2024-05-14T14:28:44.560 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-14T14:28:44.560 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} --archive /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705869 --owner scheduled_vshankar@teuthology --verbose --name vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi -- /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705869/orig.config.yaml 2024-05-14T14:28:44.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-14T14:28:44.712 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705869 branch: wip-vshankar-testing-20240509.053109-debug description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} email: vshankar@redhat.com first_in_suite: false job_id: '7705869' kernel: client: sha1: distro flavor: default kdb: true sha1: fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-vshankar-testing-20240509.053109-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: e2b755a64f0d72176b57299d02e880cf0620d780 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: e2b755a64f0d72176b57299d02e880cf0620d780 kclient: syntax: v2 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20240509.053109-debug sha1: e2b755a64f0d72176b57299d02e880cf0620d780 owner: scheduled_vshankar@teuthology priority: 120 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6285 sha1: e2b755a64f0d72176b57299d02e880cf0620d780 sleep_before_teardown: 0 subset: 548/1024 suite: fs suite_branch: wip-vshankar-testing-20240509.053109-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: e2b755a64f0d72176b57299d02e880cf0620d780 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi039.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC6aqSWTmAUa0AIGLV/ufdTrp6twR6Ej26z27LZ+uqyAOC+lwQ56GYKAmDyCdqRf16wLbeL1DDIFpQ8yF9OTcrw= smithi062.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFPqzHjL4TAmjpKfWeoblMojuxyc1SBl/ijM/lnw67I6e2eKkIIMTbBHHevyjAQi/gqWLmPVRJbKOgd5oEvd81k= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-14_07:04:04 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-14T14:28:44.712 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa; will attempt to use it 2024-05-14T14:28:44.713 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa/tasks 2024-05-14T14:28:44.713 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-14T14:28:44.714 INFO:teuthology.task.internal:Checking packages... 2024-05-14T14:28:44.742 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'e2b755a64f0d72176b57299d02e880cf0620d780' 2024-05-14T14:28:44.743 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-14T14:28:44.743 INFO:teuthology.packaging:ref: None 2024-05-14T14:28:44.743 INFO:teuthology.packaging:tag: None 2024-05-14T14:28:44.743 INFO:teuthology.packaging:branch: wip-vshankar-testing-20240509.053109-debug 2024-05-14T14:28:44.743 INFO:teuthology.packaging:sha1: e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T14:28:44.743 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-vshankar-testing-20240509.053109-debug 2024-05-14T14:28:44.890 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3588.ge2b755a6 2024-05-14T14:28:44.891 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-14T14:28:44.898 INFO:teuthology.task.internal:no buildpackages task found 2024-05-14T14:28:44.898 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-14T14:28:44.943 INFO:teuthology.task.internal:Saving configuration 2024-05-14T14:28:44.962 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-14T14:28:44.968 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-14T14:28:44.992 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi039.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705869', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-14 14:22:40.465237', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC6aqSWTmAUa0AIGLV/ufdTrp6twR6Ej26z27LZ+uqyAOC+lwQ56GYKAmDyCdqRf16wLbeL1DDIFpQ8yF9OTcrw='} 2024-05-14T14:28:45.014 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705869', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-14 14:22:40.463749', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFPqzHjL4TAmjpKfWeoblMojuxyc1SBl/ijM/lnw67I6e2eKkIIMTbBHHevyjAQi/gqWLmPVRJbKOgd5oEvd81k='} 2024-05-14T14:28:45.014 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-14T14:28:45.020 INFO:teuthology.task.internal:roles: ubuntu@smithi039.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-05-14T14:28:45.020 INFO:teuthology.task.internal:roles: ubuntu@smithi062.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-05-14T14:28:45.020 INFO:teuthology.run_tasks:Running task console_log... 2024-05-14T14:28:45.116 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7feddf506f70>, signals=[15]) 2024-05-14T14:28:45.116 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-14T14:28:45.123 INFO:teuthology.task.internal:Opening connections... 2024-05-14T14:28:45.123 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi039.front.sepia.ceph.com 2024-05-14T14:28:45.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T14:28:45.203 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi062.front.sepia.ceph.com 2024-05-14T14:28:45.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T14:28:45.276 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-14T14:28:45.283 DEBUG:teuthology.orchestra.run.smithi039:> uname -m 2024-05-14T14:28:45.301 INFO:teuthology.orchestra.run.smithi039.stdout:x86_64 2024-05-14T14:28:45.301 DEBUG:teuthology.orchestra.run.smithi039:> cat /etc/os-release 2024-05-14T14:28:45.359 INFO:teuthology.orchestra.run.smithi039.stdout:NAME="CentOS Stream" 2024-05-14T14:28:45.359 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION="9" 2024-05-14T14:28:45.359 INFO:teuthology.orchestra.run.smithi039.stdout:ID="centos" 2024-05-14T14:28:45.359 INFO:teuthology.orchestra.run.smithi039.stdout:ID_LIKE="rhel fedora" 2024-05-14T14:28:45.359 INFO:teuthology.orchestra.run.smithi039.stdout:VERSION_ID="9" 2024-05-14T14:28:45.359 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM_ID="platform:el9" 2024-05-14T14:28:45.359 INFO:teuthology.orchestra.run.smithi039.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-14T14:28:45.359 INFO:teuthology.orchestra.run.smithi039.stdout:ANSI_COLOR="0;31" 2024-05-14T14:28:45.359 INFO:teuthology.orchestra.run.smithi039.stdout:LOGO="fedora-logo-icon" 2024-05-14T14:28:45.359 INFO:teuthology.orchestra.run.smithi039.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-14T14:28:45.359 INFO:teuthology.orchestra.run.smithi039.stdout:HOME_URL="https://centos.org/" 2024-05-14T14:28:45.359 INFO:teuthology.orchestra.run.smithi039.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-14T14:28:45.359 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-14T14:28:45.360 INFO:teuthology.orchestra.run.smithi039.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-14T14:28:45.360 INFO:teuthology.lock.ops:Updating smithi039.front.sepia.ceph.com on lock server 2024-05-14T14:28:45.383 DEBUG:teuthology.orchestra.run.smithi062:> uname -m 2024-05-14T14:28:45.401 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2024-05-14T14:28:45.401 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2024-05-14T14:28:45.460 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream" 2024-05-14T14:28:45.460 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="9" 2024-05-14T14:28:45.460 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos" 2024-05-14T14:28:45.460 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora" 2024-05-14T14:28:45.460 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="9" 2024-05-14T14:28:45.460 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el9" 2024-05-14T14:28:45.461 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-14T14:28:45.461 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2024-05-14T14:28:45.461 INFO:teuthology.orchestra.run.smithi062.stdout:LOGO="fedora-logo-icon" 2024-05-14T14:28:45.461 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-14T14:28:45.461 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/" 2024-05-14T14:28:45.461 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-14T14:28:45.461 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-14T14:28:45.461 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-14T14:28:45.461 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2024-05-14T14:28:45.482 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-14T14:28:45.492 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-14T14:28:45.518 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-14T14:28:45.519 DEBUG:teuthology.orchestra.run.smithi039:> test '!' -e /home/ubuntu/cephtest 2024-05-14T14:28:45.521 DEBUG:teuthology.orchestra.run.smithi062:> test '!' -e /home/ubuntu/cephtest 2024-05-14T14:28:45.538 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-14T14:28:45.544 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-14T14:28:45.544 DEBUG:teuthology.orchestra.run.smithi039:> test -z $(ls -A /var/lib/ceph) 2024-05-14T14:28:45.579 DEBUG:teuthology.orchestra.run.smithi062:> test -z $(ls -A /var/lib/ceph) 2024-05-14T14:28:45.604 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-14T14:28:45.662 INFO:teuthology.run_tasks:Running task kernel... 2024-05-14T14:28:45.677 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e'} 2024-05-14T14:28:45.677 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-05-14T14:28:45.677 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-05-14T14:28:45.678 DEBUG:teuthology.orchestra.run.smithi039:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-14T14:28:45.678 DEBUG:teuthology.orchestra.run.smithi062:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-14T14:28:45.694 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T14:28:45.695 DEBUG:teuthology.orchestra.run.smithi039:> uname -r 2024-05-14T14:28:45.695 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T14:28:45.696 DEBUG:teuthology.orchestra.run.smithi062:> uname -r 2024-05-14T14:28:45.755 INFO:teuthology.orchestra.run.smithi039.stdout:5.14.0-437.el9.x86_64 2024-05-14T14:28:45.755 INFO:teuthology.task.kernel:Running kernel on smithi039: 5.14.0-437.el9.x86_64 2024-05-14T14:28:45.755 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum install -y kernel 2024-05-14T14:28:45.756 INFO:teuthology.orchestra.run.smithi062.stdout:5.14.0-437.el9.x86_64 2024-05-14T14:28:45.756 INFO:teuthology.task.kernel:Running kernel on smithi062: 5.14.0-437.el9.x86_64 2024-05-14T14:28:45.756 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum install -y kernel 2024-05-14T14:28:47.778 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.1 MB 00:00 2024-05-14T14:28:47.898 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.1 MB 00:00 2024-05-14T14:28:49.554 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - AppStream 29 MB/s | 19 MB 00:00 2024-05-14T14:28:51.157 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - AppStream 9.0 MB/s | 19 MB 00:02 2024-05-14T14:28:53.813 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-05-14T14:28:55.305 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 16 kB 00:00 2024-05-14T14:28:55.449 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-05-14T14:28:56.983 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - Extras packages 54 kB/s | 16 kB 00:00 2024-05-14T14:29:01.550 INFO:teuthology.orchestra.run.smithi039.stdout:Extra Packages for Enterprise Linux 3.5 MB/s | 21 MB 00:06 2024-05-14T14:29:02.750 INFO:teuthology.orchestra.run.smithi062.stdout:Extra Packages for Enterprise Linux 3.8 MB/s | 21 MB 00:05 2024-05-14T14:29:06.956 INFO:teuthology.orchestra.run.smithi039.stdout:lab-extras 45 kB/s | 1.7 kB 00:00 2024-05-14T14:29:08.184 INFO:teuthology.orchestra.run.smithi062.stdout:lab-extras 22 kB/s | 1.7 kB 00:00 2024-05-14T14:29:09.053 INFO:teuthology.orchestra.run.smithi039.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-14T14:29:09.053 INFO:teuthology.orchestra.run.smithi039.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-14T14:29:09.145 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2024-05-14T14:29:09.151 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2024-05-14T14:29:09.151 INFO:teuthology.orchestra.run.smithi039.stdout: Package Architecture Version Repository Size 2024-05-14T14:29:09.151 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2024-05-14T14:29:09.151 INFO:teuthology.orchestra.run.smithi039.stdout:Installing: 2024-05-14T14:29:09.151 INFO:teuthology.orchestra.run.smithi039.stdout: kernel x86_64 5.14.0-446.el9 baseos 550 k 2024-05-14T14:29:09.151 INFO:teuthology.orchestra.run.smithi039.stdout:Installing dependencies: 2024-05-14T14:29:09.151 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-core x86_64 5.14.0-446.el9 baseos 15 M 2024-05-14T14:29:09.151 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-modules x86_64 5.14.0-446.el9 baseos 34 M 2024-05-14T14:29:09.151 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-modules-core x86_64 5.14.0-446.el9 baseos 28 M 2024-05-14T14:29:09.151 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:29:09.151 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction Summary 2024-05-14T14:29:09.151 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2024-05-14T14:29:09.151 INFO:teuthology.orchestra.run.smithi039.stdout:Install 4 Packages 2024-05-14T14:29:09.152 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:29:09.152 INFO:teuthology.orchestra.run.smithi039.stdout:Total download size: 78 M 2024-05-14T14:29:09.153 INFO:teuthology.orchestra.run.smithi039.stdout:Installed size: 123 M 2024-05-14T14:29:09.153 INFO:teuthology.orchestra.run.smithi039.stdout:Downloading Packages: 2024-05-14T14:29:09.582 INFO:teuthology.orchestra.run.smithi039.stdout:(1/4): kernel-5.14.0-446.el9.x86_64.rpm 3.5 MB/s | 550 kB 00:00 2024-05-14T14:29:10.015 INFO:teuthology.orchestra.run.smithi039.stdout:(2/4): kernel-core-5.14.0-446.el9.x86_64.rpm 26 MB/s | 15 MB 00:00 2024-05-14T14:29:10.273 INFO:teuthology.orchestra.run.smithi062.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-14T14:29:10.273 INFO:teuthology.orchestra.run.smithi062.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-14T14:29:10.315 INFO:teuthology.orchestra.run.smithi039.stdout:(3/4): kernel-modules-5.14.0-446.el9.x86_64.rpm 38 MB/s | 34 MB 00:00 2024-05-14T14:29:10.370 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-05-14T14:29:10.387 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-14T14:29:10.387 INFO:teuthology.orchestra.run.smithi062.stdout: Package Architecture Version Repository Size 2024-05-14T14:29:10.387 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-14T14:29:10.387 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-05-14T14:29:10.387 INFO:teuthology.orchestra.run.smithi062.stdout: kernel x86_64 5.14.0-446.el9 baseos 550 k 2024-05-14T14:29:10.388 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-05-14T14:29:10.388 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-core x86_64 5.14.0-446.el9 baseos 15 M 2024-05-14T14:29:10.388 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-modules x86_64 5.14.0-446.el9 baseos 34 M 2024-05-14T14:29:10.388 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-modules-core x86_64 5.14.0-446.el9 baseos 28 M 2024-05-14T14:29:10.388 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:29:10.388 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-05-14T14:29:10.389 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-05-14T14:29:10.389 INFO:teuthology.orchestra.run.smithi062.stdout:Install 4 Packages 2024-05-14T14:29:10.389 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:29:10.390 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 78 M 2024-05-14T14:29:10.390 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 123 M 2024-05-14T14:29:10.390 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-05-14T14:29:10.601 INFO:teuthology.orchestra.run.smithi062.stdout:(1/4): kernel-5.14.0-446.el9.x86_64.rpm 3.2 MB/s | 550 kB 00:00 2024-05-14T14:29:10.649 INFO:teuthology.orchestra.run.smithi039.stdout:(4/4): kernel-modules-core-5.14.0-446.el9.x86_6 26 MB/s | 28 MB 00:01 2024-05-14T14:29:10.649 INFO:teuthology.orchestra.run.smithi039.stdout:-------------------------------------------------------------------------------- 2024-05-14T14:29:10.650 INFO:teuthology.orchestra.run.smithi039.stdout:Total 52 MB/s | 78 MB 00:01 2024-05-14T14:29:10.902 INFO:teuthology.orchestra.run.smithi062.stdout:(2/4): kernel-core-5.14.0-446.el9.x86_64.rpm 33 MB/s | 15 MB 00:00 2024-05-14T14:29:11.294 INFO:teuthology.orchestra.run.smithi062.stdout:(3/4): kernel-modules-5.14.0-446.el9.x86_64.rpm 40 MB/s | 34 MB 00:00 2024-05-14T14:29:11.363 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction check 2024-05-14T14:29:11.594 INFO:teuthology.orchestra.run.smithi062.stdout:(4/4): kernel-modules-core-5.14.0-446.el9.x86_6 28 MB/s | 28 MB 00:00 2024-05-14T14:29:11.594 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-05-14T14:29:11.594 INFO:teuthology.orchestra.run.smithi062.stdout:Total 65 MB/s | 78 MB 00:01 2024-05-14T14:29:11.793 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction check succeeded. 2024-05-14T14:29:11.794 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction test 2024-05-14T14:29:12.307 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-05-14T14:29:12.723 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-05-14T14:29:12.723 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-05-14T14:29:12.775 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction test succeeded. 2024-05-14T14:29:12.775 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction 2024-05-14T14:29:13.682 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-05-14T14:29:13.682 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-05-14T14:29:15.300 INFO:teuthology.orchestra.run.smithi039.stdout: Preparing : 1/1 2024-05-14T14:29:15.945 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : kernel-modules-core-5.14.0-446.el9.x86_64 1/4 2024-05-14T14:29:16.032 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : kernel-core-5.14.0-446.el9.x86_64 2/4 2024-05-14T14:29:16.203 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-05-14T14:29:16.825 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : kernel-modules-core-5.14.0-446.el9.x86_64 1/4 2024-05-14T14:29:16.902 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : kernel-core-5.14.0-446.el9.x86_64 2/4 2024-05-14T14:29:18.821 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-core-5.14.0-446.el9.x86_64 2/4 2024-05-14T14:29:18.967 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : kernel-modules-5.14.0-446.el9.x86_64 3/4 2024-05-14T14:29:19.708 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-core-5.14.0-446.el9.x86_64 2/4 2024-05-14T14:29:19.852 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : kernel-modules-5.14.0-446.el9.x86_64 3/4 2024-05-14T14:29:24.045 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-modules-5.14.0-446.el9.x86_64 3/4 2024-05-14T14:29:24.087 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : kernel-5.14.0-446.el9.x86_64 4/4 2024-05-14T14:29:24.924 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-modules-5.14.0-446.el9.x86_64 3/4 2024-05-14T14:29:24.972 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : kernel-5.14.0-446.el9.x86_64 4/4 2024-05-14T14:29:29.186 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-modules-core-5.14.0-446.el9.x86_64 4/4 2024-05-14T14:29:30.067 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-modules-core-5.14.0-446.el9.x86_64 4/4 2024-05-14T14:30:00.157 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-core-5.14.0-446.el9.x86_64 4/4 2024-05-14T14:30:00.197 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-modules-5.14.0-446.el9.x86_64 4/4 2024-05-14T14:30:00.490 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-5.14.0-446.el9.x86_64 4/4 2024-05-14T14:30:00.490 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : kernel-5.14.0-446.el9.x86_64 1/4 2024-05-14T14:30:00.491 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : kernel-core-5.14.0-446.el9.x86_64 2/4 2024-05-14T14:30:00.491 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : kernel-modules-5.14.0-446.el9.x86_64 3/4 2024-05-14T14:30:01.302 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : kernel-modules-core-5.14.0-446.el9.x86_64 4/4 2024-05-14T14:30:01.302 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:30:01.302 INFO:teuthology.orchestra.run.smithi039.stdout:Installed: 2024-05-14T14:30:01.302 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-5.14.0-446.el9.x86_64 2024-05-14T14:30:01.302 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-core-5.14.0-446.el9.x86_64 2024-05-14T14:30:01.302 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-modules-5.14.0-446.el9.x86_64 2024-05-14T14:30:01.302 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-modules-core-5.14.0-446.el9.x86_64 2024-05-14T14:30:01.303 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:30:01.303 INFO:teuthology.orchestra.run.smithi039.stdout:Complete! 2024-05-14T14:30:01.405 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-core-5.14.0-446.el9.x86_64 4/4 2024-05-14T14:30:01.449 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-modules-5.14.0-446.el9.x86_64 4/4 2024-05-14T14:30:01.614 DEBUG:teuthology.orchestra.run.smithi039:> rpm -q kernel | sort -rV | head -n 1 2024-05-14T14:30:01.715 INFO:teuthology.orchestra.run.smithi039.stdout:kernel-5.14.0-446.el9.x86_64 2024-05-14T14:30:01.715 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-446.el9.x86_64 2024-05-14T14:30:01.716 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-446.el9.x86_64 2024-05-14T14:30:01.716 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-14T14:30:01.716 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-14T14:30:01.716 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-05-14T14:30:01.716 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi039.front.sepia.ceph.com, path=None, version=distro) 2024-05-14T14:30:01.716 DEBUG:teuthology.orchestra.run.smithi039:> rpm -q kernel | sort -rV | head -n 1 2024-05-14T14:30:01.767 INFO:teuthology.orchestra.run.smithi039.stdout:kernel-5.14.0-446.el9.x86_64 2024-05-14T14:30:01.767 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-446.el9.x86_64 2024-05-14T14:30:01.767 DEBUG:teuthology.orchestra.run.smithi039:> sudo rpm -qi grub2-tools 2024-05-14T14:30:01.798 INFO:teuthology.orchestra.run.smithi039.stdout:Name : grub2-tools 2024-05-14T14:30:01.798 INFO:teuthology.orchestra.run.smithi039.stdout:Epoch : 1 2024-05-14T14:30:01.799 INFO:teuthology.orchestra.run.smithi039.stdout:Version : 2.06 2024-05-14T14:30:01.799 INFO:teuthology.orchestra.run.smithi039.stdout:Release : 68.el9 2024-05-14T14:30:01.799 INFO:teuthology.orchestra.run.smithi039.stdout:Architecture: x86_64 2024-05-14T14:30:01.799 INFO:teuthology.orchestra.run.smithi039.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-14T14:30:01.799 INFO:teuthology.orchestra.run.smithi039.stdout:Group : Unspecified 2024-05-14T14:30:01.799 INFO:teuthology.orchestra.run.smithi039.stdout:Size : 8264254 2024-05-14T14:30:01.799 INFO:teuthology.orchestra.run.smithi039.stdout:License : GPLv3+ 2024-05-14T14:30:01.799 INFO:teuthology.orchestra.run.smithi039.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-14T14:30:01.799 INFO:teuthology.orchestra.run.smithi039.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-14T14:30:01.799 INFO:teuthology.orchestra.run.smithi039.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-14T14:30:01.799 INFO:teuthology.orchestra.run.smithi039.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-14T14:30:01.799 INFO:teuthology.orchestra.run.smithi039.stdout:Packager : builder@centos.org 2024-05-14T14:30:01.799 INFO:teuthology.orchestra.run.smithi039.stdout:Vendor : CentOS 2024-05-14T14:30:01.799 INFO:teuthology.orchestra.run.smithi039.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-14T14:30:01.799 INFO:teuthology.orchestra.run.smithi039.stdout:Summary : Support tools for GRUB. 2024-05-14T14:30:01.799 INFO:teuthology.orchestra.run.smithi039.stdout:Description : 2024-05-14T14:30:01.800 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:30:01.800 INFO:teuthology.orchestra.run.smithi039.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-14T14:30:01.800 INFO:teuthology.orchestra.run.smithi039.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-14T14:30:01.800 INFO:teuthology.orchestra.run.smithi039.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-14T14:30:01.800 INFO:teuthology.orchestra.run.smithi039.stdout:hardware devices. 2024-05-14T14:30:01.800 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:30:01.800 INFO:teuthology.orchestra.run.smithi039.stdout:This subpackage provides tools for support of all platforms. 2024-05-14T14:30:01.801 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-14T14:30:01.801 INFO:teuthology.task.kernel:Updating grub on smithi039 to boot 5.14.0-446.el9.x86_64 2024-05-14T14:30:01.801 DEBUG:teuthology.orchestra.run.smithi039:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-14T14:30:01.850 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-5.14.0-446.el9.x86_64 4/4 2024-05-14T14:30:01.850 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : kernel-5.14.0-446.el9.x86_64 1/4 2024-05-14T14:30:01.850 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : kernel-core-5.14.0-446.el9.x86_64 2/4 2024-05-14T14:30:01.850 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : kernel-modules-5.14.0-446.el9.x86_64 3/4 2024-05-14T14:30:02.464 INFO:teuthology.orchestra.run.smithi039.stderr:Generating grub configuration file ... 2024-05-14T14:30:02.682 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : kernel-modules-core-5.14.0-446.el9.x86_64 4/4 2024-05-14T14:30:02.682 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:30:02.682 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-05-14T14:30:02.682 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-5.14.0-446.el9.x86_64 2024-05-14T14:30:02.682 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-core-5.14.0-446.el9.x86_64 2024-05-14T14:30:02.682 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-modules-5.14.0-446.el9.x86_64 2024-05-14T14:30:02.682 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-modules-core-5.14.0-446.el9.x86_64 2024-05-14T14:30:02.682 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:30:02.682 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-05-14T14:30:03.048 DEBUG:teuthology.orchestra.run.smithi062:> rpm -q kernel | sort -rV | head -n 1 2024-05-14T14:30:03.117 INFO:teuthology.orchestra.run.smithi062.stdout:kernel-5.14.0-446.el9.x86_64 2024-05-14T14:30:03.118 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-446.el9.x86_64 2024-05-14T14:30:03.118 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-446.el9.x86_64 2024-05-14T14:30:03.118 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-14T14:30:03.118 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-14T14:30:03.118 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-05-14T14:30:03.118 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi062.front.sepia.ceph.com, path=None, version=distro) 2024-05-14T14:30:03.118 DEBUG:teuthology.orchestra.run.smithi062:> rpm -q kernel | sort -rV | head -n 1 2024-05-14T14:30:03.169 INFO:teuthology.orchestra.run.smithi062.stdout:kernel-5.14.0-446.el9.x86_64 2024-05-14T14:30:03.169 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-446.el9.x86_64 2024-05-14T14:30:03.170 DEBUG:teuthology.orchestra.run.smithi062:> sudo rpm -qi grub2-tools 2024-05-14T14:30:03.203 INFO:teuthology.orchestra.run.smithi062.stdout:Name : grub2-tools 2024-05-14T14:30:03.203 INFO:teuthology.orchestra.run.smithi062.stdout:Epoch : 1 2024-05-14T14:30:03.203 INFO:teuthology.orchestra.run.smithi062.stdout:Version : 2.06 2024-05-14T14:30:03.203 INFO:teuthology.orchestra.run.smithi062.stdout:Release : 68.el9 2024-05-14T14:30:03.203 INFO:teuthology.orchestra.run.smithi062.stdout:Architecture: x86_64 2024-05-14T14:30:03.203 INFO:teuthology.orchestra.run.smithi062.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-14T14:30:03.204 INFO:teuthology.orchestra.run.smithi062.stdout:Group : Unspecified 2024-05-14T14:30:03.204 INFO:teuthology.orchestra.run.smithi062.stdout:Size : 8264254 2024-05-14T14:30:03.204 INFO:teuthology.orchestra.run.smithi062.stdout:License : GPLv3+ 2024-05-14T14:30:03.204 INFO:teuthology.orchestra.run.smithi062.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-14T14:30:03.204 INFO:teuthology.orchestra.run.smithi062.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-14T14:30:03.204 INFO:teuthology.orchestra.run.smithi062.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-14T14:30:03.204 INFO:teuthology.orchestra.run.smithi062.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-14T14:30:03.204 INFO:teuthology.orchestra.run.smithi062.stdout:Packager : builder@centos.org 2024-05-14T14:30:03.204 INFO:teuthology.orchestra.run.smithi062.stdout:Vendor : CentOS 2024-05-14T14:30:03.204 INFO:teuthology.orchestra.run.smithi062.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-14T14:30:03.204 INFO:teuthology.orchestra.run.smithi062.stdout:Summary : Support tools for GRUB. 2024-05-14T14:30:03.204 INFO:teuthology.orchestra.run.smithi062.stdout:Description : 2024-05-14T14:30:03.204 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:30:03.204 INFO:teuthology.orchestra.run.smithi062.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-14T14:30:03.204 INFO:teuthology.orchestra.run.smithi062.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-14T14:30:03.205 INFO:teuthology.orchestra.run.smithi062.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-14T14:30:03.205 INFO:teuthology.orchestra.run.smithi062.stdout:hardware devices. 2024-05-14T14:30:03.205 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:30:03.205 INFO:teuthology.orchestra.run.smithi062.stdout:This subpackage provides tools for support of all platforms. 2024-05-14T14:30:03.206 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-14T14:30:03.206 INFO:teuthology.task.kernel:Updating grub on smithi062 to boot 5.14.0-446.el9.x86_64 2024-05-14T14:30:03.206 DEBUG:teuthology.orchestra.run.smithi062:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-14T14:30:03.779 INFO:teuthology.orchestra.run.smithi062.stderr:Generating grub configuration file ... 2024-05-14T14:30:03.889 INFO:teuthology.orchestra.run.smithi039.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-14T14:30:03.919 INFO:teuthology.orchestra.run.smithi039.stderr:done 2024-05-14T14:30:03.931 DEBUG:teuthology.orchestra.run.smithi039:> mktemp 2024-05-14T14:30:03.987 INFO:teuthology.orchestra.run.smithi039.stdout:/tmp/tmp.jpTUkHqHwQ 2024-05-14T14:30:03.988 DEBUG:teuthology.orchestra.run.smithi039:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.jpTUkHqHwQ 2024-05-14T14:30:04.053 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 0666 /tmp/tmp.jpTUkHqHwQ 2024-05-14T14:30:04.194 DEBUG:teuthology.orchestra.remote:smithi039:/tmp/tmp.jpTUkHqHwQ is 6KB 2024-05-14T14:30:04.243 DEBUG:teuthology.orchestra.run.smithi039:> rm -fr /tmp/tmp.jpTUkHqHwQ 2024-05-14T14:30:04.258 DEBUG:teuthology.orchestra.run.smithi039:> sudo /bin/ls /boot/loader/entries || true 2024-05-14T14:30:04.320 INFO:teuthology.orchestra.run.smithi039.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-14T14:30:04.320 INFO:teuthology.orchestra.run.smithi039.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-14T14:30:04.320 INFO:teuthology.orchestra.run.smithi039.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-14T14:30:04.320 INFO:teuthology.orchestra.run.smithi039.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-446.el9.x86_64.conf 2024-05-14T14:30:04.321 DEBUG:teuthology.orchestra.run.smithi039:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-446.el9.x86_64 2024-05-14T14:30:04.480 DEBUG:teuthology.orchestra.run.smithi039:> sudo shutdown -r now 2024-05-14T14:30:05.187 INFO:teuthology.orchestra.run.smithi062.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-14T14:30:05.218 INFO:teuthology.orchestra.run.smithi062.stderr:done 2024-05-14T14:30:05.220 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2024-05-14T14:30:05.238 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.x6UQOW0rJY 2024-05-14T14:30:05.238 DEBUG:teuthology.orchestra.run.smithi062:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.x6UQOW0rJY 2024-05-14T14:30:05.328 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.x6UQOW0rJY 2024-05-14T14:30:05.427 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.x6UQOW0rJY is 6KB 2024-05-14T14:30:05.475 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.x6UQOW0rJY 2024-05-14T14:30:05.490 DEBUG:teuthology.orchestra.run.smithi062:> sudo /bin/ls /boot/loader/entries || true 2024-05-14T14:30:05.560 INFO:teuthology.orchestra.run.smithi062.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-14T14:30:05.560 INFO:teuthology.orchestra.run.smithi062.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-14T14:30:05.560 INFO:teuthology.orchestra.run.smithi062.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-14T14:30:05.560 INFO:teuthology.orchestra.run.smithi062.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-446.el9.x86_64.conf 2024-05-14T14:30:05.561 DEBUG:teuthology.orchestra.run.smithi062:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-446.el9.x86_64 2024-05-14T14:30:05.723 DEBUG:teuthology.orchestra.run.smithi062:> sudo shutdown -r now 2024-05-14T14:30:34.508 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-05-14T14:30:34.509 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-05-14T14:30:34.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T14:30:35.727 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-05-14T14:30:35.728 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-05-14T14:30:35.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T14:31:09.087 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-05-14T14:31:18.097 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-05-14T14:31:18.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T14:31:21.154 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.39 2024-05-14T14:31:33.167 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-05-14T14:31:33.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T14:31:35.730 DEBUG:teuthology.orchestra.remote:timed out 2024-05-14T14:31:44.738 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-05-14T14:31:44.739 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T14:31:46.057 DEBUG:teuthology.orchestra.run.smithi062:> true 2024-05-14T14:31:46.651 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-05-14T14:31:46.651 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-446.el9.x86_64"... 2024-05-14T14:31:46.652 DEBUG:teuthology.orchestra.run.smithi062:> uname -r 2024-05-14T14:31:46.667 INFO:teuthology.orchestra.run.smithi062.stdout:5.14.0-446.el9.x86_64 2024-05-14T14:31:46.667 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-446.el9.x86_64 vs 5.14.0-446.el9.x86_64 2024-05-14T14:31:46.668 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-14T14:31:46.668 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-14T14:31:47.668 DEBUG:teuthology.parallel:result is None 2024-05-14T14:32:33.169 DEBUG:teuthology.orchestra.remote:timed out 2024-05-14T14:32:48.171 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-05-14T14:32:48.172 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T14:32:48.567 DEBUG:teuthology.orchestra.run.smithi039:> true 2024-05-14T14:32:48.912 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-05-14T14:32:48.912 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-446.el9.x86_64"... 2024-05-14T14:32:48.912 DEBUG:teuthology.orchestra.run.smithi039:> uname -r 2024-05-14T14:32:48.929 INFO:teuthology.orchestra.run.smithi039.stdout:5.14.0-446.el9.x86_64 2024-05-14T14:32:48.929 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-446.el9.x86_64 vs 5.14.0-446.el9.x86_64 2024-05-14T14:32:48.929 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-14T14:32:48.929 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-14T14:32:49.930 DEBUG:teuthology.parallel:result is None 2024-05-14T14:32:49.931 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-14T14:32:49.940 INFO:teuthology.task.internal:Creating test directory... 2024-05-14T14:32:49.940 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-14T14:32:49.943 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-14T14:32:49.964 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-14T14:32:49.971 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-14T14:32:50.006 INFO:teuthology.task.internal:Creating archive directory... 2024-05-14T14:32:50.006 DEBUG:teuthology.orchestra.run.smithi039:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-14T14:32:50.009 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-14T14:32:50.046 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-14T14:32:50.052 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-14T14:32:50.053 DEBUG:teuthology.orchestra.run.smithi039:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-14T14:32:50.073 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-14T14:32:50.157 INFO:teuthology.orchestra.run.smithi039.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-14T14:32:50.179 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-14T14:32:50.197 INFO:teuthology.orchestra.run.smithi039.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-14T14:32:50.230 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-14T14:32:50.232 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-14T14:32:50.239 INFO:teuthology.task.internal:Configuring sudo... 2024-05-14T14:32:50.239 DEBUG:teuthology.orchestra.run.smithi039:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-14T14:32:50.241 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-14T14:32:50.271 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-14T14:32:50.281 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-14T14:32:50.281 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-14T14:32:50.310 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-14T14:32:50.330 DEBUG:teuthology.orchestra.run.smithi039:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-14T14:32:50.411 DEBUG:teuthology.orchestra.run.smithi039:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-14T14:32:50.455 DEBUG:teuthology.orchestra.run.smithi039:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-14T14:32:50.541 DEBUG:teuthology.orchestra.run.smithi039:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-14T14:32:50.581 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T14:32:50.581 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-14T14:32:50.648 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-14T14:32:50.694 DEBUG:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-14T14:32:50.747 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-14T14:32:50.831 DEBUG:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-14T14:32:50.877 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-14T14:32:50.877 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-14T14:32:50.946 DEBUG:teuthology.orchestra.run.smithi039:> sudo service rsyslog restart 2024-05-14T14:32:50.951 DEBUG:teuthology.orchestra.run.smithi062:> sudo service rsyslog restart 2024-05-14T14:32:50.988 INFO:teuthology.orchestra.run.smithi039.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-14T14:32:51.028 INFO:teuthology.orchestra.run.smithi062.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-14T14:32:51.424 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-14T14:32:51.433 INFO:teuthology.task.internal:Starting timer... 2024-05-14T14:32:51.433 INFO:teuthology.run_tasks:Running task pcp... 2024-05-14T14:32:51.460 INFO:teuthology.run_tasks:Running task selinux... 2024-05-14T14:32:51.492 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-05-14T14:32:51.493 DEBUG:teuthology.orchestra.run.smithi039:> sudo service auditd rotate 2024-05-14T14:32:51.603 INFO:teuthology.orchestra.run.smithi039.stdout:Rotating logs: 2024-05-14T14:32:51.605 DEBUG:teuthology.orchestra.run.smithi062:> sudo service auditd rotate 2024-05-14T14:32:51.670 INFO:teuthology.orchestra.run.smithi062.stdout:Rotating logs: 2024-05-14T14:32:51.673 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-14T14:32:51.673 DEBUG:teuthology.orchestra.run.smithi039:> /usr/sbin/getenforce 2024-05-14T14:32:51.699 INFO:teuthology.orchestra.run.smithi039.stdout:Permissive 2024-05-14T14:32:51.699 DEBUG:teuthology.orchestra.run.smithi062:> /usr/sbin/getenforce 2024-05-14T14:32:51.722 INFO:teuthology.orchestra.run.smithi062.stdout:Permissive 2024-05-14T14:32:51.722 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi039.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi062.front.sepia.ceph.com': 'permissive'} 2024-05-14T14:32:51.722 DEBUG:teuthology.orchestra.run.smithi039:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-14T14:32:51.766 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T14:32:51.767 DEBUG:teuthology.orchestra.run.smithi062:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-14T14:32:51.796 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T14:32:51.796 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-14T14:32:51.797 DEBUG:teuthology.orchestra.run.smithi039:> sudo /usr/sbin/setenforce permissive 2024-05-14T14:32:51.833 DEBUG:teuthology.orchestra.run.smithi062:> sudo /usr/sbin/setenforce permissive 2024-05-14T14:32:51.871 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-14T14:32:51.880 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-14T14:32:51.886 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-14T14:32:52.043 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-14T14:32:52.062 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-14T14:32:52.064 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi039.front.sepia.ceph.com,smithi062.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-14T14:37:27.194 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi039.front.sepia.ceph.com'), Remote(name='ubuntu@smithi062.front.sepia.ceph.com')] 2024-05-14T14:37:27.195 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-05-14T14:37:27.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi039.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T14:37:27.275 DEBUG:teuthology.orchestra.run.smithi039:> true 2024-05-14T14:37:27.358 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi039.front.sepia.ceph.com' 2024-05-14T14:37:27.359 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-05-14T14:37:27.361 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T14:37:27.474 DEBUG:teuthology.orchestra.run.smithi062:> true 2024-05-14T14:37:27.551 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-05-14T14:37:27.551 INFO:teuthology.run_tasks:Running task clock... 2024-05-14T14:37:27.563 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-14T14:37:27.563 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-14T14:37:27.564 DEBUG:teuthology.orchestra.run.smithi039:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-14T14:37:27.566 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-14T14:37:27.566 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-14T14:37:27.595 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-14T14:37:27.610 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-14T14:37:27.623 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-14T14:37:27.637 INFO:teuthology.orchestra.run.smithi039.stderr:sudo: ntpd: command not found 2024-05-14T14:37:27.639 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-14T14:37:27.648 INFO:teuthology.orchestra.run.smithi039.stdout:506 Cannot talk to daemon 2024-05-14T14:37:27.663 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-14T14:37:27.664 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: ntpd: command not found 2024-05-14T14:37:27.676 INFO:teuthology.orchestra.run.smithi062.stdout:506 Cannot talk to daemon 2024-05-14T14:37:27.678 INFO:teuthology.orchestra.run.smithi039.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-14T14:37:27.690 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-14T14:37:27.705 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-14T14:37:27.735 INFO:teuthology.orchestra.run.smithi039.stderr:bash: line 1: ntpq: command not found 2024-05-14T14:37:27.738 INFO:teuthology.orchestra.run.smithi039.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-14T14:37:27.738 INFO:teuthology.orchestra.run.smithi039.stdout:=============================================================================== 2024-05-14T14:37:27.738 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T14:37:27.738 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T14:37:27.738 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T14:37:27.738 INFO:teuthology.orchestra.run.smithi039.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T14:37:27.764 INFO:teuthology.orchestra.run.smithi062.stderr:bash: line 1: ntpq: command not found 2024-05-14T14:37:27.768 INFO:teuthology.orchestra.run.smithi062.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-14T14:37:27.768 INFO:teuthology.orchestra.run.smithi062.stdout:=============================================================================== 2024-05-14T14:37:27.768 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T14:37:27.768 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T14:37:27.768 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T14:37:27.768 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T14:37:27.769 INFO:teuthology.run_tasks:Running task install... 2024-05-14T14:37:27.776 DEBUG:teuthology.task.install:project ceph 2024-05-14T14:37:27.777 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780'}} 2024-05-14T14:37:27.777 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780'} 2024-05-14T14:37:27.777 INFO:teuthology.task.install:Using flavor: default 2024-05-14T14:37:27.782 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-14T14:37:27.783 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-14T14:37:27.783 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780', 'tag': None, 'wait_for_package': False} 2024-05-14T14:37:27.783 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T14:37:27.785 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780', 'tag': None, 'wait_for_package': False} 2024-05-14T14:37:27.786 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T14:37:27.930 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/ 2024-05-14T14:37:27.931 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3588.ge2b755a6 2024-05-14T14:37:27.938 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/ 2024-05-14T14:37:27.939 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3588.ge2b755a6 2024-05-14T14:37:28.171 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-14T14:37:28.172 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T14:37:28.172 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-14T14:37:28.182 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-14T14:37:28.182 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-14T14:37:28.182 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-14T14:37:28.199 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-14T14:37:28.199 DEBUG:teuthology.orchestra.run.smithi039:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e2b755a64f0d72176b57299d02e880cf0620d780/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-14T14:37:28.210 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-14T14:37:28.210 DEBUG:teuthology.orchestra.run.smithi062:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e2b755a64f0d72176b57299d02e880cf0620d780/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-14T14:37:28.267 DEBUG:teuthology.orchestra.run.smithi039:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-14T14:37:28.278 DEBUG:teuthology.orchestra.run.smithi062:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-14T14:37:28.344 DEBUG:teuthology.orchestra.run.smithi039:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-14T14:37:28.356 DEBUG:teuthology.orchestra.run.smithi062:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-14T14:37:28.409 INFO:teuthology.orchestra.run.smithi039.stdout:check_obsoletes = 1 2024-05-14T14:37:28.411 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum clean all 2024-05-14T14:37:28.421 INFO:teuthology.orchestra.run.smithi062.stdout:check_obsoletes = 1 2024-05-14T14:37:28.423 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum clean all 2024-05-14T14:37:28.659 INFO:teuthology.orchestra.run.smithi039.stdout:57 files removed 2024-05-14T14:37:28.670 INFO:teuthology.orchestra.run.smithi062.stdout:57 files removed 2024-05-14T14:37:28.686 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-14T14:37:28.697 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-14T14:37:29.406 INFO:teuthology.orchestra.run.smithi062.stdout:ceph packages for x86_64 200 kB/s | 84 kB 00:00 2024-05-14T14:37:29.441 INFO:teuthology.orchestra.run.smithi039.stdout:ceph packages for x86_64 180 kB/s | 84 kB 00:00 2024-05-14T14:37:29.757 INFO:teuthology.orchestra.run.smithi062.stdout:ceph noarch packages 40 kB/s | 12 kB 00:00 2024-05-14T14:37:29.825 INFO:teuthology.orchestra.run.smithi039.stdout:ceph noarch packages 36 kB/s | 12 kB 00:00 2024-05-14T14:37:30.150 INFO:teuthology.orchestra.run.smithi062.stdout:ceph source packages 5.5 kB/s | 1.9 kB 00:00 2024-05-14T14:37:30.259 INFO:teuthology.orchestra.run.smithi039.stdout:ceph source packages 4.9 kB/s | 1.9 kB 00:00 2024-05-14T14:37:32.052 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - BaseOS 4.3 MB/s | 8.1 MB 00:01 2024-05-14T14:37:33.159 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - BaseOS 2.8 MB/s | 8.1 MB 00:02 2024-05-14T14:37:34.128 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - AppStream 21 MB/s | 19 MB 00:00 2024-05-14T14:37:37.785 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - AppStream 5.5 MB/s | 19 MB 00:03 2024-05-14T14:37:39.712 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - CRB 3.3 MB/s | 6.2 MB 00:01 2024-05-14T14:37:41.488 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 16 kB 00:00 2024-05-14T14:37:42.186 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - CRB 9.2 MB/s | 6.2 MB 00:00 2024-05-14T14:37:43.159 INFO:teuthology.orchestra.run.smithi062.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-05-14T14:37:43.895 INFO:teuthology.orchestra.run.smithi039.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 16 kB 00:00 2024-05-14T14:37:45.013 INFO:teuthology.orchestra.run.smithi039.stdout:Extra Packages for Enterprise Linux 22 MB/s | 21 MB 00:00 2024-05-14T14:37:48.631 INFO:teuthology.orchestra.run.smithi062.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-05-14T14:37:50.338 INFO:teuthology.orchestra.run.smithi039.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-05-14T14:37:51.025 INFO:teuthology.orchestra.run.smithi062.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-14T14:37:51.026 INFO:teuthology.orchestra.run.smithi062.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-14T14:37:51.037 INFO:teuthology.orchestra.run.smithi062.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-14T14:37:51.038 INFO:teuthology.orchestra.run.smithi062.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-14T14:37:51.039 INFO:teuthology.orchestra.run.smithi062.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-14T14:37:51.040 INFO:teuthology.orchestra.run.smithi062.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-14T14:37:51.041 INFO:teuthology.orchestra.run.smithi062.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-14T14:37:51.044 INFO:teuthology.orchestra.run.smithi062.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-14T14:37:51.045 INFO:teuthology.orchestra.run.smithi062.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-14T14:37:51.112 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-05-14T14:37:51.123 INFO:teuthology.orchestra.run.smithi062.stdout:======================================================================================= 2024-05-14T14:37:51.123 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-05-14T14:37:51.123 INFO:teuthology.orchestra.run.smithi062.stdout:======================================================================================= 2024-05-14T14:37:51.123 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-05-14T14:37:51.123 INFO:teuthology.orchestra.run.smithi062.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-14T14:37:51.123 INFO:teuthology.orchestra.run.smithi062.stdout: ceph x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 6.6 k 2024-05-14T14:37:51.123 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 5.4 M 2024-05-14T14:37:51.123 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-fuse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 863 k 2024-05-14T14:37:51.123 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 147 k 2024-05-14T14:37:51.124 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 1.5 M 2024-05-14T14:37:51.124 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 142 k 2024-05-14T14:37:51.124 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 3.5 M 2024-05-14T14:37:51.124 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 7.4 M 2024-05-14T14:37:51.124 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-rook noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 49 k 2024-05-14T14:37:51.124 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-radosgw x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 10 M 2024-05-14T14:37:51.124 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-test x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 43 M 2024-05-14T14:37:51.124 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-volume noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 273 k 2024-05-14T14:37:51.124 INFO:teuthology.orchestra.run.smithi062.stdout: cephadm noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 763 k 2024-05-14T14:37:51.124 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-mirror x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 224 k 2024-05-14T14:37:51.124 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-shell x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 27 k 2024-05-14T14:37:51.124 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-top noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 18 k 2024-05-14T14:37:51.124 INFO:teuthology.orchestra.run.smithi062.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-14T14:37:51.125 INFO:teuthology.orchestra.run.smithi062.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-14T14:37:51.125 INFO:teuthology.orchestra.run.smithi062.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-14T14:37:51.125 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs-devel x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 32 k 2024-05-14T14:37:51.125 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 756 k 2024-05-14T14:37:51.125 INFO:teuthology.orchestra.run.smithi062.stdout: librados-devel x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 127 k 2024-05-14T14:37:51.125 INFO:teuthology.orchestra.run.smithi062.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-14T14:37:51.125 INFO:teuthology.orchestra.run.smithi062.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-14T14:37:51.125 INFO:teuthology.orchestra.run.smithi062.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-14T14:37:51.125 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-14T14:37:51.125 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-14T14:37:51.125 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-14T14:37:51.125 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cephfs x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 162 k 2024-05-14T14:37:51.125 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rados x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 321 k 2024-05-14T14:37:51.125 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rbd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 301 k 2024-05-14T14:37:51.125 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rgw x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 100 k 2024-05-14T14:37:51.126 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-fuse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 86 k 2024-05-14T14:37:51.126 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-mirror x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.0 M 2024-05-14T14:37:51.126 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-nbd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 170 k 2024-05-14T14:37:51.126 INFO:teuthology.orchestra.run.smithi062.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-14T14:37:51.126 INFO:teuthology.orchestra.run.smithi062.stdout:Upgrading: 2024-05-14T14:37:51.126 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-14T14:37:51.126 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-14T14:37:51.126 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-14T14:37:51.126 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-14T14:37:51.126 INFO:teuthology.orchestra.run.smithi062.stdout: librados2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.3 M 2024-05-14T14:37:51.126 INFO:teuthology.orchestra.run.smithi062.stdout: librbd1 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.1 M 2024-05-14T14:37:51.126 INFO:teuthology.orchestra.run.smithi062.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-14T14:37:51.126 INFO:teuthology.orchestra.run.smithi062.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-14T14:37:51.126 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-05-14T14:37:51.127 INFO:teuthology.orchestra.run.smithi062.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-14T14:37:51.127 INFO:teuthology.orchestra.run.smithi062.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-14T14:37:51.127 INFO:teuthology.orchestra.run.smithi062.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-14T14:37:51.127 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-common x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 20 M 2024-05-14T14:37:51.127 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 34 k 2024-05-14T14:37:51.127 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mds x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 2.3 M 2024-05-14T14:37:51.127 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 274 k 2024-05-14T14:37:51.127 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 4.9 M 2024-05-14T14:37:51.127 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-osd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 18 M 2024-05-14T14:37:51.127 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 16 k 2024-05-14T14:37:51.127 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-selinux x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 25 k 2024-05-14T14:37:51.127 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-14T14:37:51.127 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-14T14:37:51.127 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-14T14:37:51.127 INFO:teuthology.orchestra.run.smithi062.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-14T14:37:51.127 INFO:teuthology.orchestra.run.smithi062.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-14T14:37:51.128 INFO:teuthology.orchestra.run.smithi062.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-14T14:37:51.128 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-14T14:37:51.128 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-14T14:37:51.128 INFO:teuthology.orchestra.run.smithi062.stdout: libcephsqlite x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 157 k 2024-05-14T14:37:51.128 INFO:teuthology.orchestra.run.smithi062.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-14T14:37:51.128 INFO:teuthology.orchestra.run.smithi062.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-14T14:37:51.128 INFO:teuthology.orchestra.run.smithi062.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-14T14:37:51.128 INFO:teuthology.orchestra.run.smithi062.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-14T14:37:51.128 INFO:teuthology.orchestra.run.smithi062.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-14T14:37:51.128 INFO:teuthology.orchestra.run.smithi062.stdout: libradosstriper1 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 497 k 2024-05-14T14:37:51.128 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-14T14:37:51.128 INFO:teuthology.orchestra.run.smithi062.stdout: librgw2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 5.2 M 2024-05-14T14:37:51.128 INFO:teuthology.orchestra.run.smithi062.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-14T14:37:51.128 INFO:teuthology.orchestra.run.smithi062.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-14T14:37:51.128 INFO:teuthology.orchestra.run.smithi062.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-14T14:37:51.128 INFO:teuthology.orchestra.run.smithi062.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-14T14:37:51.129 INFO:teuthology.orchestra.run.smithi062.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-14T14:37:51.129 INFO:teuthology.orchestra.run.smithi062.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-14T14:37:51.129 INFO:teuthology.orchestra.run.smithi062.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-14T14:37:51.129 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-14T14:37:51.129 INFO:teuthology.orchestra.run.smithi062.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-14T14:37:51.129 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-14T14:37:51.129 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-14T14:37:51.129 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-14T14:37:51.129 INFO:teuthology.orchestra.run.smithi062.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-14T14:37:51.129 INFO:teuthology.orchestra.run.smithi062.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-14T14:37:51.129 INFO:teuthology.orchestra.run.smithi062.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-14T14:37:51.129 INFO:teuthology.orchestra.run.smithi062.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-14T14:37:51.129 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-14T14:37:51.129 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-argparse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 45 k 2024-05-14T14:37:51.129 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-common x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 135 k 2024-05-14T14:37:51.130 INFO:teuthology.orchestra.run.smithi062.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-14T14:37:51.130 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-14T14:37:51.130 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-14T14:37:51.130 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-14T14:37:51.130 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-14T14:37:51.130 INFO:teuthology.orchestra.run.smithi062.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-14T14:37:51.130 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-14T14:37:51.130 INFO:teuthology.orchestra.run.smithi062.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-14T14:37:51.130 INFO:teuthology.orchestra.run.smithi062.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-14T14:37:51.130 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-14T14:37:51.130 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-14T14:37:51.131 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-14T14:37:51.131 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-14T14:37:51.131 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-14T14:37:51.131 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-14T14:37:51.131 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-14T14:37:51.131 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-14T14:37:51.131 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-14T14:37:51.131 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-14T14:37:51.131 INFO:teuthology.orchestra.run.smithi062.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-14T14:37:51.131 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-14T14:37:51.132 INFO:teuthology.orchestra.run.smithi062.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-14T14:37:51.132 INFO:teuthology.orchestra.run.smithi062.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-14T14:37:51.132 INFO:teuthology.orchestra.run.smithi062.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-14T14:37:51.132 INFO:teuthology.orchestra.run.smithi062.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-14T14:37:51.132 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-14T14:37:51.132 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-14T14:37:51.132 INFO:teuthology.orchestra.run.smithi062.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-14T14:37:51.132 INFO:teuthology.orchestra.run.smithi062.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-14T14:37:51.132 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-14T14:37:51.132 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-14T14:37:51.132 INFO:teuthology.orchestra.run.smithi062.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-14T14:37:51.132 INFO:teuthology.orchestra.run.smithi062.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-14T14:37:51.133 INFO:teuthology.orchestra.run.smithi062.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-14T14:37:51.133 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-14T14:37:51.133 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-14T14:37:51.133 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-14T14:37:51.133 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-14T14:37:51.133 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-14T14:37:51.133 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-14T14:37:51.133 INFO:teuthology.orchestra.run.smithi062.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-14T14:37:51.133 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-14T14:37:51.133 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-14T14:37:51.133 INFO:teuthology.orchestra.run.smithi062.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-14T14:37:51.133 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-14T14:37:51.133 INFO:teuthology.orchestra.run.smithi062.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-14T14:37:51.133 INFO:teuthology.orchestra.run.smithi062.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-14T14:37:51.133 INFO:teuthology.orchestra.run.smithi062.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-14T14:37:51.133 INFO:teuthology.orchestra.run.smithi062.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-14T14:37:51.133 INFO:teuthology.orchestra.run.smithi062.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-14T14:37:51.134 INFO:teuthology.orchestra.run.smithi062.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-14T14:37:51.134 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-14T14:37:51.134 INFO:teuthology.orchestra.run.smithi062.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-14T14:37:51.134 INFO:teuthology.orchestra.run.smithi062.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-14T14:37:51.134 INFO:teuthology.orchestra.run.smithi062.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-14T14:37:51.134 INFO:teuthology.orchestra.run.smithi062.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-14T14:37:51.134 INFO:teuthology.orchestra.run.smithi062.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-14T14:37:51.134 INFO:teuthology.orchestra.run.smithi062.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-14T14:37:51.134 INFO:teuthology.orchestra.run.smithi062.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-14T14:37:51.134 INFO:teuthology.orchestra.run.smithi062.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-14T14:37:51.134 INFO:teuthology.orchestra.run.smithi062.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-14T14:37:51.134 INFO:teuthology.orchestra.run.smithi062.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-14T14:37:51.134 INFO:teuthology.orchestra.run.smithi062.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-14T14:37:51.135 INFO:teuthology.orchestra.run.smithi062.stdout:Installing weak dependencies: 2024-05-14T14:37:51.135 INFO:teuthology.orchestra.run.smithi062.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-14T14:37:51.135 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:37:51.135 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-05-14T14:37:51.135 INFO:teuthology.orchestra.run.smithi062.stdout:======================================================================================= 2024-05-14T14:37:51.135 INFO:teuthology.orchestra.run.smithi062.stdout:Install 148 Packages 2024-05-14T14:37:51.135 INFO:teuthology.orchestra.run.smithi062.stdout:Upgrade 8 Packages 2024-05-14T14:37:51.135 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:37:51.135 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 219 M 2024-05-14T14:37:51.135 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-05-14T14:37:52.032 INFO:teuthology.orchestra.run.smithi062.stdout:(1/156): ceph-19.0.0-3588.ge2b755a6.el9.x86_64. 23 kB/s | 6.6 kB 00:00 2024-05-14T14:37:52.486 INFO:teuthology.orchestra.run.smithi062.stdout:(2/156): ceph-fuse-19.0.0-3588.ge2b755a6.el9.x8 1.9 MB/s | 863 kB 00:00 2024-05-14T14:37:52.582 INFO:teuthology.orchestra.run.smithi062.stdout:(3/156): ceph-immutable-object-cache-19.0.0-358 1.5 MB/s | 147 kB 00:00 2024-05-14T14:37:52.740 INFO:teuthology.orchestra.run.smithi039.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-14T14:37:52.740 INFO:teuthology.orchestra.run.smithi039.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-14T14:37:52.752 INFO:teuthology.orchestra.run.smithi039.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-14T14:37:52.753 INFO:teuthology.orchestra.run.smithi039.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-14T14:37:52.754 INFO:teuthology.orchestra.run.smithi039.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-14T14:37:52.754 INFO:teuthology.orchestra.run.smithi039.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-14T14:37:52.756 INFO:teuthology.orchestra.run.smithi039.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-14T14:37:52.758 INFO:teuthology.orchestra.run.smithi039.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-14T14:37:52.759 INFO:teuthology.orchestra.run.smithi039.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-14T14:37:52.825 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2024-05-14T14:37:52.845 INFO:teuthology.orchestra.run.smithi039.stdout:======================================================================================= 2024-05-14T14:37:52.846 INFO:teuthology.orchestra.run.smithi039.stdout: Package Arch Version Repository Size 2024-05-14T14:37:52.846 INFO:teuthology.orchestra.run.smithi039.stdout:======================================================================================= 2024-05-14T14:37:52.846 INFO:teuthology.orchestra.run.smithi039.stdout:Installing: 2024-05-14T14:37:52.846 INFO:teuthology.orchestra.run.smithi039.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-14T14:37:52.846 INFO:teuthology.orchestra.run.smithi039.stdout: ceph x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 6.6 k 2024-05-14T14:37:52.846 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-base x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 5.4 M 2024-05-14T14:37:52.846 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-fuse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 863 k 2024-05-14T14:37:52.846 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 147 k 2024-05-14T14:37:52.846 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 1.5 M 2024-05-14T14:37:52.846 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 142 k 2024-05-14T14:37:52.846 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 3.5 M 2024-05-14T14:37:52.847 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 7.4 M 2024-05-14T14:37:52.847 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-rook noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 49 k 2024-05-14T14:37:52.847 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-radosgw x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 10 M 2024-05-14T14:37:52.847 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-test x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 43 M 2024-05-14T14:37:52.847 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-volume noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 273 k 2024-05-14T14:37:52.847 INFO:teuthology.orchestra.run.smithi039.stdout: cephadm noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 763 k 2024-05-14T14:37:52.847 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-mirror x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 224 k 2024-05-14T14:37:52.847 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-shell x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 27 k 2024-05-14T14:37:52.847 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-top noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 18 k 2024-05-14T14:37:52.847 INFO:teuthology.orchestra.run.smithi039.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-14T14:37:52.847 INFO:teuthology.orchestra.run.smithi039.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-14T14:37:52.847 INFO:teuthology.orchestra.run.smithi039.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-14T14:37:52.847 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs-devel x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 32 k 2024-05-14T14:37:52.847 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 756 k 2024-05-14T14:37:52.847 INFO:teuthology.orchestra.run.smithi039.stdout: librados-devel x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 127 k 2024-05-14T14:37:52.848 INFO:teuthology.orchestra.run.smithi039.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-14T14:37:52.848 INFO:teuthology.orchestra.run.smithi039.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-14T14:37:52.848 INFO:teuthology.orchestra.run.smithi039.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-14T14:37:52.848 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-14T14:37:52.848 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-14T14:37:52.848 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-14T14:37:52.848 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cephfs x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 162 k 2024-05-14T14:37:52.848 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rados x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 321 k 2024-05-14T14:37:52.848 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rbd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 301 k 2024-05-14T14:37:52.848 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rgw x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 100 k 2024-05-14T14:37:52.848 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-fuse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 86 k 2024-05-14T14:37:52.848 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-mirror x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.0 M 2024-05-14T14:37:52.848 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-nbd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 170 k 2024-05-14T14:37:52.848 INFO:teuthology.orchestra.run.smithi039.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-14T14:37:52.848 INFO:teuthology.orchestra.run.smithi039.stdout:Upgrading: 2024-05-14T14:37:52.849 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-14T14:37:52.849 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-14T14:37:52.849 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-14T14:37:52.849 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-14T14:37:52.849 INFO:teuthology.orchestra.run.smithi039.stdout: librados2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.3 M 2024-05-14T14:37:52.849 INFO:teuthology.orchestra.run.smithi039.stdout: librbd1 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.1 M 2024-05-14T14:37:52.849 INFO:teuthology.orchestra.run.smithi039.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-14T14:37:52.849 INFO:teuthology.orchestra.run.smithi039.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-14T14:37:52.849 INFO:teuthology.orchestra.run.smithi039.stdout:Installing dependencies: 2024-05-14T14:37:52.849 INFO:teuthology.orchestra.run.smithi039.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-14T14:37:52.849 INFO:teuthology.orchestra.run.smithi039.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-14T14:37:52.849 INFO:teuthology.orchestra.run.smithi039.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-14T14:37:52.849 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-common x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 20 M 2024-05-14T14:37:52.849 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 34 k 2024-05-14T14:37:52.850 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mds x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 2.3 M 2024-05-14T14:37:52.850 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 274 k 2024-05-14T14:37:52.850 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mon x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 4.9 M 2024-05-14T14:37:52.850 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-osd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 18 M 2024-05-14T14:37:52.850 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 16 k 2024-05-14T14:37:52.850 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-selinux x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 25 k 2024-05-14T14:37:52.850 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-14T14:37:52.850 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-14T14:37:52.850 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-14T14:37:52.850 INFO:teuthology.orchestra.run.smithi039.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-14T14:37:52.850 INFO:teuthology.orchestra.run.smithi039.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-14T14:37:52.850 INFO:teuthology.orchestra.run.smithi039.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-14T14:37:52.850 INFO:teuthology.orchestra.run.smithi039.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-14T14:37:52.851 INFO:teuthology.orchestra.run.smithi039.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-14T14:37:52.851 INFO:teuthology.orchestra.run.smithi039.stdout: libcephsqlite x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 157 k 2024-05-14T14:37:52.851 INFO:teuthology.orchestra.run.smithi039.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-14T14:37:52.851 INFO:teuthology.orchestra.run.smithi039.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-14T14:37:52.851 INFO:teuthology.orchestra.run.smithi039.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-14T14:37:52.851 INFO:teuthology.orchestra.run.smithi039.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-14T14:37:52.851 INFO:teuthology.orchestra.run.smithi039.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-14T14:37:52.851 INFO:teuthology.orchestra.run.smithi039.stdout: libradosstriper1 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 497 k 2024-05-14T14:37:52.851 INFO:teuthology.orchestra.run.smithi039.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-14T14:37:52.851 INFO:teuthology.orchestra.run.smithi039.stdout: librgw2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 5.2 M 2024-05-14T14:37:52.851 INFO:teuthology.orchestra.run.smithi039.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-14T14:37:52.851 INFO:teuthology.orchestra.run.smithi039.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-14T14:37:52.851 INFO:teuthology.orchestra.run.smithi039.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-14T14:37:52.851 INFO:teuthology.orchestra.run.smithi039.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-14T14:37:52.851 INFO:teuthology.orchestra.run.smithi039.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-14T14:37:52.852 INFO:teuthology.orchestra.run.smithi039.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-14T14:37:52.852 INFO:teuthology.orchestra.run.smithi039.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-14T14:37:52.852 INFO:teuthology.orchestra.run.smithi039.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-14T14:37:52.852 INFO:teuthology.orchestra.run.smithi039.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-14T14:37:52.852 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-14T14:37:52.852 INFO:teuthology.orchestra.run.smithi039.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-14T14:37:52.852 INFO:teuthology.orchestra.run.smithi039.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-14T14:37:52.852 INFO:teuthology.orchestra.run.smithi039.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-14T14:37:52.852 INFO:teuthology.orchestra.run.smithi039.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-14T14:37:52.852 INFO:teuthology.orchestra.run.smithi039.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-14T14:37:52.852 INFO:teuthology.orchestra.run.smithi039.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-14T14:37:52.852 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-14T14:37:52.852 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-argparse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 45 k 2024-05-14T14:37:52.852 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-common x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 135 k 2024-05-14T14:37:52.852 INFO:teuthology.orchestra.run.smithi039.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-14T14:37:52.852 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-14T14:37:52.853 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-14T14:37:52.853 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-14T14:37:52.853 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-14T14:37:52.853 INFO:teuthology.orchestra.run.smithi039.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-14T14:37:52.853 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-14T14:37:52.853 INFO:teuthology.orchestra.run.smithi039.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-14T14:37:52.853 INFO:teuthology.orchestra.run.smithi039.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-14T14:37:52.853 INFO:teuthology.orchestra.run.smithi039.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-14T14:37:52.853 INFO:teuthology.orchestra.run.smithi039.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-14T14:37:52.853 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-14T14:37:52.853 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-14T14:37:52.853 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-14T14:37:52.853 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-14T14:37:52.853 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-14T14:37:52.854 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-14T14:37:52.854 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-14T14:37:52.854 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-14T14:37:52.854 INFO:teuthology.orchestra.run.smithi039.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-14T14:37:52.854 INFO:teuthology.orchestra.run.smithi039.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-14T14:37:52.854 INFO:teuthology.orchestra.run.smithi039.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-14T14:37:52.854 INFO:teuthology.orchestra.run.smithi039.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-14T14:37:52.854 INFO:teuthology.orchestra.run.smithi039.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-14T14:37:52.854 INFO:teuthology.orchestra.run.smithi039.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-14T14:37:52.854 INFO:teuthology.orchestra.run.smithi039.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-14T14:37:52.854 INFO:teuthology.orchestra.run.smithi039.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-14T14:37:52.854 INFO:teuthology.orchestra.run.smithi039.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-14T14:37:52.854 INFO:teuthology.orchestra.run.smithi039.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-14T14:37:52.854 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-14T14:37:52.855 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-14T14:37:52.855 INFO:teuthology.orchestra.run.smithi039.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-14T14:37:52.855 INFO:teuthology.orchestra.run.smithi039.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-14T14:37:52.855 INFO:teuthology.orchestra.run.smithi039.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-14T14:37:52.855 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-14T14:37:52.855 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-14T14:37:52.855 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-14T14:37:52.855 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-14T14:37:52.855 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-14T14:37:52.856 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-14T14:37:52.856 INFO:teuthology.orchestra.run.smithi039.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-14T14:37:52.856 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-14T14:37:52.856 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-14T14:37:52.856 INFO:teuthology.orchestra.run.smithi039.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-14T14:37:52.856 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-14T14:37:52.856 INFO:teuthology.orchestra.run.smithi039.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-14T14:37:52.856 INFO:teuthology.orchestra.run.smithi039.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-14T14:37:52.856 INFO:teuthology.orchestra.run.smithi039.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-14T14:37:52.856 INFO:teuthology.orchestra.run.smithi039.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-14T14:37:52.857 INFO:teuthology.orchestra.run.smithi039.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-14T14:37:52.857 INFO:teuthology.orchestra.run.smithi039.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-14T14:37:52.857 INFO:teuthology.orchestra.run.smithi039.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-14T14:37:52.857 INFO:teuthology.orchestra.run.smithi039.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-14T14:37:52.857 INFO:teuthology.orchestra.run.smithi039.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-14T14:37:52.857 INFO:teuthology.orchestra.run.smithi039.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-14T14:37:52.857 INFO:teuthology.orchestra.run.smithi039.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-14T14:37:52.857 INFO:teuthology.orchestra.run.smithi039.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-14T14:37:52.857 INFO:teuthology.orchestra.run.smithi039.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-14T14:37:52.857 INFO:teuthology.orchestra.run.smithi039.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-14T14:37:52.857 INFO:teuthology.orchestra.run.smithi039.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-14T14:37:52.857 INFO:teuthology.orchestra.run.smithi039.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-14T14:37:52.857 INFO:teuthology.orchestra.run.smithi039.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-14T14:37:52.857 INFO:teuthology.orchestra.run.smithi039.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-14T14:37:52.857 INFO:teuthology.orchestra.run.smithi039.stdout:Installing weak dependencies: 2024-05-14T14:37:52.858 INFO:teuthology.orchestra.run.smithi039.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-14T14:37:52.858 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:37:52.858 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction Summary 2024-05-14T14:37:52.858 INFO:teuthology.orchestra.run.smithi039.stdout:======================================================================================= 2024-05-14T14:37:52.858 INFO:teuthology.orchestra.run.smithi039.stdout:Install 148 Packages 2024-05-14T14:37:52.858 INFO:teuthology.orchestra.run.smithi039.stdout:Upgrade 8 Packages 2024-05-14T14:37:52.858 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:37:52.858 INFO:teuthology.orchestra.run.smithi039.stdout:Total download size: 219 M 2024-05-14T14:37:52.858 INFO:teuthology.orchestra.run.smithi039.stdout:Downloading Packages: 2024-05-14T14:37:52.899 INFO:teuthology.orchestra.run.smithi062.stdout:(4/156): ceph-mds-19.0.0-3588.ge2b755a6.el9.x86 7.1 MB/s | 2.3 MB 00:00 2024-05-14T14:37:53.125 INFO:teuthology.orchestra.run.smithi062.stdout:(5/156): ceph-mgr-19.0.0-3588.ge2b755a6.el9.x86 6.7 MB/s | 1.5 MB 00:00 2024-05-14T14:37:53.592 INFO:teuthology.orchestra.run.smithi062.stdout:(6/156): ceph-base-19.0.0-3588.ge2b755a6.el9.x8 2.9 MB/s | 5.4 MB 00:01 2024-05-14T14:37:53.631 INFO:teuthology.orchestra.run.smithi039.stdout:(1/156): ceph-19.0.0-3588.ge2b755a6.el9.x86_64. 33 kB/s | 6.6 kB 00:00 2024-05-14T14:37:53.751 INFO:teuthology.orchestra.run.smithi062.stdout:(7/156): ceph-mon-19.0.0-3588.ge2b755a6.el9.x86 7.8 MB/s | 4.9 MB 00:00 2024-05-14T14:37:54.059 INFO:teuthology.orchestra.run.smithi062.stdout:(8/156): ceph-common-19.0.0-3588.ge2b755a6.el9. 8.5 MB/s | 20 MB 00:02 2024-05-14T14:37:54.159 INFO:teuthology.orchestra.run.smithi062.stdout:(9/156): ceph-selinux-19.0.0-3588.ge2b755a6.el9 252 kB/s | 25 kB 00:00 2024-05-14T14:37:54.248 INFO:teuthology.orchestra.run.smithi039.stdout:(2/156): ceph-fuse-19.0.0-3588.ge2b755a6.el9.x8 1.4 MB/s | 863 kB 00:00 2024-05-14T14:37:54.423 INFO:teuthology.orchestra.run.smithi039.stdout:(3/156): ceph-immutable-object-cache-19.0.0-358 840 kB/s | 147 kB 00:00 2024-05-14T14:37:55.415 INFO:teuthology.orchestra.run.smithi039.stdout:(4/156): ceph-mds-19.0.0-3588.ge2b755a6.el9.x86 2.3 MB/s | 2.3 MB 00:00 2024-05-14T14:37:55.443 INFO:teuthology.orchestra.run.smithi062.stdout:(10/156): ceph-radosgw-19.0.0-3588.ge2b755a6.el 6.0 MB/s | 10 MB 00:01 2024-05-14T14:37:55.543 INFO:teuthology.orchestra.run.smithi062.stdout:(11/156): cephfs-mirror-19.0.0-3588.ge2b755a6.e 2.2 MB/s | 224 kB 00:00 2024-05-14T14:37:55.668 INFO:teuthology.orchestra.run.smithi062.stdout:(12/156): cephfs-shell-19.0.0-3588.ge2b755a6.el 216 kB/s | 27 kB 00:00 2024-05-14T14:37:55.760 INFO:teuthology.orchestra.run.smithi062.stdout:(13/156): libcephfs-devel-19.0.0-3588.ge2b755a6 346 kB/s | 32 kB 00:00 2024-05-14T14:37:55.840 INFO:teuthology.orchestra.run.smithi039.stdout:(5/156): ceph-mgr-19.0.0-3588.ge2b755a6.el9.x86 3.5 MB/s | 1.5 MB 00:00 2024-05-14T14:37:55.977 INFO:teuthology.orchestra.run.smithi062.stdout:(14/156): libcephfs2-19.0.0-3588.ge2b755a6.el9. 3.4 MB/s | 756 kB 00:00 2024-05-14T14:37:56.136 INFO:teuthology.orchestra.run.smithi062.stdout:(15/156): libcephsqlite-19.0.0-3588.ge2b755a6.e 993 kB/s | 157 kB 00:00 2024-05-14T14:37:56.253 INFO:teuthology.orchestra.run.smithi062.stdout:(16/156): librados-devel-19.0.0-3588.ge2b755a6. 1.1 MB/s | 127 kB 00:00 2024-05-14T14:37:56.340 INFO:teuthology.orchestra.run.smithi039.stdout:(6/156): ceph-base-19.0.0-3588.ge2b755a6.el9.x8 1.9 MB/s | 5.4 MB 00:02 2024-05-14T14:37:56.703 INFO:teuthology.orchestra.run.smithi062.stdout:(17/156): ceph-osd-19.0.0-3588.ge2b755a6.el9.x8 5.7 MB/s | 18 MB 00:03 2024-05-14T14:37:56.774 INFO:teuthology.orchestra.run.smithi039.stdout:(7/156): ceph-common-19.0.0-3588.ge2b755a6.el9. 5.9 MB/s | 20 MB 00:03 2024-05-14T14:37:56.778 INFO:teuthology.orchestra.run.smithi062.stdout:(18/156): libradosstriper1-19.0.0-3588.ge2b755a 946 kB/s | 497 kB 00:00 2024-05-14T14:37:56.841 INFO:teuthology.orchestra.run.smithi039.stdout:(8/156): ceph-mon-19.0.0-3588.ge2b755a6.el9.x86 4.9 MB/s | 4.9 MB 00:01 2024-05-14T14:37:56.853 INFO:teuthology.orchestra.run.smithi062.stdout:(19/156): python3-ceph-argparse-19.0.0-3588.ge2 601 kB/s | 45 kB 00:00 2024-05-14T14:37:56.891 INFO:teuthology.orchestra.run.smithi039.stdout:(9/156): ceph-selinux-19.0.0-3588.ge2b755a6.el9 507 kB/s | 25 kB 00:00 2024-05-14T14:37:56.929 INFO:teuthology.orchestra.run.smithi062.stdout:(20/156): python3-ceph-common-19.0.0-3588.ge2b7 1.8 MB/s | 135 kB 00:00 2024-05-14T14:37:57.046 INFO:teuthology.orchestra.run.smithi062.stdout:(21/156): python3-cephfs-19.0.0-3588.ge2b755a6. 1.4 MB/s | 162 kB 00:00 2024-05-14T14:37:57.179 INFO:teuthology.orchestra.run.smithi062.stdout:(22/156): python3-rados-19.0.0-3588.ge2b755a6.e 2.4 MB/s | 321 kB 00:00 2024-05-14T14:37:57.321 INFO:teuthology.orchestra.run.smithi062.stdout:(23/156): python3-rbd-19.0.0-3588.ge2b755a6.el9 2.1 MB/s | 301 kB 00:00 2024-05-14T14:37:57.463 INFO:teuthology.orchestra.run.smithi062.stdout:(24/156): python3-rgw-19.0.0-3588.ge2b755a6.el9 702 kB/s | 100 kB 00:00 2024-05-14T14:37:57.555 INFO:teuthology.orchestra.run.smithi062.stdout:(25/156): librgw2-19.0.0-3588.ge2b755a6.el9.x86 6.1 MB/s | 5.2 MB 00:00 2024-05-14T14:37:57.589 INFO:teuthology.orchestra.run.smithi062.stdout:(26/156): rbd-fuse-19.0.0-3588.ge2b755a6.el9.x8 686 kB/s | 86 kB 00:00 2024-05-14T14:37:57.714 INFO:teuthology.orchestra.run.smithi062.stdout:(27/156): rbd-nbd-19.0.0-3588.ge2b755a6.el9.x86 1.3 MB/s | 170 kB 00:00 2024-05-14T14:37:57.831 INFO:teuthology.orchestra.run.smithi062.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3588.g 294 kB/s | 34 kB 00:00 2024-05-14T14:37:57.948 INFO:teuthology.orchestra.run.smithi062.stdout:(29/156): ceph-mgr-cephadm-19.0.0-3588.ge2b755a 1.2 MB/s | 142 kB 00:00 2024-05-14T14:37:58.207 INFO:teuthology.orchestra.run.smithi062.stdout:(30/156): rbd-mirror-19.0.0-3588.ge2b755a6.el9. 4.7 MB/s | 3.0 MB 00:00 2024-05-14T14:37:59.040 INFO:teuthology.orchestra.run.smithi062.stdout:(31/156): ceph-mgr-dashboard-19.0.0-3588.ge2b75 3.2 MB/s | 3.5 MB 00:01 2024-05-14T14:37:59.108 INFO:teuthology.orchestra.run.smithi039.stdout:(10/156): ceph-radosgw-19.0.0-3588.ge2b755a6.el 4.3 MB/s | 10 MB 00:02 2024-05-14T14:37:59.149 INFO:teuthology.orchestra.run.smithi062.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3588.ge2 2.5 MB/s | 274 kB 00:00 2024-05-14T14:37:59.191 INFO:teuthology.orchestra.run.smithi039.stdout:(11/156): cephfs-mirror-19.0.0-3588.ge2b755a6.e 2.6 MB/s | 224 kB 00:00 2024-05-14T14:37:59.266 INFO:teuthology.orchestra.run.smithi062.stdout:(33/156): ceph-mgr-rook-19.0.0-3588.ge2b755a6.e 422 kB/s | 49 kB 00:00 2024-05-14T14:37:59.266 INFO:teuthology.orchestra.run.smithi039.stdout:(12/156): cephfs-shell-19.0.0-3588.ge2b755a6.el 361 kB/s | 27 kB 00:00 2024-05-14T14:37:59.325 INFO:teuthology.orchestra.run.smithi039.stdout:(13/156): libcephfs-devel-19.0.0-3588.ge2b755a6 542 kB/s | 32 kB 00:00 2024-05-14T14:37:59.366 INFO:teuthology.orchestra.run.smithi062.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3588.ge 164 kB/s | 16 kB 00:00 2024-05-14T14:37:59.491 INFO:teuthology.orchestra.run.smithi062.stdout:(35/156): ceph-volume-19.0.0-3588.ge2b755a6.el9 2.1 MB/s | 273 kB 00:00 2024-05-14T14:37:59.584 INFO:teuthology.orchestra.run.smithi039.stdout:(14/156): libcephfs2-19.0.0-3588.ge2b755a6.el9. 2.9 MB/s | 756 kB 00:00 2024-05-14T14:37:59.625 INFO:teuthology.orchestra.run.smithi062.stdout:(36/156): ceph-mgr-diskprediction-local-19.0.0- 5.2 MB/s | 7.4 MB 00:01 2024-05-14T14:37:59.650 INFO:teuthology.orchestra.run.smithi039.stdout:(15/156): libcephsqlite-19.0.0-3588.ge2b755a6.e 2.3 MB/s | 157 kB 00:00 2024-05-14T14:37:59.717 INFO:teuthology.orchestra.run.smithi062.stdout:(37/156): cephfs-top-19.0.0-3588.ge2b755a6.el9. 200 kB/s | 18 kB 00:00 2024-05-14T14:37:59.718 INFO:teuthology.orchestra.run.smithi039.stdout:(16/156): librados-devel-19.0.0-3588.ge2b755a6. 1.9 MB/s | 127 kB 00:00 2024-05-14T14:37:59.742 INFO:teuthology.orchestra.run.smithi062.stdout:(38/156): cephadm-19.0.0-3588.ge2b755a6.el9.noa 3.0 MB/s | 763 kB 00:00 2024-05-14T14:37:59.826 INFO:teuthology.orchestra.run.smithi062.stdout:(39/156): fuse-2.9.9-15.el9.x86_64.rpm 740 kB/s | 80 kB 00:00 2024-05-14T14:37:59.868 INFO:teuthology.orchestra.run.smithi039.stdout:(17/156): libradosstriper1-19.0.0-3588.ge2b755a 3.2 MB/s | 497 kB 00:00 2024-05-14T14:37:59.893 INFO:teuthology.orchestra.run.smithi062.stdout:(40/156): libquadmath-11.4.1-3.el9.x86_64.rpm 2.9 MB/s | 195 kB 00:00 2024-05-14T14:37:59.968 INFO:teuthology.orchestra.run.smithi062.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-05-14T14:37:59.994 INFO:teuthology.orchestra.run.smithi062.stdout:(42/156): libgfortran-11.4.1-3.el9.x86_64.rpm 3.1 MB/s | 803 kB 00:00 2024-05-14T14:38:00.069 INFO:teuthology.orchestra.run.smithi062.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 12 MB/s | 1.2 MB 00:00 2024-05-14T14:38:00.094 INFO:teuthology.orchestra.run.smithi062.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 106 kB 00:00 2024-05-14T14:38:00.136 INFO:teuthology.orchestra.run.smithi062.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-05-14T14:38:00.161 INFO:teuthology.orchestra.run.smithi062.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-05-14T14:38:00.186 INFO:teuthology.orchestra.run.smithi062.stdout:(47/156): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-05-14T14:38:00.537 INFO:teuthology.orchestra.run.smithi062.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 1.8 MB/s | 689 kB 00:00 2024-05-14T14:38:00.595 INFO:teuthology.orchestra.run.smithi062.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-05-14T14:38:00.646 INFO:teuthology.orchestra.run.smithi062.stdout:(50/156): elfutils-libelf-devel-0.190-2.el9.x86 431 kB/s | 21 kB 00:00 2024-05-14T14:38:00.671 INFO:teuthology.orchestra.run.smithi062.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 1.9 MB/s | 943 kB 00:00 2024-05-14T14:38:00.738 INFO:teuthology.orchestra.run.smithi062.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 490 kB/s | 33 kB 00:00 2024-05-14T14:38:00.760 INFO:teuthology.orchestra.run.smithi039.stdout:(18/156): ceph-test-19.0.0-3588.ge2b755a6.el9.x 11 MB/s | 43 MB 00:03 2024-05-14T14:38:00.763 INFO:teuthology.orchestra.run.smithi062.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-05-14T14:38:00.810 INFO:teuthology.orchestra.run.smithi039.stdout:(19/156): python3-ceph-argparse-19.0.0-3588.ge2 905 kB/s | 45 kB 00:00 2024-05-14T14:38:00.822 INFO:teuthology.orchestra.run.smithi062.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 312 kB/s | 18 kB 00:00 2024-05-14T14:38:00.860 INFO:teuthology.orchestra.run.smithi039.stdout:(20/156): python3-ceph-common-19.0.0-3588.ge2b7 2.7 MB/s | 135 kB 00:00 2024-05-14T14:38:00.880 INFO:teuthology.orchestra.run.smithi062.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 191 kB/s | 11 kB 00:00 2024-05-14T14:38:00.928 INFO:teuthology.orchestra.run.smithi039.stdout:(21/156): librgw2-19.0.0-3588.ge2b755a6.el9.x86 4.9 MB/s | 5.2 MB 00:01 2024-05-14T14:38:00.953 INFO:teuthology.orchestra.run.smithi039.stdout:(22/156): python3-cephfs-19.0.0-3588.ge2b755a6. 1.7 MB/s | 162 kB 00:00 2024-05-14T14:38:00.956 INFO:teuthology.orchestra.run.smithi062.stdout:(56/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-05-14T14:38:01.003 INFO:teuthology.orchestra.run.smithi039.stdout:(23/156): python3-rados-19.0.0-3588.ge2b755a6.e 4.2 MB/s | 321 kB 00:00 2024-05-14T14:38:01.006 INFO:teuthology.orchestra.run.smithi062.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 910 kB/s | 45 kB 00:00 2024-05-14T14:38:01.029 INFO:teuthology.orchestra.run.smithi039.stdout:(24/156): python3-rbd-19.0.0-3588.ge2b755a6.el9 3.9 MB/s | 301 kB 00:00 2024-05-14T14:38:01.054 INFO:teuthology.orchestra.run.smithi039.stdout:(25/156): python3-rgw-19.0.0-3588.ge2b755a6.el9 1.9 MB/s | 100 kB 00:00 2024-05-14T14:38:01.079 INFO:teuthology.orchestra.run.smithi039.stdout:(26/156): rbd-fuse-19.0.0-3588.ge2b755a6.el9.x8 1.7 MB/s | 86 kB 00:00 2024-05-14T14:38:01.138 INFO:teuthology.orchestra.run.smithi039.stdout:(27/156): rbd-nbd-19.0.0-3588.ge2b755a6.el9.x86 2.9 MB/s | 170 kB 00:00 2024-05-14T14:38:01.139 INFO:teuthology.orchestra.run.smithi062.stdout:(58/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.9 MB/s | 662 kB 00:00 2024-05-14T14:38:01.188 INFO:teuthology.orchestra.run.smithi039.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3588.g 684 kB/s | 34 kB 00:00 2024-05-14T14:38:01.238 INFO:teuthology.orchestra.run.smithi039.stdout:(29/156): ceph-mgr-cephadm-19.0.0-3588.ge2b755a 2.8 MB/s | 142 kB 00:00 2024-05-14T14:38:01.332 INFO:teuthology.orchestra.run.smithi062.stdout:(59/156): libtool-2.4.6-45.el9.x86_64.rpm 3.0 MB/s | 582 kB 00:00 2024-05-14T14:38:01.398 INFO:teuthology.orchestra.run.smithi062.stdout:(60/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 383 kB/s | 25 kB 00:00 2024-05-14T14:38:01.449 INFO:teuthology.orchestra.run.smithi062.stdout:(61/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.2 MB/s | 3.0 MB 00:00 2024-05-14T14:38:01.474 INFO:teuthology.orchestra.run.smithi062.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 629 kB/s | 47 kB 00:00 2024-05-14T14:38:01.508 INFO:teuthology.orchestra.run.smithi062.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-05-14T14:38:01.585 INFO:teuthology.orchestra.run.smithi039.stdout:(30/156): rbd-mirror-19.0.0-3588.ge2b755a6.el9. 6.6 MB/s | 3.0 MB 00:00 2024-05-14T14:38:01.585 INFO:teuthology.orchestra.run.smithi039.stdout:(31/156): ceph-mgr-dashboard-19.0.0-3588.ge2b75 11 MB/s | 3.5 MB 00:00 2024-05-14T14:38:01.585 INFO:teuthology.orchestra.run.smithi062.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-05-14T14:38:01.585 INFO:teuthology.orchestra.run.smithi062.stdout:(65/156): openblas-0.3.21-2.el9.x86_64.rpm 702 kB/s | 35 kB 00:00 2024-05-14T14:38:01.622 INFO:teuthology.orchestra.run.smithi039.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3588.ge2 5.4 MB/s | 274 kB 00:00 2024-05-14T14:38:01.673 INFO:teuthology.orchestra.run.smithi039.stdout:(33/156): ceph-mgr-rook-19.0.0-3588.ge2b755a6.e 988 kB/s | 49 kB 00:00 2024-05-14T14:38:01.723 INFO:teuthology.orchestra.run.smithi039.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3588.ge 330 kB/s | 16 kB 00:00 2024-05-14T14:38:01.781 INFO:teuthology.orchestra.run.smithi039.stdout:(35/156): ceph-volume-19.0.0-3588.ge2b755a6.el9 4.6 MB/s | 273 kB 00:00 2024-05-14T14:38:01.865 INFO:teuthology.orchestra.run.smithi039.stdout:(36/156): cephadm-19.0.0-3588.ge2b755a6.el9.noa 9.0 MB/s | 763 kB 00:00 2024-05-14T14:38:01.916 INFO:teuthology.orchestra.run.smithi039.stdout:(37/156): cephfs-top-19.0.0-3588.ge2b755a6.el9. 365 kB/s | 18 kB 00:00 2024-05-14T14:38:01.942 INFO:teuthology.orchestra.run.smithi062.stdout:(66/156): ceph-test-19.0.0-3588.ge2b755a6.el9.x 5.6 MB/s | 43 MB 00:07 2024-05-14T14:38:02.041 INFO:teuthology.orchestra.run.smithi039.stdout:(38/156): fuse-2.9.9-15.el9.x86_64.rpm 643 kB/s | 80 kB 00:00 2024-05-14T14:38:02.142 INFO:teuthology.orchestra.run.smithi062.stdout:(67/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 7.6 MB/s | 4.4 MB 00:00 2024-05-14T14:38:02.158 INFO:teuthology.orchestra.run.smithi039.stdout:(39/156): libgfortran-11.4.1-3.el9.x86_64.rpm 6.7 MB/s | 803 kB 00:00 2024-05-14T14:38:02.226 INFO:teuthology.orchestra.run.smithi062.stdout:(68/156): postgresql-13.14-1.el9.x86_64.rpm 5.6 MB/s | 1.6 MB 00:00 2024-05-14T14:38:02.268 INFO:teuthology.orchestra.run.smithi062.stdout:(69/156): postgresql-contrib-13.14-1.el9.x86_64 7.1 MB/s | 911 kB 00:00 2024-05-14T14:38:02.293 INFO:teuthology.orchestra.run.smithi062.stdout:(70/156): postgresql-private-libs-13.14-1.el9.x 2.0 MB/s | 133 kB 00:00 2024-05-14T14:38:02.358 INFO:teuthology.orchestra.run.smithi039.stdout:(40/156): ceph-osd-19.0.0-3588.ge2b755a6.el9.x8 2.9 MB/s | 18 MB 00:06 2024-05-14T14:38:02.368 INFO:teuthology.orchestra.run.smithi062.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-05-14T14:38:02.383 INFO:teuthology.orchestra.run.smithi039.stdout:(41/156): libquadmath-11.4.1-3.el9.x86_64.rpm 867 kB/s | 195 kB 00:00 2024-05-14T14:38:02.452 INFO:teuthology.orchestra.run.smithi062.stdout:(72/156): openblas-openmp-0.3.21-2.el9.x86_64.r 5.2 MB/s | 4.7 MB 00:00 2024-05-14T14:38:02.477 INFO:teuthology.orchestra.run.smithi062.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 806 kB/s | 87 kB 00:00 2024-05-14T14:38:02.525 INFO:teuthology.orchestra.run.smithi039.stdout:(42/156): ceph-mgr-diskprediction-local-19.0.0- 7.3 MB/s | 7.4 MB 00:01 2024-05-14T14:38:02.527 INFO:teuthology.orchestra.run.smithi062.stdout:(74/156): python3-devel-3.9.18-3.el9.x86_64.rpm 4.8 MB/s | 244 kB 00:00 2024-05-14T14:38:02.567 INFO:teuthology.orchestra.run.smithi039.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 6.7 MB/s | 1.2 MB 00:00 2024-05-14T14:38:02.577 INFO:teuthology.orchestra.run.smithi062.stdout:(75/156): python3-jinja2-2.11.3-5.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-05-14T14:38:02.592 INFO:teuthology.orchestra.run.smithi039.stdout:(44/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-05-14T14:38:02.617 INFO:teuthology.orchestra.run.smithi039.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-05-14T14:38:02.628 INFO:teuthology.orchestra.run.smithi062.stdout:(76/156): python3-jsonpatch-1.21-16.el9.noarch. 513 kB/s | 26 kB 00:00 2024-05-14T14:38:02.643 INFO:teuthology.orchestra.run.smithi039.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-05-14T14:38:02.668 INFO:teuthology.orchestra.run.smithi039.stdout:(47/156): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-05-14T14:38:02.694 INFO:teuthology.orchestra.run.smithi039.stdout:(48/156): python3-ply-3.11-14.el9.noarch.rpm 634 kB/s | 106 kB 00:00 2024-05-14T14:38:02.711 INFO:teuthology.orchestra.run.smithi062.stdout:(77/156): postgresql-server-13.14-1.el9.x86_64. 13 MB/s | 5.8 MB 00:00 2024-05-14T14:38:02.737 INFO:teuthology.orchestra.run.smithi062.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 176 kB/s | 19 kB 00:00 2024-05-14T14:38:02.779 INFO:teuthology.orchestra.run.smithi062.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-05-14T14:38:02.803 INFO:teuthology.orchestra.run.smithi039.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 989 kB/s | 107 kB 00:00 2024-05-14T14:38:02.812 INFO:teuthology.orchestra.run.smithi062.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 462 kB/s | 35 kB 00:00 2024-05-14T14:38:02.828 INFO:teuthology.orchestra.run.smithi039.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 3.7 MB/s | 689 kB 00:00 2024-05-14T14:38:02.853 INFO:teuthology.orchestra.run.smithi039.stdout:(51/156): elfutils-libelf-devel-0.190-2.el9.x86 427 kB/s | 21 kB 00:00 2024-05-14T14:38:02.887 INFO:teuthology.orchestra.run.smithi039.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 4.2 MB/s | 943 kB 00:00 2024-05-14T14:38:02.912 INFO:teuthology.orchestra.run.smithi039.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 560 kB/s | 33 kB 00:00 2024-05-14T14:38:02.937 INFO:teuthology.orchestra.run.smithi039.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-05-14T14:38:02.962 INFO:teuthology.orchestra.run.smithi039.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-05-14T14:38:02.988 INFO:teuthology.orchestra.run.smithi039.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-05-14T14:38:03.013 INFO:teuthology.orchestra.run.smithi039.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-05-14T14:38:03.038 INFO:teuthology.orchestra.run.smithi039.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 902 kB/s | 45 kB 00:00 2024-05-14T14:38:03.080 INFO:teuthology.orchestra.run.smithi039.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-05-14T14:38:03.114 INFO:teuthology.orchestra.run.smithi039.stdout:(60/156): libtool-2.4.6-45.el9.x86_64.rpm 7.6 MB/s | 582 kB 00:00 2024-05-14T14:38:03.139 INFO:teuthology.orchestra.run.smithi039.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 434 kB/s | 25 kB 00:00 2024-05-14T14:38:03.164 INFO:teuthology.orchestra.run.smithi039.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-05-14T14:38:03.188 INFO:teuthology.orchestra.run.smithi062.stdout:(81/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-05-14T14:38:03.190 INFO:teuthology.orchestra.run.smithi039.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-05-14T14:38:03.215 INFO:teuthology.orchestra.run.smithi039.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-05-14T14:38:03.240 INFO:teuthology.orchestra.run.smithi039.stdout:(65/156): openblas-0.3.21-2.el9.x86_64.rpm 701 kB/s | 35 kB 00:00 2024-05-14T14:38:03.246 INFO:teuthology.orchestra.run.smithi062.stdout:(82/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.8 MB/s | 222 kB 00:00 2024-05-14T14:38:03.288 INFO:teuthology.orchestra.run.smithi062.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 527 kB/s | 250 kB 00:00 2024-05-14T14:38:03.299 INFO:teuthology.orchestra.run.smithi039.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.3 MB/s | 3.0 MB 00:00 2024-05-14T14:38:03.314 INFO:teuthology.orchestra.run.smithi062.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-05-14T14:38:03.347 INFO:teuthology.orchestra.run.smithi062.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 724 kB/s | 42 kB 00:00 2024-05-14T14:38:03.372 INFO:teuthology.orchestra.run.smithi062.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-05-14T14:38:03.391 INFO:teuthology.orchestra.run.smithi039.stdout:(67/156): openblas-openmp-0.3.21-2.el9.x86_64.r 27 MB/s | 4.7 MB 00:00 2024-05-14T14:38:03.424 INFO:teuthology.orchestra.run.smithi062.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.0 MB/s | 159 kB 00:00 2024-05-14T14:38:03.425 INFO:teuthology.orchestra.run.smithi039.stdout:(68/156): postgresql-13.14-1.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-05-14T14:38:03.448 INFO:teuthology.orchestra.run.smithi062.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-05-14T14:38:03.473 INFO:teuthology.orchestra.run.smithi062.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-05-14T14:38:03.491 INFO:teuthology.orchestra.run.smithi039.stdout:(69/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-05-14T14:38:03.498 INFO:teuthology.orchestra.run.smithi062.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-05-14T14:38:03.517 INFO:teuthology.orchestra.run.smithi039.stdout:(70/156): postgresql-private-libs-13.14-1.el9.x 1.4 MB/s | 133 kB 00:00 2024-05-14T14:38:03.549 INFO:teuthology.orchestra.run.smithi062.stdout:(91/156): python3-toml-0.10.2-6.el9.noarch.rpm 835 kB/s | 42 kB 00:00 2024-05-14T14:38:03.558 INFO:teuthology.orchestra.run.smithi039.stdout:(71/156): postgresql-contrib-13.14-1.el9.x86_64 5.3 MB/s | 911 kB 00:00 2024-05-14T14:38:03.599 INFO:teuthology.orchestra.run.smithi062.stdout:(92/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 882 kB/s | 44 kB 00:00 2024-05-14T14:38:03.601 INFO:teuthology.orchestra.run.smithi039.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-05-14T14:38:03.617 INFO:teuthology.orchestra.run.smithi039.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-05-14T14:38:03.658 INFO:teuthology.orchestra.run.smithi062.stdout:(93/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-05-14T14:38:03.660 INFO:teuthology.orchestra.run.smithi039.stdout:(74/156): python3-devel-3.9.18-3.el9.x86_64.rpm 5.7 MB/s | 244 kB 00:00 2024-05-14T14:38:03.725 INFO:teuthology.orchestra.run.smithi062.stdout:(94/156): python3-babel-2.9.1-2.el9.noarch.rpm 4.7 MB/s | 6.0 MB 00:01 2024-05-14T14:38:03.735 INFO:teuthology.orchestra.run.smithi039.stdout:(75/156): postgresql-server-13.14-1.el9.x86_64. 24 MB/s | 5.8 MB 00:00 2024-05-14T14:38:03.750 INFO:teuthology.orchestra.run.smithi062.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 390 kB/s | 36 kB 00:00 2024-05-14T14:38:03.760 INFO:teuthology.orchestra.run.smithi039.stdout:(76/156): python3-jinja2-2.11.3-5.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-05-14T14:38:03.784 INFO:teuthology.orchestra.run.smithi062.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 809 kB/s | 47 kB 00:00 2024-05-14T14:38:03.785 INFO:teuthology.orchestra.run.smithi039.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 510 kB/s | 26 kB 00:00 2024-05-14T14:38:03.802 INFO:teuthology.orchestra.run.smithi039.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 456 kB/s | 19 kB 00:00 2024-05-14T14:38:03.809 INFO:teuthology.orchestra.run.smithi062.stdout:(97/156): socat-1.7.4.1-5.el9.x86_64.rpm 5.1 MB/s | 305 kB 00:00 2024-05-14T14:38:03.819 INFO:teuthology.orchestra.run.smithi039.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 5.0 MB/s | 172 kB 00:00 2024-05-14T14:38:03.834 INFO:teuthology.orchestra.run.smithi062.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-05-14T14:38:03.836 INFO:teuthology.orchestra.run.smithi039.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 1.0 MB/s | 35 kB 00:00 2024-05-14T14:38:03.860 INFO:teuthology.orchestra.run.smithi062.stdout:(99/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-05-14T14:38:03.885 INFO:teuthology.orchestra.run.smithi062.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-05-14T14:38:03.910 INFO:teuthology.orchestra.run.smithi062.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-05-14T14:38:03.912 INFO:teuthology.orchestra.run.smithi039.stdout:(81/156): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 6.0 MB 00:00 2024-05-14T14:38:03.937 INFO:teuthology.orchestra.run.smithi039.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-05-14T14:38:03.962 INFO:teuthology.orchestra.run.smithi039.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.4 MB/s | 222 kB 00:00 2024-05-14T14:38:03.996 INFO:teuthology.orchestra.run.smithi039.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-05-14T14:38:04.021 INFO:teuthology.orchestra.run.smithi039.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 724 kB/s | 42 kB 00:00 2024-05-14T14:38:04.090 INFO:teuthology.orchestra.run.smithi039.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 2.8 MB/s | 269 kB 00:00 2024-05-14T14:38:04.114 INFO:teuthology.orchestra.run.smithi039.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 159 kB 00:00 2024-05-14T14:38:04.139 INFO:teuthology.orchestra.run.smithi039.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.6 MB/s | 279 kB 00:00 2024-05-14T14:38:04.164 INFO:teuthology.orchestra.run.smithi039.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-05-14T14:38:04.169 INFO:teuthology.orchestra.run.smithi062.stdout:(102/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 23 MB/s | 16 MB 00:00 2024-05-14T14:38:04.189 INFO:teuthology.orchestra.run.smithi039.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-05-14T14:38:04.231 INFO:teuthology.orchestra.run.smithi039.stdout:(91/156): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-05-14T14:38:04.298 INFO:teuthology.orchestra.run.smithi039.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 11 MB/s | 5.1 MB 00:00 2024-05-14T14:38:04.323 INFO:teuthology.orchestra.run.smithi039.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 481 kB/s | 44 kB 00:00 2024-05-14T14:38:04.349 INFO:teuthology.orchestra.run.smithi039.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-05-14T14:38:04.407 INFO:teuthology.orchestra.run.smithi039.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 430 kB/s | 36 kB 00:00 2024-05-14T14:38:04.433 INFO:teuthology.orchestra.run.smithi039.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 568 kB/s | 47 kB 00:00 2024-05-14T14:38:04.458 INFO:teuthology.orchestra.run.smithi039.stdout:(97/156): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 305 kB 00:00 2024-05-14T14:38:04.483 INFO:teuthology.orchestra.run.smithi039.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-05-14T14:38:04.508 INFO:teuthology.orchestra.run.smithi039.stdout:(99/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-05-14T14:38:04.534 INFO:teuthology.orchestra.run.smithi039.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-05-14T14:38:04.551 INFO:teuthology.orchestra.run.smithi039.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.0 MB/s | 45 kB 00:00 2024-05-14T14:38:04.611 INFO:teuthology.orchestra.run.smithi062.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 31 kB/s | 22 kB 00:00 2024-05-14T14:38:04.768 INFO:teuthology.orchestra.run.smithi039.stdout:(102/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-05-14T14:38:04.809 INFO:teuthology.orchestra.run.smithi039.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 81 kB/s | 22 kB 00:00 2024-05-14T14:38:04.886 INFO:teuthology.orchestra.run.smithi062.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 765 kB/s | 548 kB 00:00 2024-05-14T14:38:04.893 INFO:teuthology.orchestra.run.smithi039.stdout:(104/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.5 MB/s | 863 kB 00:00 2024-05-14T14:38:05.011 INFO:teuthology.orchestra.run.smithi062.stdout:(105/156): grpc-data-1.46.7-10.el9.noarch.rpm 155 kB/s | 19 kB 00:00 2024-05-14T14:38:05.054 INFO:teuthology.orchestra.run.smithi062.stdout:(106/156): protobuf-compiler-3.14.0-13.el9.x86_ 755 kB/s | 863 kB 00:01 2024-05-14T14:38:05.127 INFO:teuthology.orchestra.run.smithi039.stdout:(105/156): grpc-data-1.46.7-10.el9.noarch.rpm 94 kB/s | 19 kB 00:00 2024-05-14T14:38:05.169 INFO:teuthology.orchestra.run.smithi039.stdout:(106/156): abseil-cpp-20211102.0-3.el9.x86_64.r 1.3 MB/s | 548 kB 00:00 2024-05-14T14:38:05.178 INFO:teuthology.orchestra.run.smithi062.stdout:(107/156): gperftools-libs-2.9.1-2.el9.x86_64.r 545 kB/s | 309 kB 00:00 2024-05-14T14:38:05.194 INFO:teuthology.orchestra.run.smithi039.stdout:(107/156): gperftools-libs-2.9.1-2.el9.x86_64.r 869 kB/s | 309 kB 00:00 2024-05-14T14:38:05.312 INFO:teuthology.orchestra.run.smithi062.stdout:(108/156): liboath-2.6.7-2.el9.x86_64.rpm 364 kB/s | 49 kB 00:00 2024-05-14T14:38:05.338 INFO:teuthology.orchestra.run.smithi062.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 92 kB/s | 26 kB 00:00 2024-05-14T14:38:05.378 INFO:teuthology.orchestra.run.smithi039.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 125 kB/s | 26 kB 00:00 2024-05-14T14:38:05.403 INFO:teuthology.orchestra.run.smithi039.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 233 kB/s | 49 kB 00:00 2024-05-14T14:38:05.429 INFO:teuthology.orchestra.run.smithi062.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 577 kB/s | 67 kB 00:00 2024-05-14T14:38:05.521 INFO:teuthology.orchestra.run.smithi062.stdout:(111/156): libarrow-9.0.0-11.el9.x86_64.rpm 8.7 MB/s | 4.4 MB 00:00 2024-05-14T14:38:05.628 INFO:teuthology.orchestra.run.smithi039.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 269 kB/s | 67 kB 00:00 2024-05-14T14:38:05.630 INFO:teuthology.orchestra.run.smithi062.stdout:(112/156): luarocks-3.9.2-1.el9.noarch.rpm 517 kB/s | 151 kB 00:00 2024-05-14T14:38:05.672 INFO:teuthology.orchestra.run.smithi062.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.4 MB/s | 839 kB 00:00 2024-05-14T14:38:05.704 INFO:teuthology.orchestra.run.smithi039.stdout:(111/156): libarrow-9.0.0-11.el9.x86_64.rpm 7.7 MB/s | 4.4 MB 00:00 2024-05-14T14:38:05.729 INFO:teuthology.orchestra.run.smithi039.stdout:(112/156): luarocks-3.9.2-1.el9.noarch.rpm 466 kB/s | 151 kB 00:00 2024-05-14T14:38:05.754 INFO:teuthology.orchestra.run.smithi039.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.5 MB/s | 839 kB 00:00 2024-05-14T14:38:05.796 INFO:teuthology.orchestra.run.smithi039.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 5.9 MB/s | 548 kB 00:00 2024-05-14T14:38:05.821 INFO:teuthology.orchestra.run.smithi039.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 474 kB/s | 43 kB 00:00 2024-05-14T14:38:05.831 INFO:teuthology.orchestra.run.smithi062.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 217 kB/s | 43 kB 00:00 2024-05-14T14:38:05.847 INFO:teuthology.orchestra.run.smithi039.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 353 kB/s | 32 kB 00:00 2024-05-14T14:38:05.872 INFO:teuthology.orchestra.run.smithi039.stdout:(117/156): python3-certifi-2021.10.8-2.el9.noar 199 kB/s | 15 kB 00:00 2024-05-14T14:38:05.889 INFO:teuthology.orchestra.run.smithi062.stdout:(115/156): python3-asyncssh-2.13.2-5.el9.noarch 1.5 MB/s | 548 kB 00:00 2024-05-14T14:38:05.897 INFO:teuthology.orchestra.run.smithi039.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-05-14T14:38:05.923 INFO:teuthology.orchestra.run.smithi039.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2024-05-14T14:38:05.948 INFO:teuthology.orchestra.run.smithi039.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-05-14T14:38:05.973 INFO:teuthology.orchestra.run.smithi062.stdout:(116/156): python3-certifi-2021.10.8-2.el9.noar 106 kB/s | 15 kB 00:00 2024-05-14T14:38:05.982 INFO:teuthology.orchestra.run.smithi039.stdout:(121/156): python3-colorama-0.4.4-12.el9.noarch 425 kB/s | 35 kB 00:00 2024-05-14T14:38:06.007 INFO:teuthology.orchestra.run.smithi039.stdout:(122/156): python3-google-auth-2.29.0-1.el9.noa 2.4 MB/s | 206 kB 00:00 2024-05-14T14:38:06.015 INFO:teuthology.orchestra.run.smithi062.stdout:(117/156): python3-cachetools-4.2.4-1.el9.noarc 94 kB/s | 32 kB 00:00 2024-05-14T14:38:06.115 INFO:teuthology.orchestra.run.smithi062.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 762 kB/s | 172 kB 00:00 2024-05-14T14:38:06.132 INFO:teuthology.orchestra.run.smithi039.stdout:(123/156): python3-grpcio-1.46.7-10.el9.x86_64. 11 MB/s | 2.0 MB 00:00 2024-05-14T14:38:06.157 INFO:teuthology.orchestra.run.smithi039.stdout:(124/156): python3-grpcio-tools-1.46.7-10.el9.x 826 kB/s | 144 kB 00:00 2024-05-14T14:38:06.182 INFO:teuthology.orchestra.run.smithi062.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 1.7 MB/s | 358 kB 00:00 2024-05-14T14:38:06.182 INFO:teuthology.orchestra.run.smithi039.stdout:(125/156): python3-jaraco-8.2.1-3.el9.noarch.rp 61 kB/s | 11 kB 00:00 2024-05-14T14:38:06.207 INFO:teuthology.orchestra.run.smithi039.stdout:(126/156): python3-jaraco-classes-3.2.1-5.el9.n 235 kB/s | 18 kB 00:00 2024-05-14T14:38:06.241 INFO:teuthology.orchestra.run.smithi062.stdout:(120/156): python3-colorama-0.4.4-12.el9.noarch 282 kB/s | 35 kB 00:00 2024-05-14T14:38:06.241 INFO:teuthology.orchestra.run.smithi039.stdout:(127/156): python3-jaraco-collections-3.0.0-8.e 397 kB/s | 23 kB 00:00 2024-05-14T14:38:06.267 INFO:teuthology.orchestra.run.smithi039.stdout:(128/156): python3-jaraco-functools-3.5.0-2.el9 233 kB/s | 19 kB 00:00 2024-05-14T14:38:06.274 INFO:teuthology.orchestra.run.smithi062.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.1 MB/s | 303 kB 00:00 2024-05-14T14:38:06.292 INFO:teuthology.orchestra.run.smithi039.stdout:(129/156): python3-jaraco-text-3.2.0-6.el9.noar 234 kB/s | 20 kB 00:00 2024-05-14T14:38:06.358 INFO:teuthology.orchestra.run.smithi062.stdout:(122/156): python3-google-auth-2.29.0-1.el9.noa 1.1 MB/s | 206 kB 00:00 2024-05-14T14:38:06.367 INFO:teuthology.orchestra.run.smithi039.stdout:(130/156): python3-kubernetes-26.1.0-2.el9.noar 8.1 MB/s | 1.0 MB 00:00 2024-05-14T14:38:06.391 INFO:teuthology.orchestra.run.smithi062.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 1.2 MB/s | 144 kB 00:00 2024-05-14T14:38:06.392 INFO:teuthology.orchestra.run.smithi039.stdout:(131/156): python3-logutils-0.3.5-21.el9.noarch 369 kB/s | 46 kB 00:00 2024-05-14T14:38:06.417 INFO:teuthology.orchestra.run.smithi039.stdout:(132/156): python3-more-itertools-8.12.0-2.el9. 635 kB/s | 79 kB 00:00 2024-05-14T14:38:06.443 INFO:teuthology.orchestra.run.smithi039.stdout:(133/156): python3-natsort-7.1.1-5.el9.noarch.r 769 kB/s | 58 kB 00:00 2024-05-14T14:38:06.467 INFO:teuthology.orchestra.run.smithi062.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 98 kB/s | 11 kB 00:00 2024-05-14T14:38:06.500 INFO:teuthology.orchestra.run.smithi062.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 163 kB/s | 18 kB 00:00 2024-05-14T14:38:06.501 INFO:teuthology.orchestra.run.smithi039.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-05-14T14:38:06.527 INFO:teuthology.orchestra.run.smithi039.stdout:(135/156): python3-portend-3.1.0-2.el9.noarch.r 151 kB/s | 16 kB 00:00 2024-05-14T14:38:06.594 INFO:teuthology.orchestra.run.smithi039.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 597 kB/s | 90 kB 00:00 2024-05-14T14:38:06.609 INFO:teuthology.orchestra.run.smithi062.stdout:(126/156): python3-grpcio-1.46.7-10.el9.x86_64. 5.5 MB/s | 2.0 MB 00:00 2024-05-14T14:38:06.619 INFO:teuthology.orchestra.run.smithi039.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 240 kB/s | 28 kB 00:00 2024-05-14T14:38:06.626 INFO:teuthology.orchestra.run.smithi062.stdout:(127/156): python3-jaraco-collections-3.0.0-8.e 146 kB/s | 23 kB 00:00 2024-05-14T14:38:06.643 INFO:teuthology.orchestra.run.smithi062.stdout:(128/156): python3-jaraco-functools-3.5.0-2.el9 137 kB/s | 19 kB 00:00 2024-05-14T14:38:06.644 INFO:teuthology.orchestra.run.smithi039.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 262 kB/s | 31 kB 00:00 2024-05-14T14:38:06.694 INFO:teuthology.orchestra.run.smithi039.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-05-14T14:38:06.718 INFO:teuthology.orchestra.run.smithi062.stdout:(129/156): python3-jaraco-text-3.2.0-6.el9.noar 181 kB/s | 20 kB 00:00 2024-05-14T14:38:06.728 INFO:teuthology.orchestra.run.smithi039.stdout:(140/156): python3-rsa-4.9-2.el9.noarch.rpm 709 kB/s | 59 kB 00:00 2024-05-14T14:38:06.745 INFO:teuthology.orchestra.run.smithi039.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 357 kB/s | 36 kB 00:00 2024-05-14T14:38:06.760 INFO:teuthology.orchestra.run.smithi062.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 396 kB/s | 46 kB 00:00 2024-05-14T14:38:06.762 INFO:teuthology.orchestra.run.smithi039.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 758 kB/s | 51 kB 00:00 2024-05-14T14:38:06.796 INFO:teuthology.orchestra.run.smithi039.stdout:(143/156): python3-webob-1.8.7-6.el9.noarch.rpm 3.3 MB/s | 230 kB 00:00 2024-05-14T14:38:06.821 INFO:teuthology.orchestra.run.smithi039.stdout:(144/156): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-05-14T14:38:06.835 INFO:teuthology.orchestra.run.smithi062.stdout:(131/156): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-05-14T14:38:06.846 INFO:teuthology.orchestra.run.smithi039.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-05-14T14:38:06.852 INFO:teuthology.orchestra.run.smithi062.stdout:(132/156): python3-more-itertools-8.12.0-2.el9. 589 kB/s | 79 kB 00:00 2024-05-14T14:38:06.863 INFO:teuthology.orchestra.run.smithi039.stdout:(146/156): python3-zc-lockfile-2.0-10.el9.noarc 299 kB/s | 20 kB 00:00 2024-05-14T14:38:06.885 INFO:teuthology.orchestra.run.smithi062.stdout:(133/156): python3-natsort-7.1.1-5.el9.noarch.r 460 kB/s | 58 kB 00:00 2024-05-14T14:38:06.897 INFO:teuthology.orchestra.run.smithi039.stdout:(147/156): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-05-14T14:38:06.969 INFO:teuthology.orchestra.run.smithi062.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 140 kB/s | 16 kB 00:00 2024-05-14T14:38:06.980 INFO:teuthology.orchestra.run.smithi039.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-05-14T14:38:07.003 INFO:teuthology.orchestra.run.smithi062.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.6 MB/s | 272 kB 00:00 2024-05-14T14:38:07.028 INFO:teuthology.orchestra.run.smithi062.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 632 kB/s | 90 kB 00:00 2024-05-14T14:38:07.095 INFO:teuthology.orchestra.run.smithi062.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 225 kB/s | 28 kB 00:00 2024-05-14T14:38:07.120 INFO:teuthology.orchestra.run.smithi062.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 262 kB/s | 31 kB 00:00 2024-05-14T14:38:07.154 INFO:teuthology.orchestra.run.smithi062.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-05-14T14:38:07.181 INFO:teuthology.orchestra.run.smithi039.stdout:(149/156): librados2-19.0.0-3588.ge2b755a6.el9. 10 MB/s | 3.3 MB 00:00 2024-05-14T14:38:07.221 INFO:teuthology.orchestra.run.smithi062.stdout:(140/156): python3-rsa-4.9-2.el9.noarch.rpm 471 kB/s | 59 kB 00:00 2024-05-14T14:38:07.246 INFO:teuthology.orchestra.run.smithi062.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 285 kB/s | 36 kB 00:00 2024-05-14T14:38:07.247 INFO:teuthology.orchestra.run.smithi039.stdout:(150/156): NetworkManager-1.47.90-1.el9.x86_64. 8.7 MB/s | 2.3 MB 00:00 2024-05-14T14:38:07.280 INFO:teuthology.orchestra.run.smithi062.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 406 kB/s | 51 kB 00:00 2024-05-14T14:38:07.298 INFO:teuthology.orchestra.run.smithi039.stdout:(151/156): NetworkManager-team-1.47.90-1.el9.x8 832 kB/s | 41 kB 00:00 2024-05-14T14:38:07.346 INFO:teuthology.orchestra.run.smithi062.stdout:(143/156): python3-webob-1.8.7-6.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-05-14T14:38:07.348 INFO:teuthology.orchestra.run.smithi039.stdout:(152/156): NetworkManager-tui-1.47.90-1.el9.x86 4.9 MB/s | 248 kB 00:00 2024-05-14T14:38:07.372 INFO:teuthology.orchestra.run.smithi062.stdout:(144/156): python3-websocket-client-1.2.3-2.el9 714 kB/s | 90 kB 00:00 2024-05-14T14:38:07.398 INFO:teuthology.orchestra.run.smithi039.stdout:(153/156): NetworkManager-libnm-1.47.90-1.el9.x 8.3 MB/s | 1.8 MB 00:00 2024-05-14T14:38:07.439 INFO:teuthology.orchestra.run.smithi062.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.6 MB/s | 427 kB 00:00 2024-05-14T14:38:07.440 INFO:teuthology.orchestra.run.smithi039.stdout:(154/156): openssl-3.2.1-1.el9.x86_64.rpm 15 MB/s | 1.3 MB 00:00 2024-05-14T14:38:07.464 INFO:teuthology.orchestra.run.smithi062.stdout:(146/156): python3-zc-lockfile-2.0-10.el9.noarc 170 kB/s | 20 kB 00:00 2024-05-14T14:38:07.549 INFO:teuthology.orchestra.run.smithi039.stdout:(155/156): librbd1-19.0.0-3588.ge2b755a6.el9.x8 4.8 MB/s | 3.1 MB 00:00 2024-05-14T14:38:07.624 INFO:teuthology.orchestra.run.smithi039.stdout:(156/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 11 MB/s | 2.4 MB 00:00 2024-05-14T14:38:07.630 INFO:teuthology.orchestra.run.smithi039.stdout:-------------------------------------------------------------------------------- 2024-05-14T14:38:07.630 INFO:teuthology.orchestra.run.smithi039.stdout:Total 15 MB/s | 219 MB 00:14 2024-05-14T14:38:07.673 INFO:teuthology.orchestra.run.smithi062.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 6.8 MB/s | 1.6 MB 00:00 2024-05-14T14:38:07.756 INFO:teuthology.orchestra.run.smithi062.stdout:(148/156): re2-20211101-3.el9.x86_64.rpm 499 kB/s | 192 kB 00:00 2024-05-14T14:38:07.965 INFO:teuthology.orchestra.run.smithi062.stdout:(149/156): NetworkManager-1.47.90-1.el9.x86_64. 11 MB/s | 2.3 MB 00:00 2024-05-14T14:38:08.040 INFO:teuthology.orchestra.run.smithi062.stdout:(150/156): NetworkManager-libnm-1.47.90-1.el9.x 24 MB/s | 1.8 MB 00:00 2024-05-14T14:38:08.082 INFO:teuthology.orchestra.run.smithi062.stdout:(151/156): NetworkManager-team-1.47.90-1.el9.x8 1.0 MB/s | 41 kB 00:00 2024-05-14T14:38:08.132 INFO:teuthology.orchestra.run.smithi062.stdout:(152/156): NetworkManager-tui-1.47.90-1.el9.x86 4.8 MB/s | 248 kB 00:00 2024-05-14T14:38:08.191 INFO:teuthology.orchestra.run.smithi062.stdout:(153/156): librados2-19.0.0-3588.ge2b755a6.el9. 4.6 MB/s | 3.3 MB 00:00 2024-05-14T14:38:08.250 INFO:teuthology.orchestra.run.smithi062.stdout:(154/156): librbd1-19.0.0-3588.ge2b755a6.el9.x8 5.4 MB/s | 3.1 MB 00:00 2024-05-14T14:38:08.292 INFO:teuthology.orchestra.run.smithi062.stdout:(155/156): openssl-3.2.1-1.el9.x86_64.rpm 8.5 MB/s | 1.3 MB 00:00 2024-05-14T14:38:08.400 INFO:teuthology.orchestra.run.smithi062.stdout:(156/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 11 MB/s | 2.4 MB 00:00 2024-05-14T14:38:08.403 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-05-14T14:38:08.404 INFO:teuthology.orchestra.run.smithi062.stdout:Total 13 MB/s | 219 MB 00:17 2024-05-14T14:38:08.877 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction check 2024-05-14T14:38:09.046 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction check succeeded. 2024-05-14T14:38:09.046 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction test 2024-05-14T14:38:09.644 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-05-14T14:38:09.811 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-05-14T14:38:09.811 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-05-14T14:38:11.306 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction test succeeded. 2024-05-14T14:38:11.307 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction 2024-05-14T14:38:12.019 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-05-14T14:38:12.020 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-05-14T14:38:17.768 INFO:teuthology.orchestra.run.smithi039.stdout: Preparing : 1/1 2024-05-14T14:38:17.837 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-14T14:38:17.876 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-14T14:38:17.949 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-14T14:38:17.987 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-14T14:38:18.012 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-14T14:38:18.067 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-14T14:38:18.414 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-05-14T14:38:18.425 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-14T14:38:18.497 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-14T14:38:18.538 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-14T14:38:18.547 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 8/164 2024-05-14T14:38:18.604 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-14T14:38:18.647 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-14T14:38:18.672 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-14T14:38:18.683 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 8/164 2024-05-14T14:38:18.706 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/164 2024-05-14T14:38:18.730 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-14T14:38:18.799 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/164 2024-05-14T14:38:18.830 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 10/164 2024-05-14T14:38:19.032 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-14T14:38:19.126 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-14T14:38:19.133 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-14T14:38:19.153 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 13/164 2024-05-14T14:38:19.198 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 8/164 2024-05-14T14:38:19.260 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 13/164 2024-05-14T14:38:19.287 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 14/164 2024-05-14T14:38:19.335 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 8/164 2024-05-14T14:38:19.350 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 14/164 2024-05-14T14:38:19.366 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/164 2024-05-14T14:38:19.379 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-14T14:38:19.402 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-14T14:38:19.458 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/164 2024-05-14T14:38:19.495 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 10/164 2024-05-14T14:38:19.583 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-14T14:38:19.692 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-14T14:38:19.744 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-14T14:38:19.770 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 13/164 2024-05-14T14:38:19.777 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-14T14:38:19.877 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 13/164 2024-05-14T14:38:19.904 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 14/164 2024-05-14T14:38:19.944 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/164 2024-05-14T14:38:19.967 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 14/164 2024-05-14T14:38:19.989 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-14T14:38:20.004 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/164 2024-05-14T14:38:20.011 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-14T14:38:20.122 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-14T14:38:20.197 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-14T14:38:20.199 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-14T14:38:20.371 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-14T14:38:20.404 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-14T14:38:20.515 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-14T14:38:20.540 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/164 2024-05-14T14:38:20.543 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-14T14:38:20.578 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-14T14:38:20.596 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/164 2024-05-14T14:38:20.653 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-14T14:38:20.694 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-14T14:38:20.698 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-14T14:38:20.738 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-14T14:38:20.763 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-14T14:38:20.778 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-14T14:38:20.805 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-14T14:38:20.877 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-14T14:38:20.929 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-14T14:38:20.967 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-14T14:38:20.981 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-14T14:38:21.010 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-14T14:38:21.089 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-14T14:38:21.089 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-14T14:38:21.118 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-14T14:38:21.121 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9. 32/164 2024-05-14T14:38:21.145 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-14T14:38:21.156 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el 33/164 2024-05-14T14:38:21.184 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_6 34/164 2024-05-14T14:38:21.220 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-14T14:38:21.258 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-14T14:38:21.277 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-14T14:38:21.300 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-14T14:38:21.321 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-14T14:38:21.354 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-14T14:38:21.378 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-14T14:38:21.381 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-14T14:38:21.453 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-14T14:38:21.504 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-14T14:38:21.523 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-14T14:38:21.550 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-14T14:38:21.578 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-14T14:38:21.594 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-14T14:38:21.673 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-14T14:38:21.713 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9. 32/164 2024-05-14T14:38:21.757 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el 33/164 2024-05-14T14:38:21.785 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_6 34/164 2024-05-14T14:38:21.858 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-14T14:38:21.900 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-14T14:38:21.978 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-14T14:38:22.131 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-14T14:38:22.134 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-14T14:38:22.187 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-14T14:38:22.217 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-14T14:38:22.251 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-14T14:38:22.295 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-14T14:38:22.324 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_6 44/164 2024-05-14T14:38:22.367 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-14T14:38:22.533 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-14T14:38:22.585 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-14T14:38:22.680 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-14T14:38:22.743 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-14T14:38:22.751 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-14T14:38:22.825 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-14T14:38:22.842 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-14T14:38:22.861 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-14T14:38:22.876 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-14T14:38:22.898 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-14T14:38:22.919 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-14T14:38:22.946 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-14T14:38:22.957 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_6 44/164 2024-05-14T14:38:22.981 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-14T14:38:23.000 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-14T14:38:23.156 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-14T14:38:23.210 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-14T14:38:23.278 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-14T14:38:23.306 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-14T14:38:23.327 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-14T14:38:23.367 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-14T14:38:23.441 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-14T14:38:23.476 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-14T14:38:23.478 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-14T14:38:23.514 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-14T14:38:23.530 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-14T14:38:23.561 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-14T14:38:23.562 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-14T14:38:23.597 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-14T14:38:23.602 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-14T14:38:23.641 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-14T14:38:23.683 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-14T14:38:23.701 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-14T14:38:23.735 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-14T14:38:23.778 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-14T14:38:23.808 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-14T14:38:23.825 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-14T14:38:23.833 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-14T14:38:23.871 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-14T14:38:23.901 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-14T14:38:23.920 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-14T14:38:23.943 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-14T14:38:24.040 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-14T14:38:24.049 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-14T14:38:24.084 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-14T14:38:24.091 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-14T14:38:24.125 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-14T14:38:24.150 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-14T14:38:24.157 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-14T14:38:24.182 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-14T14:38:24.187 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-14T14:38:24.226 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-14T14:38:24.265 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-14T14:38:24.295 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-14T14:38:24.321 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-14T14:38:24.354 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-14T14:38:24.397 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-14T14:38:24.431 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-14T14:38:24.469 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-14T14:38:24.521 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-14T14:38:24.578 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-14T14:38:24.599 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-14T14:38:24.609 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-14T14:38:24.631 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-14T14:38:24.657 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-14T14:38:24.668 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-14T14:38:24.702 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-14T14:38:24.741 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-14T14:38:24.769 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-14T14:38:24.773 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-14T14:38:24.802 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-14T14:38:24.828 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-14T14:38:24.837 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-14T14:38:24.870 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-14T14:38:24.912 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-14T14:38:24.946 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-14T14:38:25.037 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-14T14:38:25.095 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-14T14:38:25.125 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-14T14:38:25.173 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-14T14:38:25.283 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-14T14:38:25.352 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-14T14:38:25.591 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-14T14:38:25.632 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-14T14:38:25.666 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-14T14:38:25.771 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-14T14:38:25.827 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-14T14:38:25.918 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-14T14:38:25.954 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-14T14:38:26.122 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-14T14:38:26.138 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-14T14:38:26.168 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-14T14:38:26.173 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-14T14:38:26.207 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-14T14:38:26.250 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-14T14:38:26.311 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-14T14:38:26.366 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-14T14:38:26.458 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-14T14:38:26.500 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-14T14:38:26.685 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-14T14:38:26.723 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-14T14:38:26.804 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-14T14:38:26.952 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-14T14:38:27.072 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-14T14:38:27.507 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-14T14:38:27.625 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-14T14:38:28.415 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-14T14:38:28.490 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-14T14:38:28.518 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-14T14:38:28.552 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-14T14:38:28.889 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-14T14:38:28.940 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 101/164 2024-05-14T14:38:28.973 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-14T14:38:29.031 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 101/164 2024-05-14T14:38:29.061 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 102/164 2024-05-14T14:38:29.070 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-14T14:38:29.090 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-14T14:38:29.106 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-14T14:38:29.115 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-14T14:38:29.452 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-14T14:38:29.502 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 101/164 2024-05-14T14:38:29.595 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 101/164 2024-05-14T14:38:29.621 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-14T14:38:29.624 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 102/164 2024-05-14T14:38:29.661 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-14T14:38:29.673 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 105/164 2024-05-14T14:38:29.747 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 105/164 2024-05-14T14:38:29.778 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 106/164 2024-05-14T14:38:30.180 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-14T14:38:30.214 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 105/164 2024-05-14T14:38:30.285 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 105/164 2024-05-14T14:38:30.315 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 106/164 2024-05-14T14:38:32.126 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 107/164 2024-05-14T14:38:32.166 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 107/164 2024-05-14T14:38:32.579 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 107/164 2024-05-14T14:38:32.629 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 107/164 2024-05-14T14:38:32.757 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 107/164 2024-05-14T14:38:32.795 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 108/164 2024-05-14T14:38:32.886 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 108/164 2024-05-14T14:38:32.887 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-14T14:38:32.887 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-14T14:38:32.887 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:38:32.913 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 109/164 2024-05-14T14:38:33.244 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 107/164 2024-05-14T14:38:33.341 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 108/164 2024-05-14T14:38:33.433 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 108/164 2024-05-14T14:38:33.433 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-14T14:38:33.433 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-14T14:38:33.433 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:38:33.467 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 109/164 2024-05-14T14:38:44.992 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 109/164 2024-05-14T14:38:44.993 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /sys 2024-05-14T14:38:44.993 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /proc 2024-05-14T14:38:44.993 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /mnt 2024-05-14T14:38:44.993 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /var/tmp 2024-05-14T14:38:44.993 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /home 2024-05-14T14:38:44.993 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /root 2024-05-14T14:38:44.993 INFO:teuthology.orchestra.run.smithi039.stdout:skipping the directory /tmp 2024-05-14T14:38:44.993 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:38:45.172 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 110/164 2024-05-14T14:38:45.189 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 110/164 2024-05-14T14:38:45.189 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T14:38:45.189 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-14T14:38:45.189 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:38:45.346 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 109/164 2024-05-14T14:38:45.346 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /sys 2024-05-14T14:38:45.346 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /proc 2024-05-14T14:38:45.346 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /mnt 2024-05-14T14:38:45.346 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /var/tmp 2024-05-14T14:38:45.346 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /home 2024-05-14T14:38:45.346 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /root 2024-05-14T14:38:45.346 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /tmp 2024-05-14T14:38:45.346 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:38:45.524 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 110/164 2024-05-14T14:38:45.541 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 110/164 2024-05-14T14:38:45.541 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T14:38:45.541 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-14T14:38:45.541 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:38:46.809 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 111/164 2024-05-14T14:38:46.838 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 111/164 2024-05-14T14:38:46.838 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T14:38:46.838 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-14T14:38:46.838 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-14T14:38:46.838 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-14T14:38:46.838 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:38:47.076 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 112/164 2024-05-14T14:38:47.101 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 112/164 2024-05-14T14:38:47.101 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T14:38:47.101 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-14T14:38:47.102 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-14T14:38:47.102 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-14T14:38:47.102 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:38:47.179 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 111/164 2024-05-14T14:38:47.207 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 111/164 2024-05-14T14:38:47.208 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T14:38:47.208 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-14T14:38:47.208 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-14T14:38:47.208 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-14T14:38:47.208 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:38:47.438 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 112/164 2024-05-14T14:38:47.462 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 112/164 2024-05-14T14:38:47.463 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T14:38:47.463 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-14T14:38:47.463 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-14T14:38:47.463 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-14T14:38:47.463 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:38:47.593 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 113/164 2024-05-14T14:38:47.619 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 113/164 2024-05-14T14:38:47.619 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T14:38:47.619 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-14T14:38:47.619 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-14T14:38:47.619 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-14T14:38:47.619 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:38:47.725 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-14T14:38:47.783 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-14T14:38:47.878 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-14T14:38:47.955 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 113/164 2024-05-14T14:38:47.980 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 113/164 2024-05-14T14:38:47.980 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T14:38:47.980 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-14T14:38:47.980 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-14T14:38:47.980 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-14T14:38:47.980 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:38:48.084 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-14T14:38:48.086 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-14T14:38:48.137 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-14T14:38:48.144 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-14T14:38:48.216 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-14T14:38:48.217 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-14T14:38:48.309 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-14T14:38:48.413 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-14T14:38:48.450 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-14T14:38:48.465 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-14T14:38:48.514 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-14T14:38:48.545 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-14T14:38:48.553 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-14T14:38:48.580 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-14T14:38:48.635 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-14T14:38:48.779 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-14T14:38:48.832 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-14T14:38:48.873 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-14T14:38:48.899 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-14T14:38:49.027 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 125/164 2024-05-14T14:38:49.054 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 125/164 2024-05-14T14:38:49.086 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.e 126/164 2024-05-14T14:38:49.141 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6. 127/164 2024-05-14T14:38:49.168 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 128/164 2024-05-14T14:38:49.388 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 125/164 2024-05-14T14:38:49.415 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 125/164 2024-05-14T14:38:49.448 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.e 126/164 2024-05-14T14:38:49.510 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6. 127/164 2024-05-14T14:38:49.538 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 128/164 2024-05-14T14:38:50.261 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 128/164 2024-05-14T14:38:50.296 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 129/164 2024-05-14T14:38:50.636 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 128/164 2024-05-14T14:38:50.673 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 129/164 2024-05-14T14:38:51.309 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 129/164 2024-05-14T14:38:51.337 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 130/164 2024-05-14T14:38:51.454 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 130/164 2024-05-14T14:38:51.628 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el 131/164 2024-05-14T14:38:51.656 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 132/164 2024-05-14T14:38:51.682 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 132/164 2024-05-14T14:38:51.682 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T14:38:51.682 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-14T14:38:51.682 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-14T14:38:51.682 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-14T14:38:51.682 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:38:51.690 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 129/164 2024-05-14T14:38:51.715 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 130/164 2024-05-14T14:38:51.732 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 133/164 2024-05-14T14:38:51.744 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 133/164 2024-05-14T14:38:51.834 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 130/164 2024-05-14T14:38:51.846 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 134/164 2024-05-14T14:38:51.902 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 135/164 2024-05-14T14:38:52.005 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el 131/164 2024-05-14T14:38:52.034 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 132/164 2024-05-14T14:38:52.059 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 132/164 2024-05-14T14:38:52.059 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T14:38:52.059 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-14T14:38:52.059 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-14T14:38:52.060 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-14T14:38:52.060 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:38:52.110 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 133/164 2024-05-14T14:38:52.122 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 133/164 2024-05-14T14:38:52.223 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 134/164 2024-05-14T14:38:52.280 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 135/164 2024-05-14T14:38:52.881 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-14T14:38:52.926 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 137/164 2024-05-14T14:38:52.952 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 137/164 2024-05-14T14:38:52.952 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T14:38:52.952 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-14T14:38:52.952 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-14T14:38:52.952 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-14T14:38:52.952 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:38:52.994 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 138/164 2024-05-14T14:38:53.018 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 138/164 2024-05-14T14:38:53.018 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T14:38:53.018 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-14T14:38:53.018 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:38:53.070 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 139/164 2024-05-14T14:38:53.094 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 139/164 2024-05-14T14:38:53.095 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T14:38:53.095 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-14T14:38:53.095 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-14T14:38:53.095 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-14T14:38:53.095 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:38:53.263 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-14T14:38:53.304 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 137/164 2024-05-14T14:38:53.329 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 137/164 2024-05-14T14:38:53.329 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T14:38:53.329 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-14T14:38:53.329 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-14T14:38:53.329 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-14T14:38:53.329 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:38:53.371 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 138/164 2024-05-14T14:38:53.395 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 138/164 2024-05-14T14:38:53.395 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T14:38:53.395 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-14T14:38:53.395 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:38:53.420 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 140/164 2024-05-14T14:38:53.445 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 140/164 2024-05-14T14:38:53.445 INFO:teuthology.orchestra.run.smithi039.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T14:38:53.445 INFO:teuthology.orchestra.run.smithi039.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-14T14:38:53.446 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-14T14:38:53.446 INFO:teuthology.orchestra.run.smithi039.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-14T14:38:53.446 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:38:53.447 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 139/164 2024-05-14T14:38:53.472 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 139/164 2024-05-14T14:38:53.472 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T14:38:53.472 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-14T14:38:53.472 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-14T14:38:53.473 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-14T14:38:53.473 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:38:53.797 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 140/164 2024-05-14T14:38:53.822 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 140/164 2024-05-14T14:38:53.822 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T14:38:53.822 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-14T14:38:53.823 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-14T14:38:53.823 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-14T14:38:53.823 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:38:57.983 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 141/164 2024-05-14T14:38:58.025 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 142/164 2024-05-14T14:38:58.066 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 143/164 2024-05-14T14:38:58.097 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-14T14:38:58.125 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-14T14:38:58.332 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 146/164 2024-05-14T14:38:58.388 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-14T14:38:58.394 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 141/164 2024-05-14T14:38:58.418 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_ 148/164 2024-05-14T14:38:58.436 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 142/164 2024-05-14T14:38:58.448 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 149/164 2024-05-14T14:38:58.476 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 143/164 2024-05-14T14:38:58.501 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 150/164 2024-05-14T14:38:58.508 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-14T14:38:58.535 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-14T14:38:58.743 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 146/164 2024-05-14T14:38:58.790 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-14T14:38:58.816 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_ 148/164 2024-05-14T14:38:58.845 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 149/164 2024-05-14T14:38:58.891 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 150/164 2024-05-14T14:38:59.073 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-14T14:38:59.128 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-14T14:38:59.149 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-14T14:38:59.514 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-14T14:38:59.558 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-14T14:38:59.580 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-14T14:39:00.051 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 152/164 2024-05-14T14:39:00.141 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-14T14:39:00.191 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-14T14:39:00.295 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-14T14:39:00.327 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-14T14:39:00.353 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-14T14:39:00.353 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-14T14:39:00.438 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-14T14:39:00.479 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-14T14:39:00.479 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-14T14:39:00.486 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 152/164 2024-05-14T14:39:00.572 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-14T14:39:00.597 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-14T14:39:00.604 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-14T14:39:00.604 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-14T14:39:00.605 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-14T14:39:00.656 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-14T14:39:00.757 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-14T14:39:00.791 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-14T14:39:00.791 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-14T14:39:00.791 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-14T14:39:00.817 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-14T14:39:00.817 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-14T14:39:00.880 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-14T14:39:00.901 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-14T14:39:00.934 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-14T14:39:00.934 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-14T14:39:00.952 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-14T14:39:01.019 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-14T14:39:01.052 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-14T14:39:01.059 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-14T14:39:01.059 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-14T14:39:01.254 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-14T14:39:01.255 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-14T14:39:01.339 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-14T14:39:01.417 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-14T14:39:06.512 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-14T14:39:06.513 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 1/164 2024-05-14T14:39:06.513 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 2/164 2024-05-14T14:39:06.513 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 3/164 2024-05-14T14:39:06.513 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 4/164 2024-05-14T14:39:06.513 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 5/164 2024-05-14T14:39:06.513 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 6/164 2024-05-14T14:39:06.513 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 7/164 2024-05-14T14:39:06.513 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 8/164 2024-05-14T14:39:06.513 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/164 2024-05-14T14:39:06.513 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 10/164 2024-05-14T14:39:06.513 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 11/164 2024-05-14T14:39:06.513 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 12/164 2024-05-14T14:39:06.513 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 13/164 2024-05-14T14:39:06.513 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 14/164 2024-05-14T14:39:06.514 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_ 15/164 2024-05-14T14:39:06.514 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 16/164 2024-05-14T14:39:06.514 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 17/164 2024-05-14T14:39:06.514 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_6 18/164 2024-05-14T14:39:06.514 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 19/164 2024-05-14T14:39:06.514 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 20/164 2024-05-14T14:39:06.514 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el 21/164 2024-05-14T14:39:06.514 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9. 22/164 2024-05-14T14:39:06.514 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_6 23/164 2024-05-14T14:39:06.514 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 24/164 2024-05-14T14:39:06.514 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 25/164 2024-05-14T14:39:06.514 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 26/164 2024-05-14T14:39:06.514 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 27/164 2024-05-14T14:39:06.527 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 28/164 2024-05-14T14:39:06.527 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 29/164 2024-05-14T14:39:06.527 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6. 30/164 2024-05-14T14:39:06.527 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 31/164 2024-05-14T14:39:06.527 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 32/164 2024-05-14T14:39:06.527 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 33/164 2024-05-14T14:39:06.527 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el 34/164 2024-05-14T14:39:06.527 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 35/164 2024-05-14T14:39:06.527 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.e 36/164 2024-05-14T14:39:06.528 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 37/164 2024-05-14T14:39:06.528 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 38/164 2024-05-14T14:39:06.528 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 39/164 2024-05-14T14:39:06.528 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-14T14:39:06.528 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-14T14:39:06.528 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-14T14:39:06.528 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-14T14:39:06.528 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-14T14:39:06.528 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-14T14:39:06.528 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-14T14:39:06.528 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-14T14:39:06.528 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-14T14:39:06.528 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-14T14:39:06.528 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-14T14:39:06.529 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-14T14:39:06.529 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-14T14:39:06.529 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-14T14:39:06.529 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-14T14:39:06.529 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-14T14:39:06.529 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-14T14:39:06.529 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-14T14:39:06.529 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-14T14:39:06.529 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-14T14:39:06.529 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-14T14:39:06.529 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-14T14:39:06.529 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-14T14:39:06.529 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-14T14:39:06.529 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-14T14:39:06.529 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-14T14:39:06.530 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-14T14:39:06.530 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-14T14:39:06.530 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-14T14:39:06.530 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-14T14:39:06.530 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-14T14:39:06.530 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-14T14:39:06.530 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-14T14:39:06.530 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-14T14:39:06.530 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-14T14:39:06.530 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-14T14:39:06.530 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-14T14:39:06.530 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-14T14:39:06.530 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-14T14:39:06.530 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-14T14:39:06.531 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-14T14:39:06.531 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-14T14:39:06.531 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-14T14:39:06.531 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-14T14:39:06.531 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-14T14:39:06.531 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-14T14:39:06.531 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-14T14:39:06.531 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-14T14:39:06.531 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-14T14:39:06.531 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-14T14:39:06.531 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-14T14:39:06.531 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-14T14:39:06.531 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-14T14:39:06.531 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-14T14:39:06.532 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-14T14:39:06.532 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-14T14:39:06.532 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-14T14:39:06.532 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-14T14:39:06.532 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-14T14:39:06.532 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-14T14:39:06.532 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-14T14:39:06.532 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-14T14:39:06.532 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-14T14:39:06.532 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-14T14:39:06.532 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-14T14:39:06.532 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-14T14:39:06.532 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-14T14:39:06.532 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-14T14:39:06.533 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-14T14:39:06.533 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-14T14:39:06.533 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-14T14:39:06.533 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-14T14:39:06.533 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-14T14:39:06.533 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-14T14:39:06.533 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-14T14:39:06.533 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-14T14:39:06.533 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-14T14:39:06.533 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-14T14:39:06.533 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-14T14:39:06.533 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-14T14:39:06.533 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-14T14:39:06.533 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-14T14:39:06.533 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-14T14:39:06.533 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-14T14:39:06.534 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-14T14:39:06.534 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-14T14:39:06.534 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-14T14:39:06.534 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-14T14:39:06.534 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-14T14:39:06.534 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-14T14:39:06.534 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-14T14:39:06.534 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-14T14:39:06.534 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-14T14:39:06.534 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-14T14:39:06.534 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-14T14:39:06.534 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-14T14:39:06.534 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-14T14:39:06.535 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-14T14:39:06.535 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-14T14:39:06.535 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-14T14:39:06.535 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-14T14:39:06.535 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-14T14:39:06.535 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-14T14:39:06.535 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-14T14:39:06.535 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-14T14:39:06.535 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-14T14:39:06.535 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-14T14:39:06.535 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-14T14:39:06.535 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-14T14:39:06.535 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 149/164 2024-05-14T14:39:06.535 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-14T14:39:06.535 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 151/164 2024-05-14T14:39:06.535 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-14T14:39:06.536 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 153/164 2024-05-14T14:39:06.536 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-14T14:39:06.536 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 155/164 2024-05-14T14:39:06.536 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-14T14:39:06.536 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 157/164 2024-05-14T14:39:06.536 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-14T14:39:06.536 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 159/164 2024-05-14T14:39:06.536 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-14T14:39:06.536 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-14T14:39:06.536 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-14T14:39:06.536 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-14T14:39:07.068 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-14T14:39:07.069 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 1/164 2024-05-14T14:39:07.069 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 2/164 2024-05-14T14:39:07.069 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 3/164 2024-05-14T14:39:07.069 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 4/164 2024-05-14T14:39:07.069 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 5/164 2024-05-14T14:39:07.069 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 6/164 2024-05-14T14:39:07.069 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 7/164 2024-05-14T14:39:07.069 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 8/164 2024-05-14T14:39:07.069 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/164 2024-05-14T14:39:07.069 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 10/164 2024-05-14T14:39:07.069 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 11/164 2024-05-14T14:39:07.069 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 12/164 2024-05-14T14:39:07.069 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 13/164 2024-05-14T14:39:07.069 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 14/164 2024-05-14T14:39:07.069 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_ 15/164 2024-05-14T14:39:07.070 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 16/164 2024-05-14T14:39:07.070 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 17/164 2024-05-14T14:39:07.070 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_6 18/164 2024-05-14T14:39:07.070 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 19/164 2024-05-14T14:39:07.070 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 20/164 2024-05-14T14:39:07.070 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el 21/164 2024-05-14T14:39:07.070 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9. 22/164 2024-05-14T14:39:07.070 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_6 23/164 2024-05-14T14:39:07.070 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 24/164 2024-05-14T14:39:07.070 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 25/164 2024-05-14T14:39:07.070 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 26/164 2024-05-14T14:39:07.070 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 27/164 2024-05-14T14:39:07.070 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 28/164 2024-05-14T14:39:07.070 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 29/164 2024-05-14T14:39:07.082 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6. 30/164 2024-05-14T14:39:07.083 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 31/164 2024-05-14T14:39:07.083 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 32/164 2024-05-14T14:39:07.083 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 33/164 2024-05-14T14:39:07.083 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el 34/164 2024-05-14T14:39:07.083 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 35/164 2024-05-14T14:39:07.083 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.e 36/164 2024-05-14T14:39:07.083 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 37/164 2024-05-14T14:39:07.083 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 38/164 2024-05-14T14:39:07.083 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 39/164 2024-05-14T14:39:07.083 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-14T14:39:07.083 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-14T14:39:07.083 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-14T14:39:07.083 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-14T14:39:07.083 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-14T14:39:07.084 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-14T14:39:07.084 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-14T14:39:07.084 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-14T14:39:07.084 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-14T14:39:07.084 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-14T14:39:07.084 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-14T14:39:07.084 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-14T14:39:07.084 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-14T14:39:07.084 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-14T14:39:07.084 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-14T14:39:07.084 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-14T14:39:07.084 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-14T14:39:07.084 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-14T14:39:07.084 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-14T14:39:07.084 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-14T14:39:07.085 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-14T14:39:07.085 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-14T14:39:07.085 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-14T14:39:07.085 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-14T14:39:07.085 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-14T14:39:07.085 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-14T14:39:07.085 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-14T14:39:07.085 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-14T14:39:07.085 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-14T14:39:07.085 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-14T14:39:07.085 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-14T14:39:07.085 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-14T14:39:07.085 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-14T14:39:07.085 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-14T14:39:07.086 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-14T14:39:07.086 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-14T14:39:07.086 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-14T14:39:07.086 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-14T14:39:07.086 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-14T14:39:07.086 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-14T14:39:07.086 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-14T14:39:07.086 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-14T14:39:07.086 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-14T14:39:07.086 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-14T14:39:07.086 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-14T14:39:07.086 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-14T14:39:07.086 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-14T14:39:07.087 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-14T14:39:07.087 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-14T14:39:07.087 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-14T14:39:07.087 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-14T14:39:07.087 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-14T14:39:07.087 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-14T14:39:07.087 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-14T14:39:07.087 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-14T14:39:07.087 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-14T14:39:07.087 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-14T14:39:07.087 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-14T14:39:07.087 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-14T14:39:07.087 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-14T14:39:07.087 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-14T14:39:07.087 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-14T14:39:07.088 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-14T14:39:07.088 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-14T14:39:07.088 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-14T14:39:07.088 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-14T14:39:07.088 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-14T14:39:07.088 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-14T14:39:07.088 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-14T14:39:07.088 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-14T14:39:07.088 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-14T14:39:07.088 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-14T14:39:07.088 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-14T14:39:07.088 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-14T14:39:07.088 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-14T14:39:07.088 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-14T14:39:07.089 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-14T14:39:07.089 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-14T14:39:07.089 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-14T14:39:07.089 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-14T14:39:07.089 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-14T14:39:07.089 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-14T14:39:07.089 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-14T14:39:07.089 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-14T14:39:07.089 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-14T14:39:07.089 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-14T14:39:07.089 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-14T14:39:07.089 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-14T14:39:07.089 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-14T14:39:07.089 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-14T14:39:07.089 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-14T14:39:07.090 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-14T14:39:07.090 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-14T14:39:07.090 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-14T14:39:07.090 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-14T14:39:07.090 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-14T14:39:07.090 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-14T14:39:07.090 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-14T14:39:07.090 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-14T14:39:07.090 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-14T14:39:07.090 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-14T14:39:07.090 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-14T14:39:07.090 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-14T14:39:07.090 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-14T14:39:07.090 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-14T14:39:07.091 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-14T14:39:07.091 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-14T14:39:07.091 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-14T14:39:07.091 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-14T14:39:07.091 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 149/164 2024-05-14T14:39:07.091 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-14T14:39:07.091 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 151/164 2024-05-14T14:39:07.091 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-14T14:39:07.091 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 153/164 2024-05-14T14:39:07.091 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-14T14:39:07.091 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 155/164 2024-05-14T14:39:07.091 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-14T14:39:07.091 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 157/164 2024-05-14T14:39:07.091 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-14T14:39:07.092 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 159/164 2024-05-14T14:39:07.092 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-14T14:39:07.092 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-14T14:39:07.092 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-14T14:39:07.092 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-14T14:39:09.248 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-14T14:39:09.249 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:39:09.249 INFO:teuthology.orchestra.run.smithi039.stdout:Upgraded: 2024-05-14T14:39:09.249 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-14T14:39:09.249 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-14T14:39:09.249 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-14T14:39:09.249 INFO:teuthology.orchestra.run.smithi039.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-14T14:39:09.249 INFO:teuthology.orchestra.run.smithi039.stdout: librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.249 INFO:teuthology.orchestra.run.smithi039.stdout: librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.249 INFO:teuthology.orchestra.run.smithi039.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-14T14:39:09.249 INFO:teuthology.orchestra.run.smithi039.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-14T14:39:09.249 INFO:teuthology.orchestra.run.smithi039.stdout:Installed: 2024-05-14T14:39:09.249 INFO:teuthology.orchestra.run.smithi039.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-14T14:39:09.249 INFO:teuthology.orchestra.run.smithi039.stdout: automake-1.16.2-8.el9.noarch 2024-05-14T14:39:09.249 INFO:teuthology.orchestra.run.smithi039.stdout: bison-3.7.4-5.el9.x86_64 2024-05-14T14:39:09.249 INFO:teuthology.orchestra.run.smithi039.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-14T14:39:09.250 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.250 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.250 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.250 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.250 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T14:39:09.250 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-immutable-object-cache-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.250 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.250 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.250 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T14:39:09.250 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T14:39:09.250 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T14:39:09.250 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T14:39:09.250 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T14:39:09.250 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.251 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.251 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T14:39:09.251 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.251 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.251 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.251 INFO:teuthology.orchestra.run.smithi039.stdout: ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T14:39:09.251 INFO:teuthology.orchestra.run.smithi039.stdout: cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T14:39:09.251 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.251 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.251 INFO:teuthology.orchestra.run.smithi039.stdout: cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T14:39:09.251 INFO:teuthology.orchestra.run.smithi039.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-14T14:39:09.251 INFO:teuthology.orchestra.run.smithi039.stdout: flex-2.6.4-9.el9.x86_64 2024-05-14T14:39:09.251 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-14T14:39:09.252 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-14T14:39:09.252 INFO:teuthology.orchestra.run.smithi039.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-14T14:39:09.252 INFO:teuthology.orchestra.run.smithi039.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-14T14:39:09.252 INFO:teuthology.orchestra.run.smithi039.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-14T14:39:09.252 INFO:teuthology.orchestra.run.smithi039.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-14T14:39:09.252 INFO:teuthology.orchestra.run.smithi039.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-14T14:39:09.252 INFO:teuthology.orchestra.run.smithi039.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-14T14:39:09.252 INFO:teuthology.orchestra.run.smithi039.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-14T14:39:09.252 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.252 INFO:teuthology.orchestra.run.smithi039.stdout: libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.252 INFO:teuthology.orchestra.run.smithi039.stdout: libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.252 INFO:teuthology.orchestra.run.smithi039.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-14T14:39:09.252 INFO:teuthology.orchestra.run.smithi039.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-14T14:39:09.252 INFO:teuthology.orchestra.run.smithi039.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-14T14:39:09.253 INFO:teuthology.orchestra.run.smithi039.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-14T14:39:09.253 INFO:teuthology.orchestra.run.smithi039.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-14T14:39:09.253 INFO:teuthology.orchestra.run.smithi039.stdout: librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.253 INFO:teuthology.orchestra.run.smithi039.stdout: libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.253 INFO:teuthology.orchestra.run.smithi039.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-14T14:39:09.253 INFO:teuthology.orchestra.run.smithi039.stdout: librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.253 INFO:teuthology.orchestra.run.smithi039.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-14T14:39:09.253 INFO:teuthology.orchestra.run.smithi039.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-14T14:39:09.253 INFO:teuthology.orchestra.run.smithi039.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-14T14:39:09.253 INFO:teuthology.orchestra.run.smithi039.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-14T14:39:09.253 INFO:teuthology.orchestra.run.smithi039.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-14T14:39:09.253 INFO:teuthology.orchestra.run.smithi039.stdout: lua-5.4.4-4.el9.x86_64 2024-05-14T14:39:09.253 INFO:teuthology.orchestra.run.smithi039.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-14T14:39:09.253 INFO:teuthology.orchestra.run.smithi039.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-14T14:39:09.254 INFO:teuthology.orchestra.run.smithi039.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-14T14:39:09.254 INFO:teuthology.orchestra.run.smithi039.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-14T14:39:09.254 INFO:teuthology.orchestra.run.smithi039.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-14T14:39:09.254 INFO:teuthology.orchestra.run.smithi039.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-14T14:39:09.254 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-13.14-1.el9.x86_64 2024-05-14T14:39:09.254 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-14T14:39:09.254 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-14T14:39:09.254 INFO:teuthology.orchestra.run.smithi039.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-14T14:39:09.254 INFO:teuthology.orchestra.run.smithi039.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-14T14:39:09.254 INFO:teuthology.orchestra.run.smithi039.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-14T14:39:09.254 INFO:teuthology.orchestra.run.smithi039.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-14T14:39:09.254 INFO:teuthology.orchestra.run.smithi039.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-14T14:39:09.254 INFO:teuthology.orchestra.run.smithi039.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-14T14:39:09.254 INFO:teuthology.orchestra.run.smithi039.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-14T14:39:09.254 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-14T14:39:09.255 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.255 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.255 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.255 INFO:teuthology.orchestra.run.smithi039.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-14T14:39:09.255 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-14T14:39:09.255 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-14T14:39:09.255 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-14T14:39:09.255 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-14T14:39:09.255 INFO:teuthology.orchestra.run.smithi039.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-14T14:39:09.255 INFO:teuthology.orchestra.run.smithi039.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-14T14:39:09.255 INFO:teuthology.orchestra.run.smithi039.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-14T14:39:09.255 INFO:teuthology.orchestra.run.smithi039.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-14T14:39:09.255 INFO:teuthology.orchestra.run.smithi039.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-14T14:39:09.255 INFO:teuthology.orchestra.run.smithi039.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-14T14:39:09.255 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-14T14:39:09.256 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-14T14:39:09.256 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-14T14:39:09.256 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-14T14:39:09.256 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-14T14:39:09.256 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-14T14:39:09.256 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-14T14:39:09.256 INFO:teuthology.orchestra.run.smithi039.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-14T14:39:09.256 INFO:teuthology.orchestra.run.smithi039.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-14T14:39:09.256 INFO:teuthology.orchestra.run.smithi039.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-14T14:39:09.256 INFO:teuthology.orchestra.run.smithi039.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-14T14:39:09.256 INFO:teuthology.orchestra.run.smithi039.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-14T14:39:09.256 INFO:teuthology.orchestra.run.smithi039.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-14T14:39:09.256 INFO:teuthology.orchestra.run.smithi039.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-14T14:39:09.256 INFO:teuthology.orchestra.run.smithi039.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-14T14:39:09.256 INFO:teuthology.orchestra.run.smithi039.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-14T14:39:09.256 INFO:teuthology.orchestra.run.smithi039.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-14T14:39:09.257 INFO:teuthology.orchestra.run.smithi039.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-14T14:39:09.257 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-14T14:39:09.257 INFO:teuthology.orchestra.run.smithi039.stdout: python3-ply-3.11-14.el9.noarch 2024-05-14T14:39:09.257 INFO:teuthology.orchestra.run.smithi039.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-14T14:39:09.257 INFO:teuthology.orchestra.run.smithi039.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-14T14:39:09.257 INFO:teuthology.orchestra.run.smithi039.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-14T14:39:09.257 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-14T14:39:09.257 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-14T14:39:09.257 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-14T14:39:09.257 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-14T14:39:09.257 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-14T14:39:09.257 INFO:teuthology.orchestra.run.smithi039.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-14T14:39:09.257 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.257 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.258 INFO:teuthology.orchestra.run.smithi039.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-14T14:39:09.258 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-14T14:39:09.258 INFO:teuthology.orchestra.run.smithi039.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-14T14:39:09.258 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.258 INFO:teuthology.orchestra.run.smithi039.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-14T14:39:09.258 INFO:teuthology.orchestra.run.smithi039.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-14T14:39:09.258 INFO:teuthology.orchestra.run.smithi039.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-14T14:39:09.258 INFO:teuthology.orchestra.run.smithi039.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-14T14:39:09.258 INFO:teuthology.orchestra.run.smithi039.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-14T14:39:09.258 INFO:teuthology.orchestra.run.smithi039.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-14T14:39:09.258 INFO:teuthology.orchestra.run.smithi039.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-14T14:39:09.258 INFO:teuthology.orchestra.run.smithi039.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-14T14:39:09.258 INFO:teuthology.orchestra.run.smithi039.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-14T14:39:09.258 INFO:teuthology.orchestra.run.smithi039.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-14T14:39:09.258 INFO:teuthology.orchestra.run.smithi039.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-14T14:39:09.259 INFO:teuthology.orchestra.run.smithi039.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-14T14:39:09.259 INFO:teuthology.orchestra.run.smithi039.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-14T14:39:09.259 INFO:teuthology.orchestra.run.smithi039.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-14T14:39:09.259 INFO:teuthology.orchestra.run.smithi039.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-14T14:39:09.259 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.259 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.259 INFO:teuthology.orchestra.run.smithi039.stdout: rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.259 INFO:teuthology.orchestra.run.smithi039.stdout: re2-1:20211101-3.el9.x86_64 2024-05-14T14:39:09.259 INFO:teuthology.orchestra.run.smithi039.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-14T14:39:09.259 INFO:teuthology.orchestra.run.smithi039.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-14T14:39:09.259 INFO:teuthology.orchestra.run.smithi039.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-14T14:39:09.259 INFO:teuthology.orchestra.run.smithi039.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-14T14:39:09.259 INFO:teuthology.orchestra.run.smithi039.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-14T14:39:09.260 INFO:teuthology.orchestra.run.smithi039.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-14T14:39:09.260 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:39:09.260 INFO:teuthology.orchestra.run.smithi039.stdout:Complete! 2024-05-14T14:39:09.695 DEBUG:teuthology.parallel:result is None 2024-05-14T14:39:09.905 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-14T14:39:09.905 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:39:09.905 INFO:teuthology.orchestra.run.smithi062.stdout:Upgraded: 2024-05-14T14:39:09.905 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-14T14:39:09.905 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-14T14:39:09.905 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-14T14:39:09.905 INFO:teuthology.orchestra.run.smithi062.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-14T14:39:09.905 INFO:teuthology.orchestra.run.smithi062.stdout: librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.905 INFO:teuthology.orchestra.run.smithi062.stdout: librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.905 INFO:teuthology.orchestra.run.smithi062.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-14T14:39:09.905 INFO:teuthology.orchestra.run.smithi062.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-14T14:39:09.906 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-05-14T14:39:09.906 INFO:teuthology.orchestra.run.smithi062.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-14T14:39:09.906 INFO:teuthology.orchestra.run.smithi062.stdout: automake-1.16.2-8.el9.noarch 2024-05-14T14:39:09.906 INFO:teuthology.orchestra.run.smithi062.stdout: bison-3.7.4-5.el9.x86_64 2024-05-14T14:39:09.906 INFO:teuthology.orchestra.run.smithi062.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-14T14:39:09.906 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.906 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.906 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.906 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.906 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T14:39:09.906 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-immutable-object-cache-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.906 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.906 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.906 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T14:39:09.907 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T14:39:09.907 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T14:39:09.907 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T14:39:09.907 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T14:39:09.907 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.907 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.907 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T14:39:09.907 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.907 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.907 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.907 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T14:39:09.907 INFO:teuthology.orchestra.run.smithi062.stdout: cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T14:39:09.907 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.907 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.908 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T14:39:09.908 INFO:teuthology.orchestra.run.smithi062.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-14T14:39:09.908 INFO:teuthology.orchestra.run.smithi062.stdout: flex-2.6.4-9.el9.x86_64 2024-05-14T14:39:09.908 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-14T14:39:09.908 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-14T14:39:09.908 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-14T14:39:09.908 INFO:teuthology.orchestra.run.smithi062.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-14T14:39:09.908 INFO:teuthology.orchestra.run.smithi062.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-14T14:39:09.908 INFO:teuthology.orchestra.run.smithi062.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-14T14:39:09.908 INFO:teuthology.orchestra.run.smithi062.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-14T14:39:09.908 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-14T14:39:09.908 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-14T14:39:09.908 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.908 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.909 INFO:teuthology.orchestra.run.smithi062.stdout: libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.909 INFO:teuthology.orchestra.run.smithi062.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-14T14:39:09.909 INFO:teuthology.orchestra.run.smithi062.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-14T14:39:09.909 INFO:teuthology.orchestra.run.smithi062.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-14T14:39:09.909 INFO:teuthology.orchestra.run.smithi062.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-14T14:39:09.909 INFO:teuthology.orchestra.run.smithi062.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-14T14:39:09.909 INFO:teuthology.orchestra.run.smithi062.stdout: librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.909 INFO:teuthology.orchestra.run.smithi062.stdout: libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.909 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-14T14:39:09.909 INFO:teuthology.orchestra.run.smithi062.stdout: librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.909 INFO:teuthology.orchestra.run.smithi062.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-14T14:39:09.909 INFO:teuthology.orchestra.run.smithi062.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-14T14:39:09.909 INFO:teuthology.orchestra.run.smithi062.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-14T14:39:09.909 INFO:teuthology.orchestra.run.smithi062.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-14T14:39:09.910 INFO:teuthology.orchestra.run.smithi062.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-14T14:39:09.910 INFO:teuthology.orchestra.run.smithi062.stdout: lua-5.4.4-4.el9.x86_64 2024-05-14T14:39:09.910 INFO:teuthology.orchestra.run.smithi062.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-14T14:39:09.910 INFO:teuthology.orchestra.run.smithi062.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-14T14:39:09.910 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-14T14:39:09.910 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-14T14:39:09.910 INFO:teuthology.orchestra.run.smithi062.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-14T14:39:09.910 INFO:teuthology.orchestra.run.smithi062.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-14T14:39:09.910 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-13.14-1.el9.x86_64 2024-05-14T14:39:09.910 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-14T14:39:09.910 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-14T14:39:09.910 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-14T14:39:09.910 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-14T14:39:09.910 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-14T14:39:09.911 INFO:teuthology.orchestra.run.smithi062.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-14T14:39:09.911 INFO:teuthology.orchestra.run.smithi062.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-14T14:39:09.911 INFO:teuthology.orchestra.run.smithi062.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-14T14:39:09.911 INFO:teuthology.orchestra.run.smithi062.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-14T14:39:09.911 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-14T14:39:09.911 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.911 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.911 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.911 INFO:teuthology.orchestra.run.smithi062.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-14T14:39:09.911 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-14T14:39:09.911 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-14T14:39:09.911 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-14T14:39:09.911 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-14T14:39:09.911 INFO:teuthology.orchestra.run.smithi062.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-14T14:39:09.911 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-14T14:39:09.912 INFO:teuthology.orchestra.run.smithi062.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-14T14:39:09.912 INFO:teuthology.orchestra.run.smithi062.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-14T14:39:09.912 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-14T14:39:09.912 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-14T14:39:09.912 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-14T14:39:09.912 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-14T14:39:09.912 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-14T14:39:09.912 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-14T14:39:09.912 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-14T14:39:09.912 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-14T14:39:09.912 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-14T14:39:09.912 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-14T14:39:09.912 INFO:teuthology.orchestra.run.smithi062.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-14T14:39:09.912 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-14T14:39:09.913 INFO:teuthology.orchestra.run.smithi062.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-14T14:39:09.913 INFO:teuthology.orchestra.run.smithi062.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-14T14:39:09.913 INFO:teuthology.orchestra.run.smithi062.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-14T14:39:09.913 INFO:teuthology.orchestra.run.smithi062.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-14T14:39:09.913 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-14T14:39:09.913 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-14T14:39:09.913 INFO:teuthology.orchestra.run.smithi062.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-14T14:39:09.913 INFO:teuthology.orchestra.run.smithi062.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-14T14:39:09.913 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-14T14:39:09.913 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ply-3.11-14.el9.noarch 2024-05-14T14:39:09.913 INFO:teuthology.orchestra.run.smithi062.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-14T14:39:09.913 INFO:teuthology.orchestra.run.smithi062.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-14T14:39:09.913 INFO:teuthology.orchestra.run.smithi062.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-14T14:39:09.914 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-14T14:39:09.914 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-14T14:39:09.914 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-14T14:39:09.914 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-14T14:39:09.914 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-14T14:39:09.914 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-14T14:39:09.914 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.914 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.914 INFO:teuthology.orchestra.run.smithi062.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-14T14:39:09.914 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-14T14:39:09.914 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-14T14:39:09.914 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.914 INFO:teuthology.orchestra.run.smithi062.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-14T14:39:09.914 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-14T14:39:09.914 INFO:teuthology.orchestra.run.smithi062.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-14T14:39:09.915 INFO:teuthology.orchestra.run.smithi062.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-14T14:39:09.915 INFO:teuthology.orchestra.run.smithi062.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-14T14:39:09.915 INFO:teuthology.orchestra.run.smithi062.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-14T14:39:09.915 INFO:teuthology.orchestra.run.smithi062.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-14T14:39:09.915 INFO:teuthology.orchestra.run.smithi062.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-14T14:39:09.915 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-14T14:39:09.915 INFO:teuthology.orchestra.run.smithi062.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-14T14:39:09.915 INFO:teuthology.orchestra.run.smithi062.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-14T14:39:09.915 INFO:teuthology.orchestra.run.smithi062.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-14T14:39:09.915 INFO:teuthology.orchestra.run.smithi062.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-14T14:39:09.915 INFO:teuthology.orchestra.run.smithi062.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-14T14:39:09.915 INFO:teuthology.orchestra.run.smithi062.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-14T14:39:09.915 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.915 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.916 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T14:39:09.916 INFO:teuthology.orchestra.run.smithi062.stdout: re2-1:20211101-3.el9.x86_64 2024-05-14T14:39:09.916 INFO:teuthology.orchestra.run.smithi062.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-14T14:39:09.916 INFO:teuthology.orchestra.run.smithi062.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-14T14:39:09.916 INFO:teuthology.orchestra.run.smithi062.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-14T14:39:09.916 INFO:teuthology.orchestra.run.smithi062.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-14T14:39:09.916 INFO:teuthology.orchestra.run.smithi062.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-14T14:39:09.916 INFO:teuthology.orchestra.run.smithi062.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-14T14:39:09.916 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:39:09.917 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-05-14T14:39:10.349 DEBUG:teuthology.parallel:result is None 2024-05-14T14:39:10.350 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T14:39:10.576 DEBUG:teuthology.orchestra.run.smithi039:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-14T14:39:10.604 INFO:teuthology.orchestra.run.smithi039.stdout:19.0.0-3588.ge2b755a6.el9 2024-05-14T14:39:10.604 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3588.ge2b755a6.el9 2024-05-14T14:39:10.604 INFO:teuthology.task.install:The correct ceph version 19.0.0-3588.ge2b755a6 is installed. 2024-05-14T14:39:10.606 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T14:39:10.837 DEBUG:teuthology.orchestra.run.smithi062:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-14T14:39:10.862 INFO:teuthology.orchestra.run.smithi062.stdout:19.0.0-3588.ge2b755a6.el9 2024-05-14T14:39:10.863 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3588.ge2b755a6.el9 2024-05-14T14:39:10.863 INFO:teuthology.task.install:The correct ceph version 19.0.0-3588.ge2b755a6 is installed. 2024-05-14T14:39:10.864 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-14T14:39:10.865 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T14:39:10.865 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-14T14:39:10.898 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-14T14:39:10.898 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-14T14:39:10.933 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-14T14:39:10.934 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T14:39:10.934 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/daemon-helper 2024-05-14T14:39:10.970 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-14T14:39:11.040 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-14T14:39:11.040 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/daemon-helper 2024-05-14T14:39:11.070 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-14T14:39:11.138 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-14T14:39:11.139 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T14:39:11.139 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-14T14:39:11.169 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-14T14:39:11.239 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-14T14:39:11.239 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-14T14:39:11.269 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-14T14:39:11.338 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-14T14:39:11.338 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T14:39:11.338 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/usr/bin/stdin-killer 2024-05-14T14:39:11.367 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-14T14:39:11.435 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-14T14:39:11.436 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/stdin-killer 2024-05-14T14:39:11.464 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-14T14:39:11.534 INFO:teuthology.run_tasks:Running task ceph... 2024-05-14T14:39:11.619 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-14T14:39:11.619 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 777 /var/log/ceph 2024-05-14T14:39:11.622 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 777 /var/log/ceph 2024-05-14T14:39:11.650 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-14T14:39:11.651 DEBUG:teuthology.orchestra.run.smithi039:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-14T14:39:11.691 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-14T14:39:11.719 INFO:tasks.ceph:Creating extra log directories... 2024-05-14T14:39:11.719 DEBUG:teuthology.orchestra.run.smithi039:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-14T14:39:11.758 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-14T14:39:11.793 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-14T14:39:11.793 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-14T14:39:11.793 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-14T14:39:11.793 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T14:39:11.794 DEBUG:teuthology.orchestra.run.smithi039:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-14T14:39:11.842 DEBUG:teuthology.orchestra.run.smithi039:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-14T14:39:11.958 DEBUG:teuthology.orchestra.run.smithi039:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-14T14:39:11.984 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-14T14:39:11.985 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-14T14:39:12.002 DEBUG:teuthology.orchestra.run.smithi062:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-14T14:39:12.118 DEBUG:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-14T14:39:12.151 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-14T14:39:12.151 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-14T14:39:12.151 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705869', 'branch': 'wip-vshankar-testing-20240509.053109-debug', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7705869', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20240509.053109-debug'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20240509.053109-debug', 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 120, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6285, 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780', 'sleep_before_teardown': 0, 'subset': '548/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20240509.053109-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi039.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC6aqSWTmAUa0AIGLV/ufdTrp6twR6Ej26z27LZ+uqyAOC+lwQ56GYKAmDyCdqRf16wLbeL1DDIFpQ8yF9OTcrw=', 'smithi062.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFPqzHjL4TAmjpKfWeoblMojuxyc1SBl/ijM/lnw67I6e2eKkIIMTbBHHevyjAQi/gqWLmPVRJbKOgd5oEvd81k='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-14_07:04:04', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-14T14:39:12.152 DEBUG:teuthology.orchestra.run.smithi039:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-14T14:39:12.154 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-14T14:39:12.202 DEBUG:teuthology.orchestra.run.smithi039:> sudo install -d -m0777 -- /var/run/ceph 2024-05-14T14:39:12.210 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/run/ceph 2024-05-14T14:39:12.270 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T14:39:12.270 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/scratch_devs of=/dev/stdout 2024-05-14T14:39:12.292 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-14T14:39:12.292 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_1 2024-05-14T14:39:12.348 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-14T14:39:12.348 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T14:39:12.348 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-05-14T14:39:12.348 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T14:39:12.349 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T14:39:12.349 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-05-14 14:39:01.329108041 +0000 2024-05-14T14:39:12.349 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-05-14 14:36:48.098808107 +0000 2024-05-14T14:39:12.349 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-05-14 14:36:48.098808107 +0000 2024-05-14T14:39:12.349 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2024-05-14 14:36:48.098808107 +0000 2024-05-14T14:39:12.349 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-14T14:39:12.413 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2024-05-14T14:39:12.413 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2024-05-14T14:39:12.413 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000296919 s, 1.7 MB/s 2024-05-14T14:39:12.414 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-14T14:39:12.471 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_2 2024-05-14T14:39:12.527 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-14T14:39:12.527 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T14:39:12.527 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-05-14T14:39:12.527 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T14:39:12.528 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T14:39:12.528 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-05-14 14:39:01.329108041 +0000 2024-05-14T14:39:12.528 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-05-14 14:36:48.460800622 +0000 2024-05-14T14:39:12.528 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-05-14 14:36:48.460800622 +0000 2024-05-14T14:39:12.528 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2024-05-14 14:36:48.460800622 +0000 2024-05-14T14:39:12.528 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-14T14:39:12.591 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2024-05-14T14:39:12.591 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2024-05-14T14:39:12.591 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000243241 s, 2.1 MB/s 2024-05-14T14:39:12.592 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-14T14:39:12.649 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_3 2024-05-14T14:39:12.705 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-14T14:39:12.705 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T14:39:12.705 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-05-14T14:39:12.705 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T14:39:12.705 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T14:39:12.705 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-05-14 14:39:01.330108021 +0000 2024-05-14T14:39:12.705 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-05-14 14:36:48.813793323 +0000 2024-05-14T14:39:12.705 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-05-14 14:36:48.813793323 +0000 2024-05-14T14:39:12.705 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2024-05-14 14:36:48.813793323 +0000 2024-05-14T14:39:12.706 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-14T14:39:12.769 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2024-05-14T14:39:12.769 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2024-05-14T14:39:12.769 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000246408 s, 2.1 MB/s 2024-05-14T14:39:12.770 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-14T14:39:12.827 DEBUG:teuthology.orchestra.run.smithi039:> stat /dev/vg_nvme/lv_4 2024-05-14T14:39:12.883 INFO:teuthology.orchestra.run.smithi039.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-14T14:39:12.883 INFO:teuthology.orchestra.run.smithi039.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T14:39:12.883 INFO:teuthology.orchestra.run.smithi039.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-05-14T14:39:12.883 INFO:teuthology.orchestra.run.smithi039.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T14:39:12.883 INFO:teuthology.orchestra.run.smithi039.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T14:39:12.883 INFO:teuthology.orchestra.run.smithi039.stdout:Access: 2024-05-14 14:39:01.330108021 +0000 2024-05-14T14:39:12.883 INFO:teuthology.orchestra.run.smithi039.stdout:Modify: 2024-05-14 14:36:49.164786066 +0000 2024-05-14T14:39:12.883 INFO:teuthology.orchestra.run.smithi039.stdout:Change: 2024-05-14 14:36:49.164786066 +0000 2024-05-14T14:39:12.884 INFO:teuthology.orchestra.run.smithi039.stdout: Birth: 2024-05-14 14:36:49.164786066 +0000 2024-05-14T14:39:12.884 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-14T14:39:12.947 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records in 2024-05-14T14:39:12.948 INFO:teuthology.orchestra.run.smithi039.stderr:1+0 records out 2024-05-14T14:39:12.948 INFO:teuthology.orchestra.run.smithi039.stderr:512 bytes copied, 0.000254105 s, 2.0 MB/s 2024-05-14T14:39:12.949 DEBUG:teuthology.orchestra.run.smithi039:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-14T14:39:13.005 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-14T14:39:13.006 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-14T14:39:13.006 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/scratch_devs of=/dev/stdout 2024-05-14T14:39:13.025 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-14T14:39:13.026 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_1 2024-05-14T14:39:13.085 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-14T14:39:13.085 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T14:39:13.085 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-05-14T14:39:13.085 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T14:39:13.085 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T14:39:13.085 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-05-14 14:39:01.811064876 +0000 2024-05-14T14:39:13.085 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-05-14 14:36:36.845897531 +0000 2024-05-14T14:39:13.085 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-05-14 14:36:36.845897531 +0000 2024-05-14T14:39:13.085 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-05-14 14:36:36.845897531 +0000 2024-05-14T14:39:13.086 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-14T14:39:13.153 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-05-14T14:39:13.153 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-05-14T14:39:13.153 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000218187 s, 2.3 MB/s 2024-05-14T14:39:13.155 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-14T14:39:13.214 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_2 2024-05-14T14:39:13.274 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-14T14:39:13.274 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T14:39:13.274 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-05-14T14:39:13.274 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T14:39:13.274 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T14:39:13.274 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-05-14 14:39:01.811064876 +0000 2024-05-14T14:39:13.274 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-05-14 14:36:37.206892290 +0000 2024-05-14T14:39:13.274 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-05-14 14:36:37.206892290 +0000 2024-05-14T14:39:13.275 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-05-14 14:36:37.206892290 +0000 2024-05-14T14:39:13.275 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-14T14:39:13.343 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-05-14T14:39:13.343 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-05-14T14:39:13.343 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000204818 s, 2.5 MB/s 2024-05-14T14:39:13.344 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-14T14:39:13.404 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_3 2024-05-14T14:39:13.463 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-14T14:39:13.463 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T14:39:13.463 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-05-14T14:39:13.464 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T14:39:13.464 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T14:39:13.464 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-05-14 14:39:01.811064876 +0000 2024-05-14T14:39:13.464 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-05-14 14:36:37.565887078 +0000 2024-05-14T14:39:13.464 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-05-14 14:36:37.565887078 +0000 2024-05-14T14:39:13.464 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-05-14 14:36:37.565887078 +0000 2024-05-14T14:39:13.464 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-14T14:39:13.531 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-05-14T14:39:13.531 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-05-14T14:39:13.531 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000191793 s, 2.7 MB/s 2024-05-14T14:39:13.532 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-14T14:39:13.591 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_4 2024-05-14T14:39:13.649 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-14T14:39:13.649 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T14:39:13.649 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-05-14T14:39:13.650 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T14:39:13.650 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T14:39:13.650 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-05-14 14:39:01.812064861 +0000 2024-05-14T14:39:13.650 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-05-14 14:36:37.909882084 +0000 2024-05-14T14:39:13.650 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-05-14 14:36:37.909882084 +0000 2024-05-14T14:39:13.650 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-05-14 14:36:37.909882084 +0000 2024-05-14T14:39:13.650 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-14T14:39:13.716 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-05-14T14:39:13.716 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-05-14T14:39:13.716 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000194433 s, 2.6 MB/s 2024-05-14T14:39:13.717 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-14T14:39:13.776 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-14T14:39:13.776 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi039.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi062.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-14T14:39:13.776 INFO:tasks.ceph:Generating config... 2024-05-14T14:39:13.777 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-14T14:39:13.777 INFO:tasks.ceph:[client] debug client = 20 2024-05-14T14:39:13.778 INFO:tasks.ceph:[client] debug ms = 1 2024-05-14T14:39:13.778 INFO:tasks.ceph:[client] pid file = 2024-05-14T14:39:13.778 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-14T14:39:13.778 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-14T14:39:13.778 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-05-14T14:39:13.778 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-14T14:39:13.778 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-14T14:39:13.778 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-14T14:39:13.778 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-14T14:39:13.778 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-14T14:39:13.778 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-14T14:39:13.778 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-14T14:39:13.778 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-14T14:39:13.778 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-14T14:39:13.778 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-14T14:39:13.779 INFO:tasks.ceph:[mgr] debug client = 20 2024-05-14T14:39:13.779 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-14T14:39:13.779 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-14T14:39:13.779 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-14T14:39:13.779 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-14T14:39:13.779 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-14T14:39:13.779 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-05-14T14:39:13.779 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-14T14:39:13.779 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-14T14:39:13.779 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-14T14:39:13.779 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-05-14T14:39:13.779 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-05-14T14:39:13.779 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-14T14:39:13.779 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-14T14:39:13.779 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-05-14T14:39:13.780 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-14T14:39:13.780 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-14T14:39:13.780 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-14T14:39:13.780 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-14T14:39:13.780 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-14T14:39:13.780 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-14T14:39:13.780 INFO:tasks.ceph:Setting up mon.a... 2024-05-14T14:39:13.780 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-14T14:39:13.847 INFO:teuthology.orchestra.run.smithi039.stdout:creating /etc/ceph/ceph.keyring 2024-05-14T14:39:13.851 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-14T14:39:13.909 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-14T14:39:13.935 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.39'), ('mon.b', '172.21.15.62'), ('mon.c', '[v2:172.21.15.62:3301,v1:172.21.15.62:6790]')] 2024-05-14T14:39:13.936 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.39,172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-14T14:39:13.936 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T14:39:13.937 DEBUG:teuthology.orchestra.run.smithi039:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-14T14:39:13.992 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.39 --add b 172.21.15.62 --addv c '[v2:172.21.15.62:3301,v1:172.21.15.62:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-14T14:39:14.091 INFO:teuthology.orchestra.run.smithi039.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-14T14:39:14.092 INFO:teuthology.orchestra.run.smithi039.stdout:monmaptool: generated fsid d7983fec-79c7-4991-b19c-1aecead64611 2024-05-14T14:39:14.092 INFO:teuthology.orchestra.run.smithi039.stdout:setting min_mon_release = quincy 2024-05-14T14:39:14.092 INFO:teuthology.orchestra.run.smithi039.stdout:epoch 0 2024-05-14T14:39:14.092 INFO:teuthology.orchestra.run.smithi039.stdout:fsid d7983fec-79c7-4991-b19c-1aecead64611 2024-05-14T14:39:14.092 INFO:teuthology.orchestra.run.smithi039.stdout:last_changed 2024-05-14T14:39:14.107016+0000 2024-05-14T14:39:14.092 INFO:teuthology.orchestra.run.smithi039.stdout:created 2024-05-14T14:39:14.107016+0000 2024-05-14T14:39:14.092 INFO:teuthology.orchestra.run.smithi039.stdout:min_mon_release 17 (quincy) 2024-05-14T14:39:14.092 INFO:teuthology.orchestra.run.smithi039.stdout:election_strategy: 1 2024-05-14T14:39:14.092 INFO:teuthology.orchestra.run.smithi039.stdout:0: [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] mon.a 2024-05-14T14:39:14.092 INFO:teuthology.orchestra.run.smithi039.stdout:1: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.b 2024-05-14T14:39:14.092 INFO:teuthology.orchestra.run.smithi039.stdout:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-05-14T14:39:14.092 INFO:teuthology.orchestra.run.smithi039.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-14T14:39:14.094 DEBUG:teuthology.orchestra.run.smithi039:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-14T14:39:14.109 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID d7983fec-79c7-4991-b19c-1aecead64611... 2024-05-14T14:39:14.110 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-14T14:39:14.151 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-14T14:39:14.194 INFO:teuthology.orchestra.run.smithi039.stdout:[global] 2024-05-14T14:39:14.194 INFO:teuthology.orchestra.run.smithi039.stdout: chdir = "" 2024-05-14T14:39:14.194 INFO:teuthology.orchestra.run.smithi039.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-14T14:39:14.194 INFO:teuthology.orchestra.run.smithi039.stdout: auth supported = cephx 2024-05-14T14:39:14.194 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:39:14.194 INFO:teuthology.orchestra.run.smithi039.stdout: filestore xattr use omap = true 2024-05-14T14:39:14.194 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:39:14.195 INFO:teuthology.orchestra.run.smithi039.stdout: mon clock drift allowed = 1.000 2024-05-14T14:39:14.195 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:39:14.195 INFO:teuthology.orchestra.run.smithi039.stdout: osd crush chooseleaf type = 0 2024-05-14T14:39:14.195 INFO:teuthology.orchestra.run.smithi039.stdout: auth debug = true 2024-05-14T14:39:14.195 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:39:14.195 INFO:teuthology.orchestra.run.smithi039.stdout: ms die on old message = true 2024-05-14T14:39:14.195 INFO:teuthology.orchestra.run.smithi039.stdout: ms die on bug = true 2024-05-14T14:39:14.195 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:39:14.195 INFO:teuthology.orchestra.run.smithi039.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-14T14:39:14.195 INFO:teuthology.orchestra.run.smithi039.stdout: mon pg warn max object skew = 0 2024-05-14T14:39:14.195 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:39:14.195 INFO:teuthology.orchestra.run.smithi039.stdout: # disable pg_autoscaler by default for new pools 2024-05-14T14:39:14.195 INFO:teuthology.orchestra.run.smithi039.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-14T14:39:14.195 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:39:14.196 INFO:teuthology.orchestra.run.smithi039.stdout: osd pool default size = 2 2024-05-14T14:39:14.196 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:39:14.196 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd allow primary affinity = true 2024-05-14T14:39:14.196 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd allow pg remap = true 2024-05-14T14:39:14.196 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on legacy crush tunables = false 2024-05-14T14:39:14.196 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on crush straw calc version zero = false 2024-05-14T14:39:14.196 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on no sortbitwise = false 2024-05-14T14:39:14.196 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on osd down out interval zero = false 2024-05-14T14:39:14.196 INFO:teuthology.orchestra.run.smithi039.stdout: mon warn on too few osds = false 2024-05-14T14:39:14.196 INFO:teuthology.orchestra.run.smithi039.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-14T14:39:14.196 INFO:teuthology.orchestra.run.smithi039.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-14T14:39:14.196 INFO:teuthology.orchestra.run.smithi039.stdout: mon_allow_pool_size_one = true 2024-05-14T14:39:14.196 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:39:14.196 INFO:teuthology.orchestra.run.smithi039.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-14T14:39:14.196 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:39:14.197 INFO:teuthology.orchestra.run.smithi039.stdout: osd default data pool replay window = 5 2024-05-14T14:39:14.197 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:39:14.197 INFO:teuthology.orchestra.run.smithi039.stdout: mon allow pool delete = true 2024-05-14T14:39:14.197 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:39:14.197 INFO:teuthology.orchestra.run.smithi039.stdout: mon cluster log file level = debug 2024-05-14T14:39:14.197 INFO:teuthology.orchestra.run.smithi039.stdout: debug asserts on shutdown = true 2024-05-14T14:39:14.197 INFO:teuthology.orchestra.run.smithi039.stdout: mon health detail to clog = false 2024-05-14T14:39:14.197 INFO:teuthology.orchestra.run.smithi039.stdout: mon host = "172.21.15.39,172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790]" 2024-05-14T14:39:14.197 INFO:teuthology.orchestra.run.smithi039.stdout: ms die on skipped message = False 2024-05-14T14:39:14.197 INFO:teuthology.orchestra.run.smithi039.stdout: fsid = d7983fec-79c7-4991-b19c-1aecead64611 2024-05-14T14:39:14.197 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:39:14.197 INFO:teuthology.orchestra.run.smithi039.stdout:[osd] 2024-05-14T14:39:14.197 INFO:teuthology.orchestra.run.smithi039.stdout: osd journal size = 100 2024-05-14T14:39:14.197 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:39:14.197 INFO:teuthology.orchestra.run.smithi039.stdout: osd scrub load threshold = 5.0 2024-05-14T14:39:14.198 INFO:teuthology.orchestra.run.smithi039.stdout: osd scrub max interval = 600 2024-05-14T14:39:14.198 INFO:teuthology.orchestra.run.smithi039.stdout: osd mclock profile = high_recovery_ops 2024-05-14T14:39:14.198 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:39:14.198 INFO:teuthology.orchestra.run.smithi039.stdout: osd recover clone overlap = true 2024-05-14T14:39:14.198 INFO:teuthology.orchestra.run.smithi039.stdout: osd recovery max chunk = 1048576 2024-05-14T14:39:14.198 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:39:14.198 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug shutdown = true 2024-05-14T14:39:14.198 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug op order = true 2024-05-14T14:39:14.198 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug verify stray on activate = true 2024-05-14T14:39:14.198 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug trim objects = true 2024-05-14T14:39:14.198 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:39:14.198 INFO:teuthology.orchestra.run.smithi039.stdout: osd open classes on start = true 2024-05-14T14:39:14.198 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug pg log writeout = true 2024-05-14T14:39:14.199 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:39:14.199 INFO:teuthology.orchestra.run.smithi039.stdout: osd deep scrub update digest min age = 30 2024-05-14T14:39:14.199 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:39:14.199 INFO:teuthology.orchestra.run.smithi039.stdout: osd map max advance = 10 2024-05-14T14:39:14.199 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:39:14.199 INFO:teuthology.orchestra.run.smithi039.stdout: journal zero on create = true 2024-05-14T14:39:14.199 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:39:14.199 INFO:teuthology.orchestra.run.smithi039.stdout: filestore ondisk finisher threads = 3 2024-05-14T14:39:14.199 INFO:teuthology.orchestra.run.smithi039.stdout: filestore apply finisher threads = 3 2024-05-14T14:39:14.199 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:39:14.199 INFO:teuthology.orchestra.run.smithi039.stdout: bdev debug aio = true 2024-05-14T14:39:14.199 INFO:teuthology.orchestra.run.smithi039.stdout: osd debug misdirected ops = true 2024-05-14T14:39:14.199 INFO:teuthology.orchestra.run.smithi039.stdout: bluestore block size = 96636764160 2024-05-14T14:39:14.199 INFO:teuthology.orchestra.run.smithi039.stdout: bluestore fsck on mount = True 2024-05-14T14:39:14.199 INFO:teuthology.orchestra.run.smithi039.stdout: debug bluefs = 20 2024-05-14T14:39:14.200 INFO:teuthology.orchestra.run.smithi039.stdout: debug bluestore = 20 2024-05-14T14:39:14.200 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 1 2024-05-14T14:39:14.200 INFO:teuthology.orchestra.run.smithi039.stdout: debug osd = 20 2024-05-14T14:39:14.200 INFO:teuthology.orchestra.run.smithi039.stdout: debug rocksdb = 10 2024-05-14T14:39:14.200 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd backfillfull_ratio = 0.85 2024-05-14T14:39:14.200 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd full ratio = 0.9 2024-05-14T14:39:14.200 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd nearfull ratio = 0.8 2024-05-14T14:39:14.200 INFO:teuthology.orchestra.run.smithi039.stdout: osd failsafe full ratio = 0.95 2024-05-14T14:39:14.200 INFO:teuthology.orchestra.run.smithi039.stdout: osd objectstore = bluestore 2024-05-14T14:39:14.200 INFO:teuthology.orchestra.run.smithi039.stdout: osd op complaint time = 180 2024-05-14T14:39:14.200 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:39:14.200 INFO:teuthology.orchestra.run.smithi039.stdout:[mgr] 2024-05-14T14:39:14.200 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 1 2024-05-14T14:39:14.200 INFO:teuthology.orchestra.run.smithi039.stdout: debug mgr = 20 2024-05-14T14:39:14.200 INFO:teuthology.orchestra.run.smithi039.stdout: debug mon = 20 2024-05-14T14:39:14.201 INFO:teuthology.orchestra.run.smithi039.stdout: debug auth = 20 2024-05-14T14:39:14.201 INFO:teuthology.orchestra.run.smithi039.stdout: mon reweight min pgs per osd = 4 2024-05-14T14:39:14.201 INFO:teuthology.orchestra.run.smithi039.stdout: mon reweight min bytes per osd = 10 2024-05-14T14:39:14.201 INFO:teuthology.orchestra.run.smithi039.stdout: mgr/telemetry/nag = false 2024-05-14T14:39:14.201 INFO:teuthology.orchestra.run.smithi039.stdout: debug client = 20 2024-05-14T14:39:14.201 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:39:14.201 INFO:teuthology.orchestra.run.smithi039.stdout:[mon] 2024-05-14T14:39:14.201 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 1 2024-05-14T14:39:14.201 INFO:teuthology.orchestra.run.smithi039.stdout: debug mon = 20 2024-05-14T14:39:14.201 INFO:teuthology.orchestra.run.smithi039.stdout: debug paxos = 20 2024-05-14T14:39:14.201 INFO:teuthology.orchestra.run.smithi039.stdout: debug auth = 20 2024-05-14T14:39:14.201 INFO:teuthology.orchestra.run.smithi039.stdout: mon data avail warn = 5 2024-05-14T14:39:14.201 INFO:teuthology.orchestra.run.smithi039.stdout: mon mgr mkfs grace = 240 2024-05-14T14:39:14.201 INFO:teuthology.orchestra.run.smithi039.stdout: mon reweight min pgs per osd = 4 2024-05-14T14:39:14.201 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd reporter subtree level = osd 2024-05-14T14:39:14.202 INFO:teuthology.orchestra.run.smithi039.stdout: mon osd prime pg temp = true 2024-05-14T14:39:14.202 INFO:teuthology.orchestra.run.smithi039.stdout: mon reweight min bytes per osd = 10 2024-05-14T14:39:14.202 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:39:14.202 INFO:teuthology.orchestra.run.smithi039.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-14T14:39:14.202 INFO:teuthology.orchestra.run.smithi039.stdout: auth mon ticket ttl = 660 # 11m 2024-05-14T14:39:14.202 INFO:teuthology.orchestra.run.smithi039.stdout: auth service ticket ttl = 240 # 4m 2024-05-14T14:39:14.202 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:39:14.202 INFO:teuthology.orchestra.run.smithi039.stdout: # don't complain about insecure global_id in the test suite 2024-05-14T14:39:14.202 INFO:teuthology.orchestra.run.smithi039.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-14T14:39:14.202 INFO:teuthology.orchestra.run.smithi039.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-14T14:39:14.202 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:39:14.202 INFO:teuthology.orchestra.run.smithi039.stdout: # 1m isn't quite enough 2024-05-14T14:39:14.202 INFO:teuthology.orchestra.run.smithi039.stdout: mon_down_mkfs_grace = 2m 2024-05-14T14:39:14.202 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:39:14.202 INFO:teuthology.orchestra.run.smithi039.stdout: mon_warn_on_filestore_osds = false 2024-05-14T14:39:14.202 INFO:teuthology.orchestra.run.smithi039.stdout: mon down mkfs grace = 300 2024-05-14T14:39:14.203 INFO:teuthology.orchestra.run.smithi039.stdout: mon op complaint time = 120 2024-05-14T14:39:14.203 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:39:14.203 INFO:teuthology.orchestra.run.smithi039.stdout:[client] 2024-05-14T14:39:14.203 INFO:teuthology.orchestra.run.smithi039.stdout: rgw cache enabled = true 2024-05-14T14:39:14.203 INFO:teuthology.orchestra.run.smithi039.stdout: rgw enable ops log = true 2024-05-14T14:39:14.203 INFO:teuthology.orchestra.run.smithi039.stdout: rgw enable usage log = true 2024-05-14T14:39:14.203 INFO:teuthology.orchestra.run.smithi039.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-14T14:39:14.203 INFO:teuthology.orchestra.run.smithi039.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-14T14:39:14.203 INFO:teuthology.orchestra.run.smithi039.stdout: client mount timeout = 600 2024-05-14T14:39:14.203 INFO:teuthology.orchestra.run.smithi039.stdout: debug client = 20 2024-05-14T14:39:14.203 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 1 2024-05-14T14:39:14.203 INFO:teuthology.orchestra.run.smithi039.stdout: pid file = "" 2024-05-14T14:39:14.203 INFO:teuthology.orchestra.run.smithi039.stdout: rados mon op timeout = 900 2024-05-14T14:39:14.203 INFO:teuthology.orchestra.run.smithi039.stdout: rados osd op timeout = 900 2024-05-14T14:39:14.203 INFO:teuthology.orchestra.run.smithi039.stdout:[mon.a] 2024-05-14T14:39:14.204 INFO:teuthology.orchestra.run.smithi039.stdout:[mon.b] 2024-05-14T14:39:14.204 INFO:teuthology.orchestra.run.smithi039.stdout:[mon.c] 2024-05-14T14:39:14.204 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.a] 2024-05-14T14:39:14.204 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.c] 2024-05-14T14:39:14.204 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.b] 2024-05-14T14:39:14.204 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.d] 2024-05-14T14:39:14.204 INFO:teuthology.orchestra.run.smithi039.stdout:[mds] 2024-05-14T14:39:14.204 INFO:teuthology.orchestra.run.smithi039.stdout: debug mds = 20 2024-05-14T14:39:14.204 INFO:teuthology.orchestra.run.smithi039.stdout: debug mds balancer = 20 2024-05-14T14:39:14.204 INFO:teuthology.orchestra.run.smithi039.stdout: debug ms = 1 2024-05-14T14:39:14.204 INFO:teuthology.orchestra.run.smithi039.stdout: mds debug frag = True 2024-05-14T14:39:14.204 INFO:teuthology.orchestra.run.smithi039.stdout: mds debug scatterstat = True 2024-05-14T14:39:14.204 INFO:teuthology.orchestra.run.smithi039.stdout: mds op complaint time = 180 2024-05-14T14:39:14.204 INFO:teuthology.orchestra.run.smithi039.stdout: mds verify scatter = True 2024-05-14T14:39:14.204 INFO:teuthology.orchestra.run.smithi039.stdout: osd op complaint time = 180 2024-05-14T14:39:14.204 INFO:teuthology.orchestra.run.smithi039.stdout: rados mon op timeout = 900 2024-05-14T14:39:14.205 INFO:teuthology.orchestra.run.smithi039.stdout: rados osd op timeout = 900 2024-05-14T14:39:14.205 INFO:teuthology.orchestra.run.smithi062.stdout:[global] 2024-05-14T14:39:14.205 INFO:teuthology.orchestra.run.smithi062.stdout: chdir = "" 2024-05-14T14:39:14.205 INFO:teuthology.orchestra.run.smithi062.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-14T14:39:14.205 INFO:teuthology.orchestra.run.smithi062.stdout: auth supported = cephx 2024-05-14T14:39:14.205 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:39:14.205 INFO:teuthology.orchestra.run.smithi062.stdout: filestore xattr use omap = true 2024-05-14T14:39:14.205 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:39:14.205 INFO:teuthology.orchestra.run.smithi062.stdout: mon clock drift allowed = 1.000 2024-05-14T14:39:14.205 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:39:14.206 INFO:teuthology.orchestra.run.smithi062.stdout: osd crush chooseleaf type = 0 2024-05-14T14:39:14.206 INFO:teuthology.orchestra.run.smithi062.stdout: auth debug = true 2024-05-14T14:39:14.206 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:39:14.206 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on old message = true 2024-05-14T14:39:14.206 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on bug = true 2024-05-14T14:39:14.206 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:39:14.206 INFO:teuthology.orchestra.run.smithi062.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-14T14:39:14.206 INFO:teuthology.orchestra.run.smithi062.stdout: mon pg warn max object skew = 0 2024-05-14T14:39:14.206 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:39:14.206 INFO:teuthology.orchestra.run.smithi062.stdout: # disable pg_autoscaler by default for new pools 2024-05-14T14:39:14.206 INFO:teuthology.orchestra.run.smithi062.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-14T14:39:14.206 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:39:14.206 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default size = 2 2024-05-14T14:39:14.206 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:39:14.207 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow primary affinity = true 2024-05-14T14:39:14.207 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow pg remap = true 2024-05-14T14:39:14.207 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on legacy crush tunables = false 2024-05-14T14:39:14.207 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on crush straw calc version zero = false 2024-05-14T14:39:14.207 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on no sortbitwise = false 2024-05-14T14:39:14.207 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on osd down out interval zero = false 2024-05-14T14:39:14.207 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on too few osds = false 2024-05-14T14:39:14.207 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-14T14:39:14.207 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-14T14:39:14.207 INFO:teuthology.orchestra.run.smithi062.stdout: mon_allow_pool_size_one = true 2024-05-14T14:39:14.207 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:39:14.207 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-14T14:39:14.207 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:39:14.207 INFO:teuthology.orchestra.run.smithi062.stdout: osd default data pool replay window = 5 2024-05-14T14:39:14.207 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:39:14.208 INFO:teuthology.orchestra.run.smithi062.stdout: mon allow pool delete = true 2024-05-14T14:39:14.208 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:39:14.208 INFO:teuthology.orchestra.run.smithi062.stdout: mon cluster log file level = debug 2024-05-14T14:39:14.208 INFO:teuthology.orchestra.run.smithi062.stdout: debug asserts on shutdown = true 2024-05-14T14:39:14.208 INFO:teuthology.orchestra.run.smithi062.stdout: mon health detail to clog = false 2024-05-14T14:39:14.208 INFO:teuthology.orchestra.run.smithi062.stdout: mon host = "172.21.15.39,172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790]" 2024-05-14T14:39:14.208 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on skipped message = False 2024-05-14T14:39:14.208 INFO:teuthology.orchestra.run.smithi062.stdout: fsid = d7983fec-79c7-4991-b19c-1aecead64611 2024-05-14T14:39:14.208 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:39:14.208 INFO:teuthology.orchestra.run.smithi062.stdout:[osd] 2024-05-14T14:39:14.208 INFO:teuthology.orchestra.run.smithi062.stdout: osd journal size = 100 2024-05-14T14:39:14.208 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:39:14.208 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub load threshold = 5.0 2024-05-14T14:39:14.208 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub max interval = 600 2024-05-14T14:39:14.208 INFO:teuthology.orchestra.run.smithi062.stdout: osd mclock profile = high_recovery_ops 2024-05-14T14:39:14.208 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:39:14.208 INFO:teuthology.orchestra.run.smithi062.stdout: osd recover clone overlap = true 2024-05-14T14:39:14.209 INFO:teuthology.orchestra.run.smithi062.stdout: osd recovery max chunk = 1048576 2024-05-14T14:39:14.209 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:39:14.209 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug shutdown = true 2024-05-14T14:39:14.209 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug op order = true 2024-05-14T14:39:14.209 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug verify stray on activate = true 2024-05-14T14:39:14.209 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug trim objects = true 2024-05-14T14:39:14.209 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:39:14.209 INFO:teuthology.orchestra.run.smithi062.stdout: osd open classes on start = true 2024-05-14T14:39:14.209 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug pg log writeout = true 2024-05-14T14:39:14.209 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:39:14.209 INFO:teuthology.orchestra.run.smithi062.stdout: osd deep scrub update digest min age = 30 2024-05-14T14:39:14.209 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:39:14.209 INFO:teuthology.orchestra.run.smithi062.stdout: osd map max advance = 10 2024-05-14T14:39:14.209 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:39:14.209 INFO:teuthology.orchestra.run.smithi062.stdout: journal zero on create = true 2024-05-14T14:39:14.210 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:39:14.210 INFO:teuthology.orchestra.run.smithi062.stdout: filestore ondisk finisher threads = 3 2024-05-14T14:39:14.210 INFO:teuthology.orchestra.run.smithi062.stdout: filestore apply finisher threads = 3 2024-05-14T14:39:14.210 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:39:14.210 INFO:teuthology.orchestra.run.smithi062.stdout: bdev debug aio = true 2024-05-14T14:39:14.210 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug misdirected ops = true 2024-05-14T14:39:14.210 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore block size = 96636764160 2024-05-14T14:39:14.210 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore fsck on mount = True 2024-05-14T14:39:14.210 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluefs = 20 2024-05-14T14:39:14.210 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluestore = 20 2024-05-14T14:39:14.210 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-05-14T14:39:14.210 INFO:teuthology.orchestra.run.smithi062.stdout: debug osd = 20 2024-05-14T14:39:14.210 INFO:teuthology.orchestra.run.smithi062.stdout: debug rocksdb = 10 2024-05-14T14:39:14.210 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd backfillfull_ratio = 0.85 2024-05-14T14:39:14.210 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd full ratio = 0.9 2024-05-14T14:39:14.211 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd nearfull ratio = 0.8 2024-05-14T14:39:14.211 INFO:teuthology.orchestra.run.smithi062.stdout: osd failsafe full ratio = 0.95 2024-05-14T14:39:14.211 INFO:teuthology.orchestra.run.smithi062.stdout: osd objectstore = bluestore 2024-05-14T14:39:14.211 INFO:teuthology.orchestra.run.smithi062.stdout: osd op complaint time = 180 2024-05-14T14:39:14.211 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:39:14.211 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr] 2024-05-14T14:39:14.211 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-05-14T14:39:14.211 INFO:teuthology.orchestra.run.smithi062.stdout: debug mgr = 20 2024-05-14T14:39:14.211 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2024-05-14T14:39:14.211 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2024-05-14T14:39:14.211 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2024-05-14T14:39:14.211 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2024-05-14T14:39:14.211 INFO:teuthology.orchestra.run.smithi062.stdout: mgr/telemetry/nag = false 2024-05-14T14:39:14.211 INFO:teuthology.orchestra.run.smithi062.stdout: debug client = 20 2024-05-14T14:39:14.212 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:39:14.212 INFO:teuthology.orchestra.run.smithi062.stdout:[mon] 2024-05-14T14:39:14.212 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-05-14T14:39:14.212 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2024-05-14T14:39:14.212 INFO:teuthology.orchestra.run.smithi062.stdout: debug paxos = 20 2024-05-14T14:39:14.212 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2024-05-14T14:39:14.212 INFO:teuthology.orchestra.run.smithi062.stdout: mon data avail warn = 5 2024-05-14T14:39:14.212 INFO:teuthology.orchestra.run.smithi062.stdout: mon mgr mkfs grace = 240 2024-05-14T14:39:14.212 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2024-05-14T14:39:14.212 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd reporter subtree level = osd 2024-05-14T14:39:14.212 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd prime pg temp = true 2024-05-14T14:39:14.212 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2024-05-14T14:39:14.212 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:39:14.212 INFO:teuthology.orchestra.run.smithi062.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-14T14:39:14.212 INFO:teuthology.orchestra.run.smithi062.stdout: auth mon ticket ttl = 660 # 11m 2024-05-14T14:39:14.212 INFO:teuthology.orchestra.run.smithi062.stdout: auth service ticket ttl = 240 # 4m 2024-05-14T14:39:14.213 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:39:14.213 INFO:teuthology.orchestra.run.smithi062.stdout: # don't complain about insecure global_id in the test suite 2024-05-14T14:39:14.213 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-14T14:39:14.213 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-14T14:39:14.213 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:39:14.213 INFO:teuthology.orchestra.run.smithi062.stdout: # 1m isn't quite enough 2024-05-14T14:39:14.213 INFO:teuthology.orchestra.run.smithi062.stdout: mon_down_mkfs_grace = 2m 2024-05-14T14:39:14.213 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:39:14.213 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_filestore_osds = false 2024-05-14T14:39:14.213 INFO:teuthology.orchestra.run.smithi062.stdout: mon down mkfs grace = 300 2024-05-14T14:39:14.213 INFO:teuthology.orchestra.run.smithi062.stdout: mon op complaint time = 120 2024-05-14T14:39:14.213 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-05-14T14:39:14.213 INFO:teuthology.orchestra.run.smithi062.stdout:[client] 2024-05-14T14:39:14.213 INFO:teuthology.orchestra.run.smithi062.stdout: rgw cache enabled = true 2024-05-14T14:39:14.213 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable ops log = true 2024-05-14T14:39:14.213 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable usage log = true 2024-05-14T14:39:14.214 INFO:teuthology.orchestra.run.smithi062.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-14T14:39:14.214 INFO:teuthology.orchestra.run.smithi062.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-14T14:39:14.214 INFO:teuthology.orchestra.run.smithi062.stdout: client mount timeout = 600 2024-05-14T14:39:14.214 INFO:teuthology.orchestra.run.smithi062.stdout: debug client = 20 2024-05-14T14:39:14.214 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-05-14T14:39:14.214 INFO:teuthology.orchestra.run.smithi062.stdout: pid file = "" 2024-05-14T14:39:14.214 INFO:teuthology.orchestra.run.smithi062.stdout: rados mon op timeout = 900 2024-05-14T14:39:14.214 INFO:teuthology.orchestra.run.smithi062.stdout: rados osd op timeout = 900 2024-05-14T14:39:14.214 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.a] 2024-05-14T14:39:14.214 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.b] 2024-05-14T14:39:14.214 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.c] 2024-05-14T14:39:14.214 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.a] 2024-05-14T14:39:14.214 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.c] 2024-05-14T14:39:14.214 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.b] 2024-05-14T14:39:14.214 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.d] 2024-05-14T14:39:14.215 INFO:teuthology.orchestra.run.smithi062.stdout:[mds] 2024-05-14T14:39:14.215 INFO:teuthology.orchestra.run.smithi062.stdout: debug mds = 20 2024-05-14T14:39:14.215 INFO:teuthology.orchestra.run.smithi062.stdout: debug mds balancer = 20 2024-05-14T14:39:14.215 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-05-14T14:39:14.215 INFO:teuthology.orchestra.run.smithi062.stdout: mds debug frag = True 2024-05-14T14:39:14.215 INFO:teuthology.orchestra.run.smithi062.stdout: mds debug scatterstat = True 2024-05-14T14:39:14.215 INFO:teuthology.orchestra.run.smithi062.stdout: mds op complaint time = 180 2024-05-14T14:39:14.215 INFO:teuthology.orchestra.run.smithi062.stdout: mds verify scatter = True 2024-05-14T14:39:14.215 INFO:teuthology.orchestra.run.smithi062.stdout: osd op complaint time = 180 2024-05-14T14:39:14.215 INFO:teuthology.orchestra.run.smithi062.stdout: rados mon op timeout = 900 2024-05-14T14:39:14.215 INFO:teuthology.orchestra.run.smithi062.stdout: rados osd op timeout = 900 2024-05-14T14:39:14.217 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-14T14:39:14.217 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-14T14:39:14.323 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-14T14:39:14.323 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T14:39:14.323 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-14T14:39:14.339 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T14:39:14.339 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-14T14:39:14.395 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi039.front.sepia.ceph.com 2024-05-14T14:39:14.395 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T14:39:14.395 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-14T14:39:14.395 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-14T14:39:14.471 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T14:39:14.471 DEBUG:teuthology.orchestra.run.smithi039:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-14T14:39:14.527 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi062.front.sepia.ceph.com 2024-05-14T14:39:14.527 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-14T14:39:14.527 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-14T14:39:14.527 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-14T14:39:14.569 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-14T14:39:14.570 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-14T14:39:14.628 INFO:tasks.ceph:Setting up mon nodes... 2024-05-14T14:39:14.628 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-14T14:39:14.628 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-14T14:39:14.689 INFO:teuthology.orchestra.run.smithi039.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-14T14:39:14.692 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-14T14:39:14.778 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-14T14:39:14.781 INFO:tasks.ceph:Setting up mds nodes... 2024-05-14T14:39:14.781 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-14T14:39:14.844 INFO:teuthology.orchestra.run.smithi039.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-14T14:39:14.847 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-14T14:39:14.872 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-14T14:39:14.974 INFO:teuthology.orchestra.run.smithi039.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-14T14:39:14.977 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-14T14:39:15.003 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-14T14:39:15.072 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-14T14:39:15.075 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-14T14:39:15.102 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-14T14:39:15.207 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-14T14:39:15.210 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-14T14:39:15.236 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-14T14:39:15.236 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-14T14:39:15.289 INFO:teuthology.orchestra.run.smithi039.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-14T14:39:15.303 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-05-14T14:39:15.354 INFO:teuthology.orchestra.run.smithi039.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-05-14T14:39:15.368 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-14T14:39:15.420 INFO:teuthology.orchestra.run.smithi062.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-05-14T14:39:15.434 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-05-14T14:39:15.484 INFO:teuthology.orchestra.run.smithi062.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-05-14T14:39:15.498 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-14T14:39:15.498 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi039.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi062.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-14T14:39:15.498 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-14T14:39:15.524 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-14T14:39:15.524 INFO:tasks.ceph:role: osd.0 2024-05-14T14:39:15.524 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi039.front.sepia.ceph.com 2024-05-14T14:39:15.524 DEBUG:teuthology.orchestra.run.smithi039:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-14T14:39:15.617 INFO:teuthology.orchestra.run.smithi039.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-14T14:39:15.617 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-14T14:39:15.618 INFO:teuthology.orchestra.run.smithi039.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-14T14:39:15.618 INFO:teuthology.orchestra.run.smithi039.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-14T14:39:15.618 INFO:teuthology.orchestra.run.smithi039.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-14T14:39:15.618 INFO:teuthology.orchestra.run.smithi039.stdout: = sunit=0 swidth=0 blks 2024-05-14T14:39:15.618 INFO:teuthology.orchestra.run.smithi039.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-14T14:39:15.618 INFO:teuthology.orchestra.run.smithi039.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-14T14:39:15.618 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-14T14:39:15.618 INFO:teuthology.orchestra.run.smithi039.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-14T14:39:16.935 INFO:teuthology.orchestra.run.smithi039.stdout:Discarding blocks...Done. 2024-05-14T14:39:16.937 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi039.front.sepia.ceph.com -o noatime 2024-05-14T14:39:16.937 DEBUG:teuthology.orchestra.run.smithi039:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-14T14:39:16.977 DEBUG:teuthology.orchestra.run.smithi039:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-14T14:39:17.053 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-14T14:39:17.122 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-14T14:39:17.122 INFO:tasks.ceph:role: osd.1 2024-05-14T14:39:17.122 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi039.front.sepia.ceph.com 2024-05-14T14:39:17.122 DEBUG:teuthology.orchestra.run.smithi039:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-14T14:39:17.219 INFO:teuthology.orchestra.run.smithi039.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-14T14:39:17.219 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-14T14:39:17.219 INFO:teuthology.orchestra.run.smithi039.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-14T14:39:17.219 INFO:teuthology.orchestra.run.smithi039.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-14T14:39:17.219 INFO:teuthology.orchestra.run.smithi039.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-14T14:39:17.219 INFO:teuthology.orchestra.run.smithi039.stdout: = sunit=0 swidth=0 blks 2024-05-14T14:39:17.219 INFO:teuthology.orchestra.run.smithi039.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-14T14:39:17.219 INFO:teuthology.orchestra.run.smithi039.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-14T14:39:17.219 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-14T14:39:17.219 INFO:teuthology.orchestra.run.smithi039.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-14T14:39:18.533 INFO:teuthology.orchestra.run.smithi039.stdout:Discarding blocks...Done. 2024-05-14T14:39:18.535 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi039.front.sepia.ceph.com -o noatime 2024-05-14T14:39:18.535 DEBUG:teuthology.orchestra.run.smithi039:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-14T14:39:18.568 DEBUG:teuthology.orchestra.run.smithi039:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-14T14:39:18.638 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-14T14:39:18.704 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-14T14:39:18.704 INFO:tasks.ceph:role: osd.2 2024-05-14T14:39:18.704 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi039.front.sepia.ceph.com 2024-05-14T14:39:18.704 DEBUG:teuthology.orchestra.run.smithi039:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-14T14:39:18.798 INFO:teuthology.orchestra.run.smithi039.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-14T14:39:18.798 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-14T14:39:18.798 INFO:teuthology.orchestra.run.smithi039.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-14T14:39:18.798 INFO:teuthology.orchestra.run.smithi039.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-14T14:39:18.798 INFO:teuthology.orchestra.run.smithi039.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-14T14:39:18.798 INFO:teuthology.orchestra.run.smithi039.stdout: = sunit=0 swidth=0 blks 2024-05-14T14:39:18.798 INFO:teuthology.orchestra.run.smithi039.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-14T14:39:18.798 INFO:teuthology.orchestra.run.smithi039.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-14T14:39:18.798 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-14T14:39:18.798 INFO:teuthology.orchestra.run.smithi039.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-14T14:39:20.120 INFO:teuthology.orchestra.run.smithi039.stdout:Discarding blocks...Done. 2024-05-14T14:39:20.123 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi039.front.sepia.ceph.com -o noatime 2024-05-14T14:39:20.123 DEBUG:teuthology.orchestra.run.smithi039:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-14T14:39:20.161 DEBUG:teuthology.orchestra.run.smithi039:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-14T14:39:20.236 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-14T14:39:20.304 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-14T14:39:20.304 INFO:tasks.ceph:role: osd.3 2024-05-14T14:39:20.304 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi039.front.sepia.ceph.com 2024-05-14T14:39:20.305 DEBUG:teuthology.orchestra.run.smithi039:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-14T14:39:20.400 INFO:teuthology.orchestra.run.smithi039.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-14T14:39:20.401 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-14T14:39:20.401 INFO:teuthology.orchestra.run.smithi039.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-14T14:39:20.401 INFO:teuthology.orchestra.run.smithi039.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-14T14:39:20.401 INFO:teuthology.orchestra.run.smithi039.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-14T14:39:20.401 INFO:teuthology.orchestra.run.smithi039.stdout: = sunit=0 swidth=0 blks 2024-05-14T14:39:20.401 INFO:teuthology.orchestra.run.smithi039.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-14T14:39:20.401 INFO:teuthology.orchestra.run.smithi039.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-14T14:39:20.401 INFO:teuthology.orchestra.run.smithi039.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-14T14:39:20.401 INFO:teuthology.orchestra.run.smithi039.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-14T14:39:21.725 INFO:teuthology.orchestra.run.smithi039.stdout:Discarding blocks...Done. 2024-05-14T14:39:21.728 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi039.front.sepia.ceph.com -o noatime 2024-05-14T14:39:21.728 DEBUG:teuthology.orchestra.run.smithi039:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-14T14:39:21.765 DEBUG:teuthology.orchestra.run.smithi039:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-14T14:39:21.838 DEBUG:teuthology.orchestra.run.smithi039:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-14T14:39:21.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:21.964+0000 7f251ee1b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-14T14:39:21.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:21.965+0000 7f251ee1b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-14T14:39:21.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:21.965+0000 7f251ee1b640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-14T14:39:21.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:21.965+0000 7f251ee1b640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-14T14:39:21.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:21.965+0000 7f251ee1b640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-14T14:39:21.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:21.965+0000 7f251ee1b640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-14T14:39:24.813 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-14T14:39:24.845 DEBUG:teuthology.orchestra.run.smithi039:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-14T14:39:24.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:24.966+0000 7ff19f81a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-14T14:39:24.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:24.966+0000 7ff19f81a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-14T14:39:24.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:24.966+0000 7ff19f81a640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-14T14:39:24.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:24.966+0000 7ff19f81a640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-14T14:39:24.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:24.966+0000 7ff19f81a640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-14T14:39:24.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:24.967+0000 7ff19f81a640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-14T14:39:27.826 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-14T14:39:27.858 DEBUG:teuthology.orchestra.run.smithi039:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-14T14:39:27.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:27.978+0000 7fd2227bc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-14T14:39:27.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:27.978+0000 7fd2227bc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-14T14:39:27.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:27.978+0000 7fd2227bc640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-14T14:39:27.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:27.978+0000 7fd2227bc640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-14T14:39:27.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:27.978+0000 7fd2227bc640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-14T14:39:27.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:27.979+0000 7fd2227bc640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-14T14:39:30.823 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-14T14:39:30.852 DEBUG:teuthology.orchestra.run.smithi039:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-14T14:39:30.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:30.970+0000 7f0c8d5b1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-14T14:39:30.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:30.970+0000 7f0c8d5b1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-14T14:39:30.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:30.970+0000 7f0c8d5b1640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-14T14:39:30.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:30.970+0000 7f0c8d5b1640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-14T14:39:30.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:30.970+0000 7f0c8d5b1640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-14T14:39:30.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:30.971+0000 7f0c8d5b1640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-14T14:39:33.827 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-14T14:39:33.857 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-14T14:39:33.888 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-14T14:39:33.888 INFO:tasks.ceph:role: osd.4 2024-05-14T14:39:33.888 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi062.front.sepia.ceph.com 2024-05-14T14:39:33.888 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-14T14:39:33.963 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-14T14:39:33.964 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-14T14:39:33.964 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-14T14:39:33.964 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-14T14:39:33.964 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-14T14:39:33.964 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2024-05-14T14:39:33.964 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-14T14:39:33.964 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-14T14:39:33.964 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-14T14:39:33.964 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-14T14:39:34.460 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2024-05-14T14:39:34.463 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2024-05-14T14:39:34.463 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-14T14:39:34.565 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-14T14:39:34.597 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-14T14:39:34.663 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-14T14:39:34.663 INFO:tasks.ceph:role: osd.5 2024-05-14T14:39:34.663 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi062.front.sepia.ceph.com 2024-05-14T14:39:34.663 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-14T14:39:34.736 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-14T14:39:34.736 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-14T14:39:34.736 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-14T14:39:34.737 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-14T14:39:34.737 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-14T14:39:34.737 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2024-05-14T14:39:34.737 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-14T14:39:34.737 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-14T14:39:34.737 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-14T14:39:34.737 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-14T14:39:35.189 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2024-05-14T14:39:35.191 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2024-05-14T14:39:35.191 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-14T14:39:35.271 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-14T14:39:35.343 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-14T14:39:35.410 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-14T14:39:35.410 INFO:tasks.ceph:role: osd.6 2024-05-14T14:39:35.410 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi062.front.sepia.ceph.com 2024-05-14T14:39:35.410 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-14T14:39:35.482 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-14T14:39:35.482 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-14T14:39:35.482 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-14T14:39:35.482 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-14T14:39:35.482 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-14T14:39:35.483 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2024-05-14T14:39:35.483 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-14T14:39:35.483 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-14T14:39:35.483 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-14T14:39:35.483 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-14T14:39:35.969 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2024-05-14T14:39:35.971 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2024-05-14T14:39:35.971 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-14T14:39:36.064 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-14T14:39:36.096 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-14T14:39:36.163 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-14T14:39:36.163 INFO:tasks.ceph:role: osd.7 2024-05-14T14:39:36.163 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi062.front.sepia.ceph.com 2024-05-14T14:39:36.163 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-14T14:39:36.238 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-14T14:39:36.238 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-14T14:39:36.238 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-14T14:39:36.238 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-14T14:39:36.238 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-14T14:39:36.238 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2024-05-14T14:39:36.238 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-14T14:39:36.238 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-14T14:39:36.238 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-14T14:39:36.238 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-14T14:39:36.758 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2024-05-14T14:39:36.760 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2024-05-14T14:39:36.761 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-14T14:39:36.882 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-14T14:39:36.917 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-14T14:39:37.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:37.045+0000 7f8d8e63a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-14T14:39:37.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:37.051+0000 7f8d8e63a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-14T14:39:37.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:37.051+0000 7f8d8e63a640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-14T14:39:37.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:37.051+0000 7f8d8e63a640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-14T14:39:37.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:37.051+0000 7f8d8e63a640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-14T14:39:37.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:37.053+0000 7f8d8e63a640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-14T14:39:39.893 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-14T14:39:39.925 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-14T14:39:40.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:40.047+0000 7f6335021640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-14T14:39:40.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:40.047+0000 7f6335021640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-14T14:39:40.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:40.047+0000 7f6335021640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-14T14:39:40.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:40.047+0000 7f6335021640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-14T14:39:40.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:40.047+0000 7f6335021640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-14T14:39:40.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:40.048+0000 7f6335021640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-14T14:39:42.153 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:39:42.157 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:39:42.880 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-14T14:39:42.911 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-14T14:39:43.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:43.032+0000 7fc47601d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-14T14:39:43.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:43.032+0000 7fc47601d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-14T14:39:43.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:43.032+0000 7fc47601d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-14T14:39:43.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:43.032+0000 7fc47601d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-14T14:39:43.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:43.032+0000 7fc47601d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-14T14:39:43.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:43.033+0000 7fc47601d640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-14T14:39:45.866 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-14T14:39:45.897 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-14T14:39:46.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:46.017+0000 7fa55f861640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-14T14:39:46.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:46.018+0000 7fa55f861640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-14T14:39:46.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:46.018+0000 7fa55f861640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-14T14:39:46.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:46.018+0000 7fa55f861640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-14T14:39:46.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:46.018+0000 7fa55f861640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-14T14:39:46.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:46.018+0000 7fa55f861640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-14T14:39:48.859 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-14T14:39:48.888 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-14T14:39:48.889 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T14:39:48.889 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-14T14:39:48.920 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T14:39:48.920 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-14T14:39:48.989 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T14:39:48.989 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-14T14:39:49.058 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T14:39:49.058 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-14T14:39:49.126 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T14:39:49.126 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-14T14:39:49.193 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T14:39:49.193 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-14T14:39:49.260 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T14:39:49.260 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-14T14:39:49.326 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-14T14:39:49.326 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-14T14:39:49.357 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-14T14:39:49.357 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-14T14:39:49.427 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-14T14:39:49.427 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-14T14:39:49.498 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-14T14:39:49.498 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-14T14:39:49.568 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-14T14:39:49.568 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-14T14:39:49.636 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-14T14:39:49.637 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-14T14:39:49.704 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-14T14:39:49.704 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-14T14:39:49.771 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T14:39:49.771 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-14T14:39:49.789 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T14:39:49.789 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-05-14T14:39:49.846 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-14T14:39:49.847 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-05-14T14:39:49.863 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-14T14:39:49.863 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-05-14T14:39:49.920 INFO:tasks.ceph:Adding keys to all mons... 2024-05-14T14:39:49.920 DEBUG:teuthology.orchestra.run.smithi039:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-14T14:39:49.922 DEBUG:teuthology.orchestra.run.smithi062:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-14T14:39:49.963 INFO:teuthology.orchestra.run.smithi039.stdout:[mgr.y] 2024-05-14T14:39:49.963 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQCSd0Nmmy8TKhAAo6Ta4NrmDXm+h/bmI+LHTg== 2024-05-14T14:39:49.963 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.a] 2024-05-14T14:39:49.964 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQCSd0Nm4a9FMxAApbmS1XfEyR4q6CO6UDG+cw== 2024-05-14T14:39:49.964 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.c] 2024-05-14T14:39:49.964 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQCSd0NmO5cJOxAAb2mw8iod6DV2NbQFmdrSTw== 2024-05-14T14:39:49.964 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.0] 2024-05-14T14:39:49.964 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQCZd0NmrAuUORAA52j0Y3kmqDkQAUqUj8kxuw== 2024-05-14T14:39:49.964 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.1] 2024-05-14T14:39:49.964 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQCcd0NmgEOsORAAHkw/LYA2JX4jFMI7NJ6zWQ== 2024-05-14T14:39:49.964 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.2] 2024-05-14T14:39:49.964 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQCfd0NmxtFoOhAAJAdu3pBXuh0zUW5tRhUqrQ== 2024-05-14T14:39:49.964 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.3] 2024-05-14T14:39:49.964 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQCid0Nm1tLiORAAOauIbA7k+qRs9R2u25XF8w== 2024-05-14T14:39:49.964 INFO:teuthology.orchestra.run.smithi039.stdout:[mgr.x] 2024-05-14T14:39:49.964 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQCSd0NmjEFVLxAA/dcONNAHSobwjkRZKBDwOA== 2024-05-14T14:39:49.965 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.b] 2024-05-14T14:39:49.965 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQCTd0NmZGVHBRAAg0uPt2eDuXLhfPbeqJYZmg== 2024-05-14T14:39:49.965 INFO:teuthology.orchestra.run.smithi039.stdout:[mds.d] 2024-05-14T14:39:49.965 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQCTd0NmZrFTDRAAggDxYQt3mBD/mHPvaZQu8A== 2024-05-14T14:39:49.965 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.4] 2024-05-14T14:39:49.965 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQCpd0NmbBTJAhAA2vLCiFiVDFwvGaY/nTVsUg== 2024-05-14T14:39:49.965 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.5] 2024-05-14T14:39:49.965 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQCsd0NmIV/hAhAAMoFlzq4YeQtFij1yh1CH+A== 2024-05-14T14:39:49.965 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.6] 2024-05-14T14:39:49.965 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQCvd0Nm/+r5ARAAb2WnICCWfiys0UC4oFDP+Q== 2024-05-14T14:39:49.965 INFO:teuthology.orchestra.run.smithi039.stdout:[osd.7] 2024-05-14T14:39:49.965 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQCyd0NmJnsfARAANNJ2L6G1vIQvRpKbJVya6A== 2024-05-14T14:39:49.965 INFO:teuthology.orchestra.run.smithi039.stdout:[client.0] 2024-05-14T14:39:49.965 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQCTd0NmL7k5EhAAA1EBx0QBmemnkBYg0scBMA== 2024-05-14T14:39:49.965 INFO:teuthology.orchestra.run.smithi039.stdout:[client.2] 2024-05-14T14:39:49.966 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQCTd0NmvBkcFhAA0/hU07EBXNgk+88pgFySbg== 2024-05-14T14:39:49.966 INFO:teuthology.orchestra.run.smithi039.stdout:[client.1] 2024-05-14T14:39:49.966 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQCTd0NmwtkHGhAA54KfnG/4EZ81C+vby9bcXA== 2024-05-14T14:39:49.966 INFO:teuthology.orchestra.run.smithi039.stdout:[client.3] 2024-05-14T14:39:49.966 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQCTd0NmhwfbHRAAYHuMMMTGhPDN9RDy75Wkqw== 2024-05-14T14:39:49.985 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr.y] 2024-05-14T14:39:49.985 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCSd0Nmmy8TKhAAo6Ta4NrmDXm+h/bmI+LHTg== 2024-05-14T14:39:49.985 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.a] 2024-05-14T14:39:49.985 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCSd0Nm4a9FMxAApbmS1XfEyR4q6CO6UDG+cw== 2024-05-14T14:39:49.985 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.c] 2024-05-14T14:39:49.986 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCSd0NmO5cJOxAAb2mw8iod6DV2NbQFmdrSTw== 2024-05-14T14:39:49.986 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.0] 2024-05-14T14:39:49.986 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCZd0NmrAuUORAA52j0Y3kmqDkQAUqUj8kxuw== 2024-05-14T14:39:49.986 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.1] 2024-05-14T14:39:49.986 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCcd0NmgEOsORAAHkw/LYA2JX4jFMI7NJ6zWQ== 2024-05-14T14:39:49.986 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.2] 2024-05-14T14:39:49.986 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCfd0NmxtFoOhAAJAdu3pBXuh0zUW5tRhUqrQ== 2024-05-14T14:39:49.986 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.3] 2024-05-14T14:39:49.986 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCid0Nm1tLiORAAOauIbA7k+qRs9R2u25XF8w== 2024-05-14T14:39:49.986 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr.x] 2024-05-14T14:39:49.986 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCSd0NmjEFVLxAA/dcONNAHSobwjkRZKBDwOA== 2024-05-14T14:39:49.986 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.b] 2024-05-14T14:39:49.986 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCTd0NmZGVHBRAAg0uPt2eDuXLhfPbeqJYZmg== 2024-05-14T14:39:49.986 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.d] 2024-05-14T14:39:49.986 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCTd0NmZrFTDRAAggDxYQt3mBD/mHPvaZQu8A== 2024-05-14T14:39:49.987 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.4] 2024-05-14T14:39:49.987 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCpd0NmbBTJAhAA2vLCiFiVDFwvGaY/nTVsUg== 2024-05-14T14:39:49.987 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.5] 2024-05-14T14:39:49.987 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCsd0NmIV/hAhAAMoFlzq4YeQtFij1yh1CH+A== 2024-05-14T14:39:49.987 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.6] 2024-05-14T14:39:49.987 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCvd0Nm/+r5ARAAb2WnICCWfiys0UC4oFDP+Q== 2024-05-14T14:39:49.987 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.7] 2024-05-14T14:39:49.987 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCyd0NmJnsfARAANNJ2L6G1vIQvRpKbJVya6A== 2024-05-14T14:39:49.987 INFO:teuthology.orchestra.run.smithi062.stdout:[client.0] 2024-05-14T14:39:49.987 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCTd0NmL7k5EhAAA1EBx0QBmemnkBYg0scBMA== 2024-05-14T14:39:49.987 INFO:teuthology.orchestra.run.smithi062.stdout:[client.2] 2024-05-14T14:39:49.987 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCTd0NmvBkcFhAA0/hU07EBXNgk+88pgFySbg== 2024-05-14T14:39:49.987 INFO:teuthology.orchestra.run.smithi062.stdout:[client.1] 2024-05-14T14:39:49.987 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCTd0NmwtkHGhAA54KfnG/4EZ81C+vby9bcXA== 2024-05-14T14:39:49.987 INFO:teuthology.orchestra.run.smithi062.stdout:[client.3] 2024-05-14T14:39:49.988 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQCTd0NmhwfbHRAAYHuMMMTGhPDN9RDy75Wkqw== 2024-05-14T14:39:49.988 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-14T14:39:50.009 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-14T14:39:50.093 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-14T14:39:50.096 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-14T14:39:50.160 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-14T14:39:50.163 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-14T14:39:50.227 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T14:39:50.229 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T14:39:50.292 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T14:39:50.295 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T14:39:50.357 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T14:39:50.359 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T14:39:50.420 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T14:39:50.423 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T14:39:50.484 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-14T14:39:50.486 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-14T14:39:50.548 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-14T14:39:50.550 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-14T14:39:50.615 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-14T14:39:50.618 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-14T14:39:50.682 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T14:39:50.685 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T14:39:50.748 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T14:39:50.750 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T14:39:50.813 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T14:39:50.815 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T14:39:50.877 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T14:39:50.879 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-14T14:39:50.941 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-14T14:39:50.944 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-14T14:39:51.009 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-14T14:39:51.012 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-14T14:39:51.077 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-14T14:39:51.080 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-14T14:39:51.145 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-14T14:39:51.147 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-14T14:39:51.213 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-14T14:39:51.213 DEBUG:teuthology.orchestra.run.smithi039:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-14T14:39:51.239 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-14T14:39:51.374 DEBUG:teuthology.orchestra.run.smithi039:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-14T14:39:51.399 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-14T14:39:51.425 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-14T14:39:51.534 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-14T14:39:51.561 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-14T14:39:51.626 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-14T14:39:51.736 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-14T14:39:51.761 DEBUG:teuthology.orchestra.run.smithi039:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-14T14:39:51.763 DEBUG:teuthology.orchestra.run.smithi062:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-14T14:39:51.817 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-14T14:39:51.817 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-14T14:39:51.818 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-14T14:39:51.820 INFO:tasks.ceph.mon.a:Started 2024-05-14T14:39:51.820 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-14T14:39:51.821 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-14T14:39:51.860 INFO:tasks.ceph.mon.b:Started 2024-05-14T14:39:51.860 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-14T14:39:51.860 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-14T14:39:51.862 INFO:tasks.ceph.mon.c:Started 2024-05-14T14:39:51.862 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-14T14:39:51.863 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-14T14:39:51.863 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-14T14:39:51.867 INFO:tasks.ceph.mgr.y:Started 2024-05-14T14:39:51.867 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-14T14:39:51.867 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-14T14:39:51.869 INFO:tasks.ceph.mgr.x:Started 2024-05-14T14:39:51.869 INFO:tasks.ceph:Setting crush tunables to default 2024-05-14T14:39:51.869 DEBUG:teuthology.orchestra.run.smithi039:> sudo ceph --cluster ceph osd crush tunables default 2024-05-14T14:39:51.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.001+0000 7fe1f5014640 1 Processor -- start 2024-05-14T14:39:51.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.001+0000 7fe1f5014640 1 -- start start 2024-05-14T14:39:51.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.003+0000 7fe1f5014640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe1f00d0920 0x7fe1f00ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:51.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.003+0000 7fe1f5014640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1f015e420 0x7fe1f00d2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:51.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.003+0000 7fe1f5014640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1f015e830 con 0x7fe1f00d1de0 2024-05-14T14:39:51.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.003+0000 7fe1f5014640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fe1f0162000 con 0x7fe1f00d0920 2024-05-14T14:39:51.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.003+0000 7fe1f5014640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe1f01622e0 con 0x7fe1f015e420 2024-05-14T14:39:51.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.003+0000 7fe1ef59e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1f015e420 0x7fe1f00d2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:51.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.003+0000 7fe1ee59c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe1f00d0920 0x7fe1f00ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:51.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.003+0000 7fe1ee59c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe1f00d0920 0x7fe1f00ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.39:52700/0 (socket says 172.21.15.39:52700) 2024-05-14T14:39:51.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.003+0000 7fe1ee59c640 1 -- 172.21.15.39:0/936153150 learned_addr learned my addr 172.21.15.39:0/936153150 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:39:51.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.003+0000 7fe1ef59e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1f015e420 0x7fe1f00d2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.39:57488/0 (socket says 172.21.15.39:57488) 2024-05-14T14:39:51.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.003+0000 7fe1ee59c640 1 -- 172.21.15.39:0/936153150 >> v2:172.21.15.62:3300/0 conn(0x7fe1f00d0920 msgr2=0x7fe1f00ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-14T14:39:51.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.003+0000 7fe1ee59c640 1 -- 172.21.15.39:0/936153150 >> v2:172.21.15.62:3300/0 conn(0x7fe1f00d0920 msgr2=0x7fe1f00ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-14T14:39:51.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.003+0000 7fe1ee59c640 1 --2- 172.21.15.39:0/936153150 >> v2:172.21.15.62:3300/0 conn(0x7fe1f00d0920 0x7fe1f00ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-14T14:39:51.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.003+0000 7fe1ef59e640 1 -- 172.21.15.39:0/936153150 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1f015e420 msgr2=0x7fe1f00d2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-14T14:39:51.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.003+0000 7fe1ef59e640 1 -- 172.21.15.39:0/936153150 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1f015e420 msgr2=0x7fe1f00d2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-14T14:39:51.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.003+0000 7fe1ef59e640 1 --2- 172.21.15.39:0/936153150 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1f015e420 0x7fe1f00d2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-14T14:39:51.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.003+0000 7fe1ee59c640 1 --2- 172.21.15.39:0/936153150 >> v2:172.21.15.62:3300/0 conn(0x7fe1f00d0920 0x7fe1f00ce510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-14T14:39:51.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.003+0000 7fe1ef59e640 1 --2- 172.21.15.39:0/936153150 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1f015e420 0x7fe1f00d2520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-14T14:39:52.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.175+0000 7fe1edd9b640 1 -- 172.21.15.39:0/936153150 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2787003601 0 0) 0x7fe1f015e830 con 0x7fe1f00d1de0 2024-05-14T14:39:52.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.175+0000 7fe1edd9b640 1 -- 172.21.15.39:0/936153150 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1d8003520 con 0x7fe1f00d1de0 2024-05-14T14:39:52.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.176+0000 7fe1edd9b640 1 -- 172.21.15.39:0/936153150 <== mon.1 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 381344706 0 0) 0x7fe1d8003520 con 0x7fe1f00d1de0 2024-05-14T14:39:52.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.176+0000 7fe1edd9b640 1 -- 172.21.15.39:0/936153150 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1f015e420 msgr2=0x7fe1f00d2520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T14:39:52.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.176+0000 7fe1edd9b640 1 --2- 172.21.15.39:0/936153150 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1f015e420 0x7fe1f00d2520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:52.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.176+0000 7fe1edd9b640 1 -- 172.21.15.39:0/936153150 >> v2:172.21.15.62:3300/0 conn(0x7fe1f00d0920 msgr2=0x7fe1f00ce510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T14:39:52.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.176+0000 7fe1edd9b640 1 --2- 172.21.15.39:0/936153150 >> v2:172.21.15.62:3300/0 conn(0x7fe1f00d0920 0x7fe1f00ce510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:52.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.176+0000 7fe1edd9b640 1 -- 172.21.15.39:0/936153150 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1f01625c0 con 0x7fe1f00d1de0 2024-05-14T14:39:52.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.176+0000 7fe1edd9b640 1 -- 172.21.15.39:0/936153150 <== mon.1 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1803005051 0 0) 0x7fe1e00016f0 con 0x7fe1f00d1de0 2024-05-14T14:39:52.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.176+0000 7fe1edd9b640 1 -- 172.21.15.39:0/936153150 >> v1:172.21.15.62:6789/0 conn(0x7fe1f00d1de0 legacy=0x7fe1f00d0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:52.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.176+0000 7fe1edd9b640 1 --2- 172.21.15.39:0/936153150 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1f015e420 0x7fe1d8003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:52.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.176+0000 7fe1edd9b640 1 --2- 172.21.15.39:0/936153150 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1d8004080 0x7fe1d8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:52.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.176+0000 7fe1edd9b640 1 --2- 172.21.15.39:0/936153150 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1d8004d90 0x7fe1d8005260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:52.162 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.176+0000 7fe1edd9b640 1 -- 172.21.15.39:0/936153150 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f0162000 con 0x7fe1d8004080 2024-05-14T14:39:52.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.176+0000 7fe1edd9b640 1 -- 172.21.15.39:0/936153150 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f01622e0 con 0x7fe1d8004d90 2024-05-14T14:39:52.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.176+0000 7fe1edd9b640 1 -- 172.21.15.39:0/936153150 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe1d800bd40 con 0x7fe1f015e420 2024-05-14T14:39:52.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.176+0000 7fe1eed9d640 1 --2- 172.21.15.39:0/936153150 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1f015e420 0x7fe1d8003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:52.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.176+0000 7fe1ee59c640 1 --2- 172.21.15.39:0/936153150 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1d8004080 0x7fe1d8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:52.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.176+0000 7fe1ef59e640 1 --2- 172.21.15.39:0/936153150 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1d8004d90 0x7fe1d8005260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:52.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.176+0000 7fe1ee59c640 1 -- 172.21.15.39:0/936153150 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1f015e420 msgr2=0x7fe1d8003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:39:52.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.176+0000 7fe1ee59c640 1 --2- 172.21.15.39:0/936153150 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1f015e420 0x7fe1d8003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:52.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.176+0000 7fe1ee59c640 1 -- 172.21.15.39:0/936153150 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1d8004d90 msgr2=0x7fe1d8005260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:39:52.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.176+0000 7fe1ee59c640 1 --2- 172.21.15.39:0/936153150 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1d8004d90 0x7fe1d8005260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:52.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.176+0000 7fe1ee59c640 1 -- 172.21.15.39:0/936153150 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d8003520 con 0x7fe1d8004080 2024-05-14T14:39:52.163 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.177+0000 7fe1ee59c640 1 --2- 172.21.15.39:0/936153150 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1d8004080 0x7fe1d8004800 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4009880 tx=0x7fe1d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3ee3a3bcaad03a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:39:52.164 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.179+0000 7fe1edd9b640 1 -- 172.21.15.39:0/936153150 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e400f040 con 0x7fe1d8004080 2024-05-14T14:39:52.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.179+0000 7fe1edd9b640 1 -- 172.21.15.39:0/936153150 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1e402e070 con 0x7fe1d8004080 2024-05-14T14:39:52.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.179+0000 7fe1edd9b640 1 -- 172.21.15.39:0/936153150 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e4005990 con 0x7fe1d8004080 2024-05-14T14:39:52.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.180+0000 7fe1f5014640 1 -- 172.21.15.39:0/936153150 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1d8004080 msgr2=0x7fe1d8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:52.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.180+0000 7fe1f5014640 1 --2- 172.21.15.39:0/936153150 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1d8004080 0x7fe1d8004800 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4009880 tx=0x7fe1d8005830 comp rx=0 tx=0).stop 2024-05-14T14:39:52.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.180+0000 7fe1ef59e640 1 -- 172.21.15.39:0/936153150 reap_dead start 2024-05-14T14:39:52.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.180+0000 7fe1f5014640 1 -- 172.21.15.39:0/936153150 shutdown_connections 2024-05-14T14:39:52.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.180+0000 7fe1f5014640 1 -- 172.21.15.39:0/936153150 >> 172.21.15.39:0/936153150 conn(0x7fe1f00b5780 msgr2=0x7fe1f00b5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:39:52.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.180+0000 7fe1f5014640 1 -- 172.21.15.39:0/936153150 shutdown_connections 2024-05-14T14:39:52.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.180+0000 7fe1f5014640 1 -- 172.21.15.39:0/936153150 wait complete. 2024-05-14T14:39:52.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.182+0000 7fe1f5014640 1 Processor -- start 2024-05-14T14:39:52.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.183+0000 7fe1f5014640 1 -- start start 2024-05-14T14:39:52.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.185+0000 7fe1f5014640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1d8004080 0x7fe1f00cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:52.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.185+0000 7fe1f5014640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1f006f9c0 0x7fe1f01588e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:52.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.185+0000 7fe1eed9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1d8004080 0x7fe1f00cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:52.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.185+0000 7fe1f5014640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1f0158e20 0x7fe1f015ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:52.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.185+0000 7fe1ee59c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1f006f9c0 0x7fe1f01588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:52.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.185+0000 7fe1eed9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1d8004080 0x7fe1f00cb9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37550/0 (socket says 172.21.15.39:37550) 2024-05-14T14:39:52.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.185+0000 7fe1ee59c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1f006f9c0 0x7fe1f01588e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.39:57540/0 (socket says 172.21.15.39:57540) 2024-05-14T14:39:52.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.185+0000 7fe1eed9d640 1 -- 172.21.15.39:0/3665273736 learned_addr learned my addr 172.21.15.39:0/3665273736 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:39:52.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.185+0000 7fe1f5014640 1 -- 172.21.15.39:0/3665273736 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f00d2520 con 0x7fe1d8004080 2024-05-14T14:39:52.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.185+0000 7fe1f5014640 1 -- 172.21.15.39:0/3665273736 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe1f00cf660 con 0x7fe1f0158e20 2024-05-14T14:39:52.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.185+0000 7fe1f5014640 1 -- 172.21.15.39:0/3665273736 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe1f00d26a0 con 0x7fe1f006f9c0 2024-05-14T14:39:52.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.185+0000 7fe1ef59e640 1 --2- 172.21.15.39:0/3665273736 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1f0158e20 0x7fe1f015ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:52.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.186+0000 7fe1eed9d640 1 -- 172.21.15.39:0/3665273736 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1f006f9c0 msgr2=0x7fe1f01588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:52.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.186+0000 7fe1eed9d640 1 --2- 172.21.15.39:0/3665273736 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1f006f9c0 0x7fe1f01588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:52.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.186+0000 7fe1eed9d640 1 -- 172.21.15.39:0/3665273736 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1f0158e20 msgr2=0x7fe1f015ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:52.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.186+0000 7fe1eed9d640 1 --2- 172.21.15.39:0/3665273736 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1f0158e20 0x7fe1f015ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:52.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.186+0000 7fe1eed9d640 1 -- 172.21.15.39:0/3665273736 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1f0159230 con 0x7fe1d8004080 2024-05-14T14:39:52.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.186+0000 7fe1eed9d640 1 --2- 172.21.15.39:0/3665273736 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1d8004080 0x7fe1f00cb9a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0007fd0 tx=0x7fe1e000fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:39:52.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.189+0000 7fe1d77fe640 1 -- 172.21.15.39:0/3665273736 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e000fe50 con 0x7fe1d8004080 2024-05-14T14:39:52.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.189+0000 7fe1d77fe640 1 -- 172.21.15.39:0/3665273736 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1e0018070 con 0x7fe1d8004080 2024-05-14T14:39:52.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.189+0000 7fe1d77fe640 1 -- 172.21.15.39:0/3665273736 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1e000d730 con 0x7fe1d8004080 2024-05-14T14:39:52.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.189+0000 7fe1f5014640 1 -- 172.21.15.39:0/3665273736 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1f006e740 con 0x7fe1d8004080 2024-05-14T14:39:52.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.189+0000 7fe1d77fe640 1 -- 172.21.15.39:0/3665273736 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe1e000d8d0 con 0x7fe1d8004080 2024-05-14T14:39:52.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.189+0000 7fe1f5014640 1 -- 172.21.15.39:0/3665273736 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1f006ed00 con 0x7fe1d8004080 2024-05-14T14:39:52.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.189+0000 7fe1d77fe640 1 -- 172.21.15.39:0/3665273736 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe1e000ddf0 con 0x7fe1d8004080 2024-05-14T14:39:52.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.190+0000 7fe1f5014640 1 -- 172.21.15.39:0/3665273736 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1f0076aa0 con 0x7fe1d8004080 2024-05-14T14:39:52.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.193+0000 7fe1d77fe640 1 -- 172.21.15.39:0/3665273736 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fe1f0159230 con 0x7fe1d8004080 2024-05-14T14:39:52.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.260+0000 7fe1f5014640 1 -- 172.21.15.39:0/3665273736 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fe1f00cde70 con 0x7fe1d8004080 2024-05-14T14:39:52.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.262+0000 7fe1d77fe640 1 -- 172.21.15.39:0/3665273736 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fe1e00035f0 con 0x7fe1d8004080 2024-05-14T14:39:52.246 INFO:teuthology.orchestra.run.smithi039.stderr:adjusted tunables profile to default 2024-05-14T14:39:52.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.263+0000 7fe1f5014640 1 -- 172.21.15.39:0/3665273736 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1d8004080 msgr2=0x7fe1f00cb9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:52.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.263+0000 7fe1f5014640 1 --2- 172.21.15.39:0/3665273736 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1d8004080 0x7fe1f00cb9a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0007fd0 tx=0x7fe1e000fc00 comp rx=0 tx=0).stop 2024-05-14T14:39:52.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.263+0000 7fe1f5014640 1 -- 172.21.15.39:0/3665273736 shutdown_connections 2024-05-14T14:39:52.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.263+0000 7fe1f5014640 1 --2- 172.21.15.39:0/3665273736 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1f0158e20 0x7fe1f015ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:52.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.263+0000 7fe1f5014640 1 --2- 172.21.15.39:0/3665273736 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1f006f9c0 0x7fe1f01588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:52.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.263+0000 7fe1f5014640 1 --2- 172.21.15.39:0/3665273736 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1d8004080 0x7fe1f00cb9a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:52.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.263+0000 7fe1f5014640 1 -- 172.21.15.39:0/3665273736 >> 172.21.15.39:0/3665273736 conn(0x7fe1f00b5780 msgr2=0x7fe1f00b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:39:52.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.263+0000 7fe1f5014640 1 -- 172.21.15.39:0/3665273736 shutdown_connections 2024-05-14T14:39:52.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:52.263+0000 7fe1f5014640 1 -- 172.21.15.39:0/3665273736 wait complete. 2024-05-14T14:39:52.259 INFO:tasks.ceph:check_enable_crimson: False 2024-05-14T14:39:52.259 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-14T14:39:52.259 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T14:39:52.259 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-14T14:39:52.274 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-05-14T14:39:52.290+0000 7f21f3730040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-14T14:39:52.285 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T14:39:52.285 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-14T14:39:52.351 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T14:39:52.351 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-14T14:39:52.418 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T14:39:52.418 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-14T14:39:52.440 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-05-14T14:39:52.456+0000 7f21f3730040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-14T14:39:52.465 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-14T14:39:52.466 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-14T14:39:52.492 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-14T14:39:52.493 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-14T14:39:52.497 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-05-14T14:39:52.513+0000 7f21f3730040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-14T14:39:52.559 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-14T14:39:52.559 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-14T14:39:52.628 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-14T14:39:52.628 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-14T14:39:52.672 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-14T14:39:52.687+0000 7fe29a510040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-14T14:39:52.694 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new c4ec4534-6301-4dd7-b4d6-d560b096d442 0 2024-05-14T14:39:52.752 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-05-14T14:39:52.767+0000 7f21f3730040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-14T14:39:52.799 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-05-14T14:39:52.814+0000 7f21f3730040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-14T14:39:52.839 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-14T14:39:52.854+0000 7fe29a510040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-14T14:39:52.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.863+0000 7f951fb96640 1 Processor -- start 2024-05-14T14:39:52.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.864+0000 7f951fb96640 1 -- start start 2024-05-14T14:39:52.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.865+0000 7f951fb96640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95180d02c0 0x7f9518161c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:52.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.865+0000 7f951fb96640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f95180cea30 0x7f95180cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:52.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.865+0000 7f951fb96640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95180cf380 con 0x7f951815e0a0 2024-05-14T14:39:52.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.865+0000 7f951fb96640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f9518162b30 con 0x7f95180cea30 2024-05-14T14:39:52.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.865+0000 7f951fb96640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f95180ce810 con 0x7f95180d02c0 2024-05-14T14:39:52.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.865+0000 7f951d932640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95180d02c0 0x7f9518161c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:52.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.865+0000 7f951d932640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95180d02c0 0x7f9518161c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:34830/0 (socket says 172.21.15.62:34830) 2024-05-14T14:39:52.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.865+0000 7f951d932640 1 -- 172.21.15.62:0/619312806 learned_addr learned my addr 172.21.15.62:0/619312806 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-14T14:39:52.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.865+0000 7f951e133640 1 --2- 172.21.15.62:0/619312806 >> v2:172.21.15.62:3300/0 conn(0x7f95180cea30 0x7f95180cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:52.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.865+0000 7f951d932640 1 -- 172.21.15.62:0/619312806 >> v2:172.21.15.62:3300/0 conn(0x7f95180cea30 msgr2=0x7f95180cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:39:52.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.865+0000 7f951d932640 1 --2- 172.21.15.62:0/619312806 >> v2:172.21.15.62:3300/0 conn(0x7f95180cea30 0x7f95180cee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:52.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.866+0000 7f951d932640 1 -- 172.21.15.62:0/619312806 >> v1:172.21.15.39:6789/0 conn(0x7f951815e0a0 legacy=0x7f95180b6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:52.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.866+0000 7f951d932640 1 -- 172.21.15.62:0/619312806 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9518162290 con 0x7f95180d02c0 2024-05-14T14:39:52.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.866+0000 7f951d932640 1 --2- 172.21.15.62:0/619312806 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95180d02c0 0x7f9518161c00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9514009870 tx=0x7f951402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb2617c2f72f6ab5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:39:52.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.866+0000 7f951c930640 1 -- 172.21.15.62:0/619312806 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9514037070 con 0x7f95180d02c0 2024-05-14T14:39:52.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.866+0000 7f951c930640 1 -- 172.21.15.62:0/619312806 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9514032440 con 0x7f95180d02c0 2024-05-14T14:39:52.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.866+0000 7f951c930640 1 -- 172.21.15.62:0/619312806 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9514032810 con 0x7f95180d02c0 2024-05-14T14:39:52.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.867+0000 7f951fb96640 1 -- 172.21.15.62:0/619312806 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95180d02c0 msgr2=0x7f9518161c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:52.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.867+0000 7f951fb96640 1 --2- 172.21.15.62:0/619312806 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95180d02c0 0x7f9518161c00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9514009870 tx=0x7f951402a1c0 comp rx=0 tx=0).stop 2024-05-14T14:39:52.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.867+0000 7f951fb96640 1 -- 172.21.15.62:0/619312806 shutdown_connections 2024-05-14T14:39:52.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.867+0000 7f951fb96640 1 --2- 172.21.15.62:0/619312806 >> v2:172.21.15.62:3300/0 conn(0x7f95180cea30 0x7f95180cee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:52.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.867+0000 7f951fb96640 1 --2- 172.21.15.62:0/619312806 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95180d02c0 0x7f9518161c00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:52.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.867+0000 7f951fb96640 1 -- 172.21.15.62:0/619312806 >> 172.21.15.62:0/619312806 conn(0x7f9518071680 msgr2=0x7f9518071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:39:52.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.867+0000 7f951fb96640 1 -- 172.21.15.62:0/619312806 shutdown_connections 2024-05-14T14:39:52.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.867+0000 7f951fb96640 1 -- 172.21.15.62:0/619312806 wait complete. 2024-05-14T14:39:52.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.869+0000 7f951fb96640 1 Processor -- start 2024-05-14T14:39:52.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.869+0000 7f951fb96640 1 -- start start 2024-05-14T14:39:52.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.870+0000 7f951fb96640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95180cea30 0x7f95180b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:52.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.870+0000 7f951fb96640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95180d02c0 0x7f9518160e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:52.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.870+0000 7f951fb96640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f951815e0a0 0x7f951815f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:52.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.870+0000 7f951fb96640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f95180d21e0 con 0x7f95180d02c0 2024-05-14T14:39:52.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.870+0000 7f951fb96640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9518162850 con 0x7f951815e0a0 2024-05-14T14:39:52.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.870+0000 7f951fb96640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f951815e4b0 con 0x7f95180cea30 2024-05-14T14:39:52.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.871+0000 7f951d932640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95180cea30 0x7f95180b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:52.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.871+0000 7f951e133640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f951815e0a0 0x7f951815f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:52.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.871+0000 7f951d932640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95180cea30 0x7f95180b5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:34838/0 (socket says 172.21.15.62:34838) 2024-05-14T14:39:52.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.871+0000 7f951d932640 1 -- 172.21.15.62:0/11771576 learned_addr learned my addr 172.21.15.62:0/11771576 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-14T14:39:52.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.871+0000 7f951d131640 1 --2- 172.21.15.62:0/11771576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95180d02c0 0x7f9518160e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:52.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.871+0000 7f951d932640 1 -- 172.21.15.62:0/11771576 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f951815e0a0 msgr2=0x7f951815f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:52.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.871+0000 7f951d932640 1 --2- 172.21.15.62:0/11771576 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f951815e0a0 0x7f951815f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:52.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.871+0000 7f951d932640 1 -- 172.21.15.62:0/11771576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95180d02c0 msgr2=0x7f9518160e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:52.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.871+0000 7f951d932640 1 --2- 172.21.15.62:0/11771576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95180d02c0 0x7f9518160e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:52.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.871+0000 7f951d932640 1 -- 172.21.15.62:0/11771576 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f951815e780 con 0x7f95180cea30 2024-05-14T14:39:52.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.871+0000 7f951e133640 1 --2- 172.21.15.62:0/11771576 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f951815e0a0 0x7f951815f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T14:39:52.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.871+0000 7f951d932640 1 --2- 172.21.15.62:0/11771576 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95180cea30 0x7f95180b5aa0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9514009870 tx=0x7f95140046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:39:52.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.871+0000 7f950e7fc640 1 -- 172.21.15.62:0/11771576 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9514037040 con 0x7f95180cea30 2024-05-14T14:39:52.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.871+0000 7f950e7fc640 1 -- 172.21.15.62:0/11771576 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9514042070 con 0x7f95180cea30 2024-05-14T14:39:52.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.871+0000 7f950e7fc640 1 -- 172.21.15.62:0/11771576 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9514030880 con 0x7f95180cea30 2024-05-14T14:39:52.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.871+0000 7f951fb96640 1 -- 172.21.15.62:0/11771576 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f951815ea60 con 0x7f95180cea30 2024-05-14T14:39:52.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.872+0000 7f951fb96640 1 -- 172.21.15.62:0/11771576 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f951815f020 con 0x7f95180cea30 2024-05-14T14:39:52.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.872+0000 7f950e7fc640 1 -- 172.21.15.62:0/11771576 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f951402ad10 con 0x7f95180cea30 2024-05-14T14:39:52.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.872+0000 7f950e7fc640 1 -- 172.21.15.62:0/11771576 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f9514047900 con 0x7f95180cea30 2024-05-14T14:39:52.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.873+0000 7f951fb96640 1 -- 172.21.15.62:0/11771576 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9518076aa0 con 0x7f95180cea30 2024-05-14T14:39:52.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.875+0000 7f950e7fc640 1 -- 172.21.15.62:0/11771576 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f9514047460 con 0x7f95180cea30 2024-05-14T14:39:52.897 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-14T14:39:52.913+0000 7fe29a510040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-14T14:39:52.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.950+0000 7f951fb96640 1 -- 172.21.15.62:0/11771576 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c4ec4534-6301-4dd7-b4d6-d560b096d442", "id": 0} v 0) -- 0x7f951815b700 con 0x7f95180cea30 2024-05-14T14:39:52.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.958+0000 7f950e7fc640 1 -- 172.21.15.62:0/11771576 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c4ec4534-6301-4dd7-b4d6-d560b096d442", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f9514047b50 con 0x7f95180cea30 2024-05-14T14:39:52.943 INFO:teuthology.orchestra.run.smithi062.stdout:0 2024-05-14T14:39:52.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.959+0000 7f951fb96640 1 -- 172.21.15.62:0/11771576 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95180cea30 msgr2=0x7f95180b5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:52.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.959+0000 7f951fb96640 1 --2- 172.21.15.62:0/11771576 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95180cea30 0x7f95180b5aa0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9514009870 tx=0x7f95140046c0 comp rx=0 tx=0).stop 2024-05-14T14:39:52.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.959+0000 7f951fb96640 1 -- 172.21.15.62:0/11771576 shutdown_connections 2024-05-14T14:39:52.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.959+0000 7f951fb96640 1 --2- 172.21.15.62:0/11771576 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f951815e0a0 0x7f951815f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:52.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.959+0000 7f951fb96640 1 --2- 172.21.15.62:0/11771576 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f95180d02c0 0x7f9518160e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:52.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.959+0000 7f951fb96640 1 --2- 172.21.15.62:0/11771576 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f95180cea30 0x7f95180b5aa0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:52.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.959+0000 7f951fb96640 1 -- 172.21.15.62:0/11771576 >> 172.21.15.62:0/11771576 conn(0x7f9518071680 msgr2=0x7f95180b6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:39:52.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.959+0000 7f951fb96640 1 -- 172.21.15.62:0/11771576 shutdown_connections 2024-05-14T14:39:52.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:52.959+0000 7f951fb96640 1 -- 172.21.15.62:0/11771576 wait complete. 2024-05-14T14:39:52.958 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 93f91b0e-096e-4bdf-aed0-d1136f73f136 1 2024-05-14T14:39:53.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.086+0000 7fae8ff3f640 1 Processor -- start 2024-05-14T14:39:53.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.087+0000 7fae8ff3f640 1 -- start start 2024-05-14T14:39:53.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.088+0000 7fae8ff3f640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fae8815dfc0 0x7fae88160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:53.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.088+0000 7fae8ff3f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fae8806e750 0x7fae8806eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:53.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.088+0000 7fae8ff3f640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae8815e3d0 con 0x7fae8809b5f0 2024-05-14T14:39:53.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.088+0000 7fae8ff3f640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fae88161000 con 0x7fae8815dfc0 2024-05-14T14:39:53.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.088+0000 7fae8ff3f640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fae88161230 con 0x7fae8806e750 2024-05-14T14:39:53.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.088+0000 7fae8d4da640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fae8806e750 0x7fae8806eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:53.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.088+0000 7fae8d4da640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fae8806e750 0x7fae8806eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46536/0 (socket says 172.21.15.62:46536) 2024-05-14T14:39:53.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.088+0000 7fae8d4da640 1 -- 172.21.15.62:0/2609689550 learned_addr learned my addr 172.21.15.62:0/2609689550 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-14T14:39:53.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.088+0000 7fae8dcdb640 1 --2- 172.21.15.62:0/2609689550 >> v2:172.21.15.39:3300/0 conn(0x7fae8815dfc0 0x7fae88160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:53.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.088+0000 7fae8d4da640 1 -- 172.21.15.62:0/2609689550 >> v2:172.21.15.39:3300/0 conn(0x7fae8815dfc0 msgr2=0x7fae88160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:39:53.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.088+0000 7fae8d4da640 1 --2- 172.21.15.62:0/2609689550 >> v2:172.21.15.39:3300/0 conn(0x7fae8815dfc0 0x7fae88160ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:53.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.088+0000 7fae8d4da640 1 -- 172.21.15.62:0/2609689550 >> v1:172.21.15.39:6789/0 conn(0x7fae8809b5f0 legacy=0x7fae8809ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:53.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.088+0000 7fae8d4da640 1 -- 172.21.15.62:0/2609689550 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae88161510 con 0x7fae8806e750 2024-05-14T14:39:53.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.089+0000 7fae8d4da640 1 --2- 172.21.15.62:0/2609689550 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae8806e750 0x7fae8806eb60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fae8806e480 tx=0x7fae7c02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bc4f5245062f560 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:39:53.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.089+0000 7fae8ccd9640 1 -- 172.21.15.62:0/2609689550 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae7c037070 con 0x7fae8806e750 2024-05-14T14:39:53.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.089+0000 7fae8ccd9640 1 -- 172.21.15.62:0/2609689550 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae7c032440 con 0x7fae8806e750 2024-05-14T14:39:53.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.089+0000 7fae8ccd9640 1 -- 172.21.15.62:0/2609689550 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae7c032810 con 0x7fae8806e750 2024-05-14T14:39:53.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.090+0000 7fae8ff3f640 1 -- 172.21.15.62:0/2609689550 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae8806e750 msgr2=0x7fae8806eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:53.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.090+0000 7fae8ff3f640 1 --2- 172.21.15.62:0/2609689550 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae8806e750 0x7fae8806eb60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fae8806e480 tx=0x7fae7c02a270 comp rx=0 tx=0).stop 2024-05-14T14:39:53.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.090+0000 7fae8ff3f640 1 -- 172.21.15.62:0/2609689550 shutdown_connections 2024-05-14T14:39:53.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.090+0000 7fae8ff3f640 1 --2- 172.21.15.62:0/2609689550 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae8806e750 0x7fae8806eb60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:53.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.090+0000 7fae8ff3f640 1 --2- 172.21.15.62:0/2609689550 >> v2:172.21.15.39:3300/0 conn(0x7fae8815dfc0 0x7fae88160ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:53.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.090+0000 7fae8ff3f640 1 -- 172.21.15.62:0/2609689550 >> 172.21.15.62:0/2609689550 conn(0x7fae88074720 msgr2=0x7fae880b7820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:39:53.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.090+0000 7fae8ff3f640 1 -- 172.21.15.62:0/2609689550 shutdown_connections 2024-05-14T14:39:53.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.090+0000 7fae8ff3f640 1 -- 172.21.15.62:0/2609689550 wait complete. 2024-05-14T14:39:53.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.092+0000 7fae8ff3f640 1 Processor -- start 2024-05-14T14:39:53.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.092+0000 7fae8ff3f640 1 -- start start 2024-05-14T14:39:53.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.093+0000 7fae8ff3f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae8806e750 0x7fae880d0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:53.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.093+0000 7fae8ff3f640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fae8809b5f0 0x7fae8815be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:53.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.093+0000 7fae8ff3f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae8815dfc0 0x7fae8813d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:53.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.093+0000 7fae8ff3f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fae880d2e40 con 0x7fae8806e750 2024-05-14T14:39:53.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.093+0000 7fae8ff3f640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fae8806f9b0 con 0x7fae8815dfc0 2024-05-14T14:39:53.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.093+0000 7fae8ff3f640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fae880d2fc0 con 0x7fae8809b5f0 2024-05-14T14:39:53.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.094+0000 7fae8e4dc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae8815dfc0 0x7fae8813d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:53.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.094+0000 7fae8d4da640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fae8809b5f0 0x7fae8815be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:53.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.094+0000 7fae8d4da640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fae8809b5f0 0x7fae8815be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:34854/0 (socket says 172.21.15.62:34854) 2024-05-14T14:39:53.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.094+0000 7fae8e4dc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae8815dfc0 0x7fae8813d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46548/0 (socket says 172.21.15.62:46548) 2024-05-14T14:39:53.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.094+0000 7fae8d4da640 1 -- 172.21.15.62:0/2225732169 learned_addr learned my addr 172.21.15.62:0/2225732169 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-14T14:39:53.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.094+0000 7fae8dcdb640 1 --2- 172.21.15.62:0/2225732169 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae8806e750 0x7fae880d0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:53.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.094+0000 7fae8e4dc640 1 -- 172.21.15.62:0/2225732169 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fae8809b5f0 msgr2=0x7fae8815be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:53.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.094+0000 7fae8e4dc640 1 --2- 172.21.15.62:0/2225732169 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fae8809b5f0 0x7fae8815be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:53.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.094+0000 7fae8e4dc640 1 -- 172.21.15.62:0/2225732169 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae8806e750 msgr2=0x7fae880d0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:53.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.094+0000 7fae8e4dc640 1 --2- 172.21.15.62:0/2225732169 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae8806e750 0x7fae880d0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:53.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.094+0000 7fae8e4dc640 1 -- 172.21.15.62:0/2225732169 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae8815c6e0 con 0x7fae8815dfc0 2024-05-14T14:39:53.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.094+0000 7fae8dcdb640 1 --2- 172.21.15.62:0/2225732169 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae8806e750 0x7fae880d0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T14:39:53.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.094+0000 7fae8e4dc640 1 --2- 172.21.15.62:0/2225732169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae8815dfc0 0x7fae8813d000 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fae880b5a00 tx=0x7fae8000cb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:39:53.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.094+0000 7fae7a7fc640 1 -- 172.21.15.62:0/2225732169 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae80003b70 con 0x7fae8815dfc0 2024-05-14T14:39:53.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.094+0000 7fae7a7fc640 1 -- 172.21.15.62:0/2225732169 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae80003d10 con 0x7fae8815dfc0 2024-05-14T14:39:53.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.094+0000 7fae8ff3f640 1 -- 172.21.15.62:0/2225732169 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae880cbd50 con 0x7fae8815dfc0 2024-05-14T14:39:53.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.094+0000 7fae7a7fc640 1 -- 172.21.15.62:0/2225732169 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae800052f0 con 0x7fae8815dfc0 2024-05-14T14:39:53.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.094+0000 7fae8ff3f640 1 -- 172.21.15.62:0/2225732169 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae880cd590 con 0x7fae8815dfc0 2024-05-14T14:39:53.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.095+0000 7fae7a7fc640 1 -- 172.21.15.62:0/2225732169 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fae80005490 con 0x7fae8815dfc0 2024-05-14T14:39:53.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.095+0000 7fae7a7fc640 1 -- 172.21.15.62:0/2225732169 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fae800124b0 con 0x7fae8815dfc0 2024-05-14T14:39:53.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.095+0000 7fae8ff3f640 1 -- 172.21.15.62:0/2225732169 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae88076aa0 con 0x7fae8815dfc0 2024-05-14T14:39:53.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.098+0000 7fae7a7fc640 1 -- 172.21.15.62:0/2225732169 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fae8000a5e0 con 0x7fae8815dfc0 2024-05-14T14:39:53.175 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-14T14:39:53.191+0000 7fe29a510040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-14T14:39:53.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.192+0000 7fae8ff3f640 1 -- 172.21.15.62:0/2225732169 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd new", "uuid": "93f91b0e-096e-4bdf-aed0-d1136f73f136", "id": 1} v 0) -- 0x7fae880d2c00 con 0x7fae8815dfc0 2024-05-14T14:39:53.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.195+0000 7fae7a7fc640 1 -- 172.21.15.62:0/2225732169 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "93f91b0e-096e-4bdf-aed0-d1136f73f136", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fae8000a7c0 con 0x7fae8815dfc0 2024-05-14T14:39:53.180 INFO:teuthology.orchestra.run.smithi062.stdout:1 2024-05-14T14:39:53.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.196+0000 7fae8ff3f640 1 -- 172.21.15.62:0/2225732169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae8815dfc0 msgr2=0x7fae8813d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:53.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.196+0000 7fae8ff3f640 1 --2- 172.21.15.62:0/2225732169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae8815dfc0 0x7fae8813d000 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fae880b5a00 tx=0x7fae8000cb90 comp rx=0 tx=0).stop 2024-05-14T14:39:53.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.196+0000 7fae8ff3f640 1 -- 172.21.15.62:0/2225732169 shutdown_connections 2024-05-14T14:39:53.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.196+0000 7fae8ff3f640 1 --2- 172.21.15.62:0/2225732169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fae8815dfc0 0x7fae8813d000 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:53.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.196+0000 7fae8ff3f640 1 --2- 172.21.15.62:0/2225732169 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fae8809b5f0 0x7fae8815be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:53.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.196+0000 7fae8ff3f640 1 --2- 172.21.15.62:0/2225732169 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fae8806e750 0x7fae880d0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:53.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.196+0000 7fae8ff3f640 1 -- 172.21.15.62:0/2225732169 >> 172.21.15.62:0/2225732169 conn(0x7fae88074720 msgr2=0x7fae8815f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:39:53.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.196+0000 7fae8ff3f640 1 -- 172.21.15.62:0/2225732169 shutdown_connections 2024-05-14T14:39:53.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.196+0000 7fae8ff3f640 1 -- 172.21.15.62:0/2225732169 wait complete. 2024-05-14T14:39:53.192 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new c590b1e0-67eb-452e-8e80-d2208da17d09 2 2024-05-14T14:39:53.225 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-14T14:39:53.241+0000 7fe29a510040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-14T14:39:53.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.321+0000 7f76ac7ea640 1 Processor -- start 2024-05-14T14:39:53.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.321+0000 7f76ac7ea640 1 -- start start 2024-05-14T14:39:53.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.322+0000 7f76ac7ea640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f76a406e040 0x7f76a406e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:53.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.322+0000 7f76ac7ea640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76a40d3380 con 0x7f76a40ce040 2024-05-14T14:39:53.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.322+0000 7f76ac7ea640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76a406e990 con 0x7f76a40d2f70 2024-05-14T14:39:53.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.322+0000 7f76ac7ea640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f76a406f380 con 0x7f76a406e040 2024-05-14T14:39:53.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.323+0000 7f76aa586640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f76a40d2f70 0x7f76a40b2380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:48504/0 (socket says 172.21.15.62:48504) 2024-05-14T14:39:53.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.323+0000 7f76aa586640 1 -- 172.21.15.62:0/3796995065 learned_addr learned my addr 172.21.15.62:0/3796995065 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-05-14T14:39:53.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.323+0000 7f76a9d85640 1 --2- 172.21.15.62:0/3796995065 >> v2:172.21.15.39:3300/0 conn(0x7f76a406e040 0x7f76a406e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:53.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.323+0000 7f76a9584640 1 -- 172.21.15.62:0/3796995065 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3297605982 0 0) 0x7f76a0001110 con 0x7f76a40d2f70 2024-05-14T14:39:53.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.323+0000 7f76a9584640 1 -- 172.21.15.62:0/3796995065 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7690003520 con 0x7f76a40d2f70 2024-05-14T14:39:53.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.323+0000 7f76a9d85640 1 -- 172.21.15.62:0/3796995065 >> v1:172.21.15.62:6789/0 conn(0x7f76a40d2f70 legacy=0x7f76a40b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:53.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.323+0000 7f76a9d85640 1 -- 172.21.15.62:0/3796995065 >> v1:172.21.15.39:6789/0 conn(0x7f76a40ce040 legacy=0x7f76a40ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:53.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.323+0000 7f76a9d85640 1 -- 172.21.15.62:0/3796995065 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76a40b5200 con 0x7f76a406e040 2024-05-14T14:39:53.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.324+0000 7f76a9d85640 1 --2- 172.21.15.62:0/3796995065 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f76a406e040 0x7f76a406e450 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f76940097a0 tx=0x7f769402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f90b2072af3530 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:39:53.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.324+0000 7f76a9584640 1 -- 172.21.15.62:0/3796995065 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7694037070 con 0x7f76a406e040 2024-05-14T14:39:53.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.324+0000 7f76a9584640 1 -- 172.21.15.62:0/3796995065 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f769402adc0 con 0x7f76a406e040 2024-05-14T14:39:53.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.324+0000 7f76a9584640 1 -- 172.21.15.62:0/3796995065 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7694032660 con 0x7f76a406e040 2024-05-14T14:39:53.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.325+0000 7f76ac7ea640 1 -- 172.21.15.62:0/3796995065 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f76a406e040 msgr2=0x7f76a406e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:53.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.325+0000 7f76ac7ea640 1 --2- 172.21.15.62:0/3796995065 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f76a406e040 0x7f76a406e450 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f76940097a0 tx=0x7f769402a130 comp rx=0 tx=0).stop 2024-05-14T14:39:53.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.325+0000 7f76ac7ea640 1 -- 172.21.15.62:0/3796995065 shutdown_connections 2024-05-14T14:39:53.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.325+0000 7f76ac7ea640 1 --2- 172.21.15.62:0/3796995065 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f76a406e040 0x7f76a406e450 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:53.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.325+0000 7f76ac7ea640 1 -- 172.21.15.62:0/3796995065 >> 172.21.15.62:0/3796995065 conn(0x7f76a40b7730 msgr2=0x7f76a40b7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:39:53.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.325+0000 7f76ac7ea640 1 -- 172.21.15.62:0/3796995065 shutdown_connections 2024-05-14T14:39:53.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.325+0000 7f76ac7ea640 1 -- 172.21.15.62:0/3796995065 wait complete. 2024-05-14T14:39:53.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.327+0000 7f76ac7ea640 1 Processor -- start 2024-05-14T14:39:53.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.327+0000 7f76ac7ea640 1 -- start start 2024-05-14T14:39:53.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.328+0000 7f76ac7ea640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f76a406e040 0x7f76a4156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:53.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.328+0000 7f76ac7ea640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76a40ce040 0x7f76a415bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:53.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.328+0000 7f76ac7ea640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76a40d2f70 0x7f76a415c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:53.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.328+0000 7f76ac7ea640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f76a40d0060 con 0x7f76a406e040 2024-05-14T14:39:53.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.328+0000 7f76ac7ea640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f76a406f900 con 0x7f76a40d2f70 2024-05-14T14:39:53.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.328+0000 7f76ac7ea640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f76a40d01e0 con 0x7f76a40ce040 2024-05-14T14:39:53.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.328+0000 7f76aad87640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76a40d2f70 0x7f76a415c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:53.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.328+0000 7f76a9d85640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76a40ce040 0x7f76a415bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:53.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.328+0000 7f76aad87640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76a40d2f70 0x7f76a415c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46552/0 (socket says 172.21.15.62:46552) 2024-05-14T14:39:53.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.328+0000 7f76aad87640 1 -- 172.21.15.62:0/2519081806 learned_addr learned my addr 172.21.15.62:0/2519081806 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-14T14:39:53.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.328+0000 7f76aa586640 1 --2- 172.21.15.62:0/2519081806 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f76a406e040 0x7f76a4156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:53.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.329+0000 7f76aad87640 1 -- 172.21.15.62:0/2519081806 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76a40ce040 msgr2=0x7f76a415bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:53.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.329+0000 7f76aad87640 1 --2- 172.21.15.62:0/2519081806 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76a40ce040 0x7f76a415bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:53.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.329+0000 7f76aad87640 1 -- 172.21.15.62:0/2519081806 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f76a406e040 msgr2=0x7f76a4156a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:53.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.329+0000 7f76aad87640 1 --2- 172.21.15.62:0/2519081806 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f76a406e040 0x7f76a4156a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:53.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.329+0000 7f76aad87640 1 -- 172.21.15.62:0/2519081806 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76a4156f80 con 0x7f76a40d2f70 2024-05-14T14:39:53.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.329+0000 7f76aa586640 1 --2- 172.21.15.62:0/2519081806 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f76a406e040 0x7f76a4156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:39:53.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.329+0000 7f76aad87640 1 --2- 172.21.15.62:0/2519081806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76a40d2f70 0x7f76a415c140 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f769c00c840 tx=0x7f769c00cd00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:39:53.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.329+0000 7f769affd640 1 -- 172.21.15.62:0/2519081806 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f769c017070 con 0x7f76a40d2f70 2024-05-14T14:39:53.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.329+0000 7f769affd640 1 -- 172.21.15.62:0/2519081806 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f769c003da0 con 0x7f76a40d2f70 2024-05-14T14:39:53.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.329+0000 7f76ac7ea640 1 -- 172.21.15.62:0/2519081806 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76a4147d50 con 0x7f76a40d2f70 2024-05-14T14:39:53.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.329+0000 7f769affd640 1 -- 172.21.15.62:0/2519081806 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f769c005290 con 0x7f76a40d2f70 2024-05-14T14:39:53.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.329+0000 7f76ac7ea640 1 -- 172.21.15.62:0/2519081806 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76a4148310 con 0x7f76a40d2f70 2024-05-14T14:39:53.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.329+0000 7f769affd640 1 -- 172.21.15.62:0/2519081806 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f769c01a070 con 0x7f76a40d2f70 2024-05-14T14:39:53.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.329+0000 7f769affd640 1 -- 172.21.15.62:0/2519081806 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f769c00ad70 con 0x7f76a40d2f70 2024-05-14T14:39:53.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.330+0000 7f76ac7ea640 1 -- 172.21.15.62:0/2519081806 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76a4147ac0 con 0x7f76a40d2f70 2024-05-14T14:39:53.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.333+0000 7f769affd640 1 -- 172.21.15.62:0/2519081806 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f769c021070 con 0x7f76a40d2f70 2024-05-14T14:39:53.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.406+0000 7f76ac7ea640 1 -- 172.21.15.62:0/2519081806 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c590b1e0-67eb-452e-8e80-d2208da17d09", "id": 2} v 0) -- 0x7f76a4076aa0 con 0x7f76a40d2f70 2024-05-14T14:39:53.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.409+0000 7f769affd640 1 -- 172.21.15.62:0/2519081806 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c590b1e0-67eb-452e-8e80-d2208da17d09", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f769c005720 con 0x7f76a40d2f70 2024-05-14T14:39:53.394 INFO:teuthology.orchestra.run.smithi062.stdout:2 2024-05-14T14:39:53.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.410+0000 7f76ac7ea640 1 -- 172.21.15.62:0/2519081806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76a40d2f70 msgr2=0x7f76a415c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:53.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.410+0000 7f76ac7ea640 1 --2- 172.21.15.62:0/2519081806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76a40d2f70 0x7f76a415c140 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f769c00c840 tx=0x7f769c00cd00 comp rx=0 tx=0).stop 2024-05-14T14:39:53.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.410+0000 7f76ac7ea640 1 -- 172.21.15.62:0/2519081806 shutdown_connections 2024-05-14T14:39:53.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.410+0000 7f76ac7ea640 1 --2- 172.21.15.62:0/2519081806 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76a40d2f70 0x7f76a415c140 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:53.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.410+0000 7f76ac7ea640 1 --2- 172.21.15.62:0/2519081806 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76a40ce040 0x7f76a415bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:53.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.410+0000 7f76ac7ea640 1 --2- 172.21.15.62:0/2519081806 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f76a406e040 0x7f76a4156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:53.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.410+0000 7f76ac7ea640 1 -- 172.21.15.62:0/2519081806 >> 172.21.15.62:0/2519081806 conn(0x7f76a40b7730 msgr2=0x7f76a40d05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:39:53.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.410+0000 7f76ac7ea640 1 -- 172.21.15.62:0/2519081806 shutdown_connections 2024-05-14T14:39:53.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.410+0000 7f76ac7ea640 1 -- 172.21.15.62:0/2519081806 wait complete. 2024-05-14T14:39:53.406 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new d57661b0-44f6-4355-9115-83eceb9b8f71 3 2024-05-14T14:39:53.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.575+0000 7f1256f72640 1 Processor -- start 2024-05-14T14:39:53.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.575+0000 7f1256f72640 1 -- start start 2024-05-14T14:39:53.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.577+0000 7f1256f72640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f12500d2f70 0x7f12500b2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:53.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.577+0000 7f1256f72640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f12500ce040 0x7f12500ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:53.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.577+0000 7f1256f72640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12500d3380 con 0x7f125006e040 2024-05-14T14:39:53.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.577+0000 7f1256f72640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f125006f380 con 0x7f12500ce040 2024-05-14T14:39:53.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.577+0000 7f1256f72640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f12500b28c0 con 0x7f12500d2f70 2024-05-14T14:39:53.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.577+0000 7f1254d0e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f12500d2f70 0x7f12500b2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:53.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.577+0000 7f124ffff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f125006e040 0x7f125006e450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:48516/0 (socket says 172.21.15.62:48516) 2024-05-14T14:39:53.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.577+0000 7f124ffff640 1 -- 172.21.15.62:0/3959885840 learned_addr learned my addr 172.21.15.62:0/3959885840 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-05-14T14:39:53.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.577+0000 7f125550f640 1 --2- 172.21.15.62:0/3959885840 >> v2:172.21.15.39:3300/0 conn(0x7f12500ce040 0x7f12500ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:53.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.577+0000 7f124f7fe640 1 -- 172.21.15.62:0/3959885840 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1284062599 0 0) 0x7f12500d3380 con 0x7f125006e040 2024-05-14T14:39:53.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.577+0000 7f124f7fe640 1 -- 172.21.15.62:0/3959885840 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f123c003520 con 0x7f125006e040 2024-05-14T14:39:53.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.577+0000 7f1254d0e640 1 -- 172.21.15.62:0/3959885840 >> v2:172.21.15.39:3300/0 conn(0x7f12500ce040 msgr2=0x7f12500ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:39:53.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.577+0000 7f1254d0e640 1 --2- 172.21.15.62:0/3959885840 >> v2:172.21.15.39:3300/0 conn(0x7f12500ce040 0x7f12500ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:53.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.577+0000 7f1254d0e640 1 -- 172.21.15.62:0/3959885840 >> v1:172.21.15.62:6789/0 conn(0x7f125006e040 legacy=0x7f125006e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:53.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.577+0000 7f1254d0e640 1 -- 172.21.15.62:0/3959885840 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12500b5200 con 0x7f12500d2f70 2024-05-14T14:39:53.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.578+0000 7f1254d0e640 1 --2- 172.21.15.62:0/3959885840 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f12500d2f70 0x7f12500b2380 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f12380097a0 tx=0x7f123802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f51aece62105fa09 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:39:53.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.578+0000 7f124f7fe640 1 -- 172.21.15.62:0/3959885840 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1238037070 con 0x7f12500d2f70 2024-05-14T14:39:53.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.578+0000 7f124f7fe640 1 -- 172.21.15.62:0/3959885840 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1238032440 con 0x7f12500d2f70 2024-05-14T14:39:53.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.578+0000 7f124f7fe640 1 -- 172.21.15.62:0/3959885840 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1238032810 con 0x7f12500d2f70 2024-05-14T14:39:53.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.579+0000 7f1256f72640 1 -- 172.21.15.62:0/3959885840 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f12500d2f70 msgr2=0x7f12500b2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:53.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.579+0000 7f1256f72640 1 --2- 172.21.15.62:0/3959885840 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f12500d2f70 0x7f12500b2380 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f12380097a0 tx=0x7f123802a180 comp rx=0 tx=0).stop 2024-05-14T14:39:53.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.579+0000 7f1256f72640 1 -- 172.21.15.62:0/3959885840 shutdown_connections 2024-05-14T14:39:53.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.579+0000 7f1256f72640 1 --2- 172.21.15.62:0/3959885840 >> v2:172.21.15.39:3300/0 conn(0x7f12500ce040 0x7f12500ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:53.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.579+0000 7f1256f72640 1 --2- 172.21.15.62:0/3959885840 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f12500d2f70 0x7f12500b2380 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:53.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.579+0000 7f1256f72640 1 -- 172.21.15.62:0/3959885840 >> 172.21.15.62:0/3959885840 conn(0x7f12500b7730 msgr2=0x7f12500b7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:39:53.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.579+0000 7f1256f72640 1 -- 172.21.15.62:0/3959885840 shutdown_connections 2024-05-14T14:39:53.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.579+0000 7f1256f72640 1 -- 172.21.15.62:0/3959885840 wait complete. 2024-05-14T14:39:53.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.581+0000 7f1256f72640 1 Processor -- start 2024-05-14T14:39:53.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.581+0000 7f1256f72640 1 -- start start 2024-05-14T14:39:53.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.582+0000 7f1256f72640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f125006e040 0x7f1250159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:53.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.582+0000 7f1256f72640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f12500ce040 0x7f125009ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:53.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.582+0000 7f1256f72640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f12500d2f70 0x7f125014a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:53.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.582+0000 7f1256f72640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f12500d0060 con 0x7f125006e040 2024-05-14T14:39:53.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.582+0000 7f1256f72640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f125006f900 con 0x7f12500d2f70 2024-05-14T14:39:53.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.582+0000 7f1256f72640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f12500d01e0 con 0x7f12500ce040 2024-05-14T14:39:53.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.582+0000 7f124ffff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f12500ce040 0x7f125009ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:53.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.582+0000 7f125550f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f12500d2f70 0x7f125014a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:53.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.582+0000 7f124ffff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f12500ce040 0x7f125009ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:34874/0 (socket says 172.21.15.62:34874) 2024-05-14T14:39:53.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.582+0000 7f124ffff640 1 -- 172.21.15.62:0/3076692467 learned_addr learned my addr 172.21.15.62:0/3076692467 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-14T14:39:53.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.582+0000 7f1254d0e640 1 --2- 172.21.15.62:0/3076692467 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f125006e040 0x7f1250159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:53.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.583+0000 7f125550f640 1 -- 172.21.15.62:0/3076692467 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f12500ce040 msgr2=0x7f125009ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:53.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.583+0000 7f125550f640 1 --2- 172.21.15.62:0/3076692467 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f12500ce040 0x7f125009ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:53.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.583+0000 7f125550f640 1 -- 172.21.15.62:0/3076692467 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f125006e040 msgr2=0x7f1250159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:53.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.583+0000 7f125550f640 1 --2- 172.21.15.62:0/3076692467 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f125006e040 0x7f1250159860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:53.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.583+0000 7f125550f640 1 -- 172.21.15.62:0/3076692467 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12500a04a0 con 0x7f12500d2f70 2024-05-14T14:39:53.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.583+0000 7f124ffff640 1 --2- 172.21.15.62:0/3076692467 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f12500ce040 0x7f125009ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T14:39:53.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.583+0000 7f1254d0e640 1 --2- 172.21.15.62:0/3076692467 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f125006e040 0x7f1250159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T14:39:53.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.583+0000 7f125550f640 1 --2- 172.21.15.62:0/3076692467 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f12500d2f70 0x7f125014a880 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1248009e40 tx=0x7f124800eb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:39:53.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.583+0000 7f124d7fa640 1 -- 172.21.15.62:0/3076692467 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f124801e070 con 0x7f12500d2f70 2024-05-14T14:39:53.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.583+0000 7f124d7fa640 1 -- 172.21.15.62:0/3076692467 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f124800c730 con 0x7f12500d2f70 2024-05-14T14:39:53.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.583+0000 7f124d7fa640 1 -- 172.21.15.62:0/3076692467 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f124800cb20 con 0x7f12500d2f70 2024-05-14T14:39:53.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.583+0000 7f1256f72640 1 -- 172.21.15.62:0/3076692467 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12501587c0 con 0x7f12500d2f70 2024-05-14T14:39:53.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.583+0000 7f1256f72640 1 -- 172.21.15.62:0/3076692467 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1250158d80 con 0x7f12500d2f70 2024-05-14T14:39:53.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.583+0000 7f124d7fa640 1 -- 172.21.15.62:0/3076692467 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1248021070 con 0x7f12500d2f70 2024-05-14T14:39:53.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.584+0000 7f124d7fa640 1 -- 172.21.15.62:0/3076692467 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f1248011450 con 0x7f12500d2f70 2024-05-14T14:39:53.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.585+0000 7f1256f72640 1 -- 172.21.15.62:0/3076692467 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1250076aa0 con 0x7f12500d2f70 2024-05-14T14:39:53.572 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-05-14T14:39:53.588+0000 7f21f3730040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-14T14:39:53.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.588+0000 7f124d7fa640 1 -- 172.21.15.62:0/3076692467 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f124800cd60 con 0x7f12500d2f70 2024-05-14T14:39:53.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.663+0000 7f1256f72640 1 -- 172.21.15.62:0/3076692467 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d57661b0-44f6-4355-9115-83eceb9b8f71", "id": 3} v 0) -- 0x7f12501584e0 con 0x7f12500d2f70 2024-05-14T14:39:53.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.671+0000 7f124d7fa640 1 -- 172.21.15.62:0/3076692467 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d57661b0-44f6-4355-9115-83eceb9b8f71", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f1248004150 con 0x7f12500d2f70 2024-05-14T14:39:53.655 INFO:teuthology.orchestra.run.smithi062.stdout:3 2024-05-14T14:39:53.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.672+0000 7f1256f72640 1 -- 172.21.15.62:0/3076692467 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f12500d2f70 msgr2=0x7f125014a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:53.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.672+0000 7f1256f72640 1 --2- 172.21.15.62:0/3076692467 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f12500d2f70 0x7f125014a880 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1248009e40 tx=0x7f124800eb90 comp rx=0 tx=0).stop 2024-05-14T14:39:53.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.672+0000 7f1256f72640 1 -- 172.21.15.62:0/3076692467 shutdown_connections 2024-05-14T14:39:53.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.672+0000 7f1256f72640 1 --2- 172.21.15.62:0/3076692467 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f12500d2f70 0x7f125014a880 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:53.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.672+0000 7f1256f72640 1 --2- 172.21.15.62:0/3076692467 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f12500ce040 0x7f125009ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:53.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.672+0000 7f1256f72640 1 --2- 172.21.15.62:0/3076692467 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f125006e040 0x7f1250159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:53.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.672+0000 7f1256f72640 1 -- 172.21.15.62:0/3076692467 >> 172.21.15.62:0/3076692467 conn(0x7f12500b7730 msgr2=0x7f125015ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:39:53.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.672+0000 7f1256f72640 1 -- 172.21.15.62:0/3076692467 shutdown_connections 2024-05-14T14:39:53.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.672+0000 7f1256f72640 1 -- 172.21.15.62:0/3076692467 wait complete. 2024-05-14T14:39:53.665 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-05-14T14:39:53.681+0000 7f21f3730040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-14T14:39:53.667 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new b131436f-f6e1-4d72-a86e-de200afdcebb 4 2024-05-14T14:39:53.710 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-05-14T14:39:53.725+0000 7f21f3730040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-14T14:39:53.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.796+0000 7f4424f5e640 1 Processor -- start 2024-05-14T14:39:53.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.796+0000 7f4424f5e640 1 -- start start 2024-05-14T14:39:53.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.797+0000 7f4424f5e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f442006e040 0x7f442006e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:53.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.797+0000 7f4424f5e640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44200d3380 con 0x7f44200d2f70 2024-05-14T14:39:53.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.797+0000 7f4424f5e640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f442006e990 con 0x7f44200ce040 2024-05-14T14:39:53.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.797+0000 7f4424f5e640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f442006f380 con 0x7f442006e040 2024-05-14T14:39:53.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.797+0000 7f441dd9b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f442006e040 0x7f442006e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:53.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.797+0000 7f441ed9d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f44200ce040 0x7f44200ce450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:48520/0 (socket says 172.21.15.62:48520) 2024-05-14T14:39:53.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.797+0000 7f441dd9b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f442006e040 0x7f442006e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46566/0 (socket says 172.21.15.62:46566) 2024-05-14T14:39:53.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.797+0000 7f441ed9d640 1 -- 172.21.15.62:0/3536464606 learned_addr learned my addr 172.21.15.62:0/3536464606 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-05-14T14:39:53.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.798+0000 7f441dd9b640 1 -- 172.21.15.62:0/3536464606 >> v1:172.21.15.62:6789/0 conn(0x7f44200ce040 legacy=0x7f44200ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:53.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.798+0000 7f441dd9b640 1 -- 172.21.15.62:0/3536464606 >> v1:172.21.15.39:6789/0 conn(0x7f44200d2f70 legacy=0x7f44200b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:53.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.798+0000 7f441dd9b640 1 -- 172.21.15.62:0/3536464606 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44200b5200 con 0x7f442006e040 2024-05-14T14:39:53.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.798+0000 7f441dd9b640 1 --2- 172.21.15.62:0/3536464606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f442006e040 0x7f442006e450 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f44140097a0 tx=0x7f441402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ceb3b5e5b613631 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:39:53.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.799+0000 7f441d59a640 1 -- 172.21.15.62:0/3536464606 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4414037070 con 0x7f442006e040 2024-05-14T14:39:53.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.799+0000 7f441d59a640 1 -- 172.21.15.62:0/3536464606 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4414032440 con 0x7f442006e040 2024-05-14T14:39:53.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.799+0000 7f441d59a640 1 -- 172.21.15.62:0/3536464606 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4414032810 con 0x7f442006e040 2024-05-14T14:39:53.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.799+0000 7f4424f5e640 1 -- 172.21.15.62:0/3536464606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f442006e040 msgr2=0x7f442006e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:53.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.799+0000 7f4424f5e640 1 --2- 172.21.15.62:0/3536464606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f442006e040 0x7f442006e450 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f44140097a0 tx=0x7f441402a230 comp rx=0 tx=0).stop 2024-05-14T14:39:53.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.800+0000 7f4424f5e640 1 -- 172.21.15.62:0/3536464606 shutdown_connections 2024-05-14T14:39:53.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.800+0000 7f4424f5e640 1 --2- 172.21.15.62:0/3536464606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f442006e040 0x7f442006e450 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:53.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.800+0000 7f4424f5e640 1 -- 172.21.15.62:0/3536464606 >> 172.21.15.62:0/3536464606 conn(0x7f44200b7730 msgr2=0x7f44200b7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:39:53.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.800+0000 7f4424f5e640 1 -- 172.21.15.62:0/3536464606 shutdown_connections 2024-05-14T14:39:53.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.800+0000 7f4424f5e640 1 -- 172.21.15.62:0/3536464606 wait complete. 2024-05-14T14:39:53.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.802+0000 7f4424f5e640 1 Processor -- start 2024-05-14T14:39:53.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.802+0000 7f4424f5e640 1 -- start start 2024-05-14T14:39:53.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.803+0000 7f4424f5e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f442006e040 0x7f44201487f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:53.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.803+0000 7f4424f5e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44200ce040 0x7f44201f7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:53.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.803+0000 7f4424f5e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44200d2f70 0x7f44201f4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:53.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.803+0000 7f4424f5e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f44200d0060 con 0x7f44200d2f70 2024-05-14T14:39:53.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.803+0000 7f4424f5e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f442006f900 con 0x7f44200ce040 2024-05-14T14:39:53.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.803+0000 7f4424f5e640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f44200d01e0 con 0x7f442006e040 2024-05-14T14:39:53.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.803+0000 7f441dd9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44200ce040 0x7f44201f7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:53.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.803+0000 7f441e59c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f442006e040 0x7f44201487f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:53.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.803+0000 7f441dd9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44200ce040 0x7f44201f7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46580/0 (socket says 172.21.15.62:46580) 2024-05-14T14:39:53.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.803+0000 7f441dd9b640 1 -- 172.21.15.62:0/3824980348 learned_addr learned my addr 172.21.15.62:0/3824980348 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-14T14:39:53.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.803+0000 7f441ed9d640 1 --2- 172.21.15.62:0/3824980348 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44200d2f70 0x7f44201f4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:53.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.804+0000 7f441dd9b640 1 -- 172.21.15.62:0/3824980348 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f442006e040 msgr2=0x7f44201487f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:53.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.804+0000 7f441dd9b640 1 --2- 172.21.15.62:0/3824980348 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f442006e040 0x7f44201487f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:53.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.804+0000 7f441dd9b640 1 -- 172.21.15.62:0/3824980348 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44200d2f70 msgr2=0x7f44201f4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:53.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.804+0000 7f441dd9b640 1 --2- 172.21.15.62:0/3824980348 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44200d2f70 0x7f44201f4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:53.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.804+0000 7f441dd9b640 1 -- 172.21.15.62:0/3824980348 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44201f83b0 con 0x7f44200ce040 2024-05-14T14:39:53.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.804+0000 7f441e59c640 1 --2- 172.21.15.62:0/3824980348 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f442006e040 0x7f44201487f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T14:39:53.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.804+0000 7f441ed9d640 1 --2- 172.21.15.62:0/3824980348 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44200d2f70 0x7f44201f4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T14:39:53.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.804+0000 7f441dd9b640 1 --2- 172.21.15.62:0/3824980348 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44200ce040 0x7f44201f7e70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4414035040 tx=0x7f44140046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:39:53.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.804+0000 7f440effd640 1 -- 172.21.15.62:0/3824980348 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4414037040 con 0x7f44200ce040 2024-05-14T14:39:53.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.804+0000 7f440effd640 1 -- 172.21.15.62:0/3824980348 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4414030770 con 0x7f44200ce040 2024-05-14T14:39:53.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.804+0000 7f4424f5e640 1 -- 172.21.15.62:0/3824980348 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44201f88c0 con 0x7f44200ce040 2024-05-14T14:39:53.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.804+0000 7f440effd640 1 -- 172.21.15.62:0/3824980348 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4414030b80 con 0x7f44200ce040 2024-05-14T14:39:53.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.804+0000 7f4424f5e640 1 -- 172.21.15.62:0/3824980348 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4420147ff0 con 0x7f44200ce040 2024-05-14T14:39:53.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.804+0000 7f440effd640 1 -- 172.21.15.62:0/3824980348 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4414044020 con 0x7f44200ce040 2024-05-14T14:39:53.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.804+0000 7f440effd640 1 -- 172.21.15.62:0/3824980348 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f4414046920 con 0x7f44200ce040 2024-05-14T14:39:53.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.805+0000 7f4424f5e640 1 -- 172.21.15.62:0/3824980348 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4420076aa0 con 0x7f44200ce040 2024-05-14T14:39:53.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.809+0000 7f440effd640 1 -- 172.21.15.62:0/3824980348 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f4414032e20 con 0x7f44200ce040 2024-05-14T14:39:53.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.897+0000 7f4424f5e640 1 -- 172.21.15.62:0/3824980348 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b131436f-f6e1-4d72-a86e-de200afdcebb", "id": 4} v 0) -- 0x7f44200cf4f0 con 0x7f44200ce040 2024-05-14T14:39:53.884 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-05-14T14:39:53.900+0000 7f21f3730040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-14T14:39:53.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.905+0000 7f440effd640 1 -- 172.21.15.62:0/3824980348 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b131436f-f6e1-4d72-a86e-de200afdcebb", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f4414046410 con 0x7f44200ce040 2024-05-14T14:39:53.889 INFO:teuthology.orchestra.run.smithi062.stdout:4 2024-05-14T14:39:53.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.906+0000 7f4424f5e640 1 -- 172.21.15.62:0/3824980348 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44200ce040 msgr2=0x7f44201f7e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:53.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.906+0000 7f4424f5e640 1 --2- 172.21.15.62:0/3824980348 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44200ce040 0x7f44201f7e70 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4414035040 tx=0x7f44140046c0 comp rx=0 tx=0).stop 2024-05-14T14:39:53.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.906+0000 7f4424f5e640 1 -- 172.21.15.62:0/3824980348 shutdown_connections 2024-05-14T14:39:53.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.906+0000 7f4424f5e640 1 --2- 172.21.15.62:0/3824980348 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f44200d2f70 0x7f44201f4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:53.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.906+0000 7f4424f5e640 1 --2- 172.21.15.62:0/3824980348 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f44200ce040 0x7f44201f7e70 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:53.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.906+0000 7f4424f5e640 1 --2- 172.21.15.62:0/3824980348 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f442006e040 0x7f44201487f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:53.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.906+0000 7f4424f5e640 1 -- 172.21.15.62:0/3824980348 >> 172.21.15.62:0/3824980348 conn(0x7f44200b7730 msgr2=0x7f44200d14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:39:53.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.906+0000 7f4424f5e640 1 -- 172.21.15.62:0/3824980348 shutdown_connections 2024-05-14T14:39:53.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:53.906+0000 7f4424f5e640 1 -- 172.21.15.62:0/3824980348 wait complete. 2024-05-14T14:39:53.902 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new 12e10b40-28b1-410f-9ce0-7b427daa111e 5 2024-05-14T14:39:53.938 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-05-14T14:39:53.954+0000 7f21f3730040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-14T14:39:53.993 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-05-14T14:39:54.009+0000 7f21f3730040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-14T14:39:54.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.031+0000 7ff44e431640 1 Processor -- start 2024-05-14T14:39:54.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.031+0000 7ff44e431640 1 -- start start 2024-05-14T14:39:54.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.032+0000 7ff44e431640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff4480b5c00 0x7ff44816b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:54.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.032+0000 7ff44e431640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff448163e70 con 0x7ff44806fad0 2024-05-14T14:39:54.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.032+0000 7ff44e431640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff44806f6b0 con 0x7ff44806f2a0 2024-05-14T14:39:54.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.032+0000 7ff44e431640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7ff4480d2650 con 0x7ff4480b5c00 2024-05-14T14:39:54.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.032+0000 7ff4477fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff44806f2a0 0x7ff4480b54f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:48532/0 (socket says 172.21.15.62:48532) 2024-05-14T14:39:54.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.032+0000 7ff4477fe640 1 -- 172.21.15.62:0/3772786514 learned_addr learned my addr 172.21.15.62:0/3772786514 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-05-14T14:39:54.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.032+0000 7ff44c9ce640 1 --2- 172.21.15.62:0/3772786514 >> v2:172.21.15.39:3300/0 conn(0x7ff4480b5c00 0x7ff44816b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:54.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.032+0000 7ff446ffd640 1 -- 172.21.15.62:0/3772786514 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3758178095 0 0) 0x7ff44806f6b0 con 0x7ff44806f2a0 2024-05-14T14:39:54.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.032+0000 7ff446ffd640 1 -- 172.21.15.62:0/3772786514 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff430003520 con 0x7ff44806f2a0 2024-05-14T14:39:54.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.033+0000 7ff446ffd640 1 -- 172.21.15.62:0/3772786514 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2848190725 0 0) 0x7ff448163e70 con 0x7ff44806fad0 2024-05-14T14:39:54.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.033+0000 7ff446ffd640 1 -- 172.21.15.62:0/3772786514 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff44806f6b0 con 0x7ff44806fad0 2024-05-14T14:39:54.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.033+0000 7ff44c9ce640 1 -- 172.21.15.62:0/3772786514 >> v1:172.21.15.62:6789/0 conn(0x7ff44806f2a0 legacy=0x7ff4480b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:54.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.033+0000 7ff44c9ce640 1 -- 172.21.15.62:0/3772786514 >> v1:172.21.15.39:6789/0 conn(0x7ff44806fad0 legacy=0x7ff4481600d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:54.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.033+0000 7ff44c9ce640 1 -- 172.21.15.62:0/3772786514 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff448164110 con 0x7ff4480b5c00 2024-05-14T14:39:54.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.033+0000 7ff44c9ce640 1 --2- 172.21.15.62:0/3772786514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4480b5c00 0x7ff44816b160 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff440009d90 tx=0x7ff44002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8593b17930d44e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:39:54.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.034+0000 7ff446ffd640 1 -- 172.21.15.62:0/3772786514 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff440007740 con 0x7ff4480b5c00 2024-05-14T14:39:54.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.034+0000 7ff446ffd640 1 -- 172.21.15.62:0/3772786514 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4400078e0 con 0x7ff4480b5c00 2024-05-14T14:39:54.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.034+0000 7ff446ffd640 1 -- 172.21.15.62:0/3772786514 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff440007cb0 con 0x7ff4480b5c00 2024-05-14T14:39:54.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.034+0000 7ff44e431640 1 -- 172.21.15.62:0/3772786514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4480b5c00 msgr2=0x7ff44816b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:54.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.034+0000 7ff44e431640 1 --2- 172.21.15.62:0/3772786514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4480b5c00 0x7ff44816b160 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff440009d90 tx=0x7ff44002a6f0 comp rx=0 tx=0).stop 2024-05-14T14:39:54.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.034+0000 7ff44e431640 1 -- 172.21.15.62:0/3772786514 shutdown_connections 2024-05-14T14:39:54.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.034+0000 7ff44e431640 1 --2- 172.21.15.62:0/3772786514 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4480b5c00 0x7ff44816b160 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:54.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.034+0000 7ff44e431640 1 -- 172.21.15.62:0/3772786514 >> 172.21.15.62:0/3772786514 conn(0x7ff4480d04f0 msgr2=0x7ff4480d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:39:54.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.035+0000 7ff44e431640 1 -- 172.21.15.62:0/3772786514 shutdown_connections 2024-05-14T14:39:54.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.035+0000 7ff44e431640 1 -- 172.21.15.62:0/3772786514 wait complete. 2024-05-14T14:39:54.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.036+0000 7ff44e431640 1 Processor -- start 2024-05-14T14:39:54.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.037+0000 7ff44e431640 1 -- start start 2024-05-14T14:39:54.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.038+0000 7ff44e431640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff44806f2a0 0x7ff448155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:54.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.038+0000 7ff44e431640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff44806fad0 0x7ff4480d3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:54.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.038+0000 7ff44e431640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4480c7ac0 0x7ff4480d3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:54.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.038+0000 7ff44e431640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff44806ffd0 con 0x7ff4480c7ac0 2024-05-14T14:39:54.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.038+0000 7ff44e431640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff4481646d0 con 0x7ff44806f2a0 2024-05-14T14:39:54.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.038+0000 7ff44e431640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7ff4480c7130 con 0x7ff44806fad0 2024-05-14T14:39:54.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.038+0000 7ff447fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff44806f2a0 0x7ff448155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:54.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.038+0000 7ff4477fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff44806fad0 0x7ff4480d3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:54.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.038+0000 7ff4477fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff44806fad0 0x7ff4480d3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:34902/0 (socket says 172.21.15.62:34902) 2024-05-14T14:39:54.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.038+0000 7ff447fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff44806f2a0 0x7ff448155e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46588/0 (socket says 172.21.15.62:46588) 2024-05-14T14:39:54.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.038+0000 7ff4477fe640 1 -- 172.21.15.62:0/322050407 learned_addr learned my addr 172.21.15.62:0/322050407 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-14T14:39:54.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.038+0000 7ff44c9ce640 1 --2- 172.21.15.62:0/322050407 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4480c7ac0 0x7ff4480d3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:54.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.038+0000 7ff447fff640 1 -- 172.21.15.62:0/322050407 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff44806fad0 msgr2=0x7ff4480d3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:54.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.038+0000 7ff447fff640 1 --2- 172.21.15.62:0/322050407 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff44806fad0 0x7ff4480d3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:54.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.038+0000 7ff447fff640 1 -- 172.21.15.62:0/322050407 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4480c7ac0 msgr2=0x7ff4480d3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:54.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.038+0000 7ff447fff640 1 --2- 172.21.15.62:0/322050407 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4480c7ac0 0x7ff4480d3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:54.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.038+0000 7ff447fff640 1 -- 172.21.15.62:0/322050407 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4480cc570 con 0x7ff44806f2a0 2024-05-14T14:39:54.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.038+0000 7ff44c9ce640 1 --2- 172.21.15.62:0/322050407 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4480c7ac0 0x7ff4480d3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T14:39:54.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.039+0000 7ff447fff640 1 --2- 172.21.15.62:0/322050407 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff44806f2a0 0x7ff448155e10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff43800c390 tx=0x7ff438001ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:39:54.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.039+0000 7ff444ff9640 1 -- 172.21.15.62:0/322050407 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff438017070 con 0x7ff44806f2a0 2024-05-14T14:39:54.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.039+0000 7ff444ff9640 1 -- 172.21.15.62:0/322050407 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4380052f0 con 0x7ff44806f2a0 2024-05-14T14:39:54.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.039+0000 7ff44e431640 1 -- 172.21.15.62:0/322050407 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4480cc850 con 0x7ff44806f2a0 2024-05-14T14:39:54.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.039+0000 7ff444ff9640 1 -- 172.21.15.62:0/322050407 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff438003640 con 0x7ff44806f2a0 2024-05-14T14:39:54.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.039+0000 7ff44e431640 1 -- 172.21.15.62:0/322050407 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4480cce10 con 0x7ff44806f2a0 2024-05-14T14:39:54.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.039+0000 7ff444ff9640 1 -- 172.21.15.62:0/322050407 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff43801a070 con 0x7ff44806f2a0 2024-05-14T14:39:54.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.039+0000 7ff444ff9640 1 -- 172.21.15.62:0/322050407 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7ff438011ae0 con 0x7ff44806f2a0 2024-05-14T14:39:54.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.040+0000 7ff44e431640 1 -- 172.21.15.62:0/322050407 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff448076aa0 con 0x7ff44806f2a0 2024-05-14T14:39:54.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.044+0000 7ff444ff9640 1 -- 172.21.15.62:0/322050407 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7ff438021020 con 0x7ff44806f2a0 2024-05-14T14:39:54.048 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-14T14:39:54.064+0000 7fe29a510040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-14T14:39:54.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.118+0000 7ff44e431640 1 -- 172.21.15.62:0/322050407 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd new", "uuid": "12e10b40-28b1-410f-9ce0-7b427daa111e", "id": 5} v 0) -- 0x7ff4480d35c0 con 0x7ff44806f2a0 2024-05-14T14:39:54.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.122+0000 7ff444ff9640 1 -- 172.21.15.62:0/322050407 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "12e10b40-28b1-410f-9ce0-7b427daa111e", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7ff438011d30 con 0x7ff44806f2a0 2024-05-14T14:39:54.107 INFO:teuthology.orchestra.run.smithi062.stdout:5 2024-05-14T14:39:54.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.123+0000 7ff44e431640 1 -- 172.21.15.62:0/322050407 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff44806f2a0 msgr2=0x7ff448155e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:54.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.123+0000 7ff44e431640 1 --2- 172.21.15.62:0/322050407 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff44806f2a0 0x7ff448155e10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff43800c390 tx=0x7ff438001ec0 comp rx=0 tx=0).stop 2024-05-14T14:39:54.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.123+0000 7ff44e431640 1 -- 172.21.15.62:0/322050407 shutdown_connections 2024-05-14T14:39:54.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.123+0000 7ff44e431640 1 --2- 172.21.15.62:0/322050407 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff4480c7ac0 0x7ff4480d3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:54.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.123+0000 7ff44e431640 1 --2- 172.21.15.62:0/322050407 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff44806fad0 0x7ff4480d3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:54.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.123+0000 7ff44e431640 1 --2- 172.21.15.62:0/322050407 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff44806f2a0 0x7ff448155e10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:54.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.123+0000 7ff44e431640 1 -- 172.21.15.62:0/322050407 >> 172.21.15.62:0/322050407 conn(0x7ff4480d04f0 msgr2=0x7ff4480d1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:39:54.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.123+0000 7ff44e431640 1 -- 172.21.15.62:0/322050407 shutdown_connections 2024-05-14T14:39:54.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.124+0000 7ff44e431640 1 -- 172.21.15.62:0/322050407 wait complete. 2024-05-14T14:39:54.111 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-05-14T14:39:54.127+0000 7f21f3730040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-14T14:39:54.119 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new ad8950a5-70bd-488c-8f29-010515cc4a04 6 2024-05-14T14:39:54.144 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-14T14:39:54.159+0000 7fe29a510040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-14T14:39:54.191 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-14T14:39:54.207+0000 7fe29a510040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-14T14:39:54.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.249+0000 7f9d328d1640 1 Processor -- start 2024-05-14T14:39:54.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.249+0000 7f9d328d1640 1 -- start start 2024-05-14T14:39:54.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.250+0000 7f9d328d1640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9d2c0d0920 0x7f9d2c0ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:54.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.250+0000 7f9d328d1640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9d2c15e420 0x7f9d2c0d2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:54.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.250+0000 7f9d328d1640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d2c15e830 con 0x7f9d2c0d1de0 2024-05-14T14:39:54.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.250+0000 7f9d328d1640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f9d2c162000 con 0x7f9d2c0d0920 2024-05-14T14:39:54.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.250+0000 7f9d328d1640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f9d2c1622e0 con 0x7f9d2c15e420 2024-05-14T14:39:54.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.250+0000 7f9d2b7fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9d2c0d0920 0x7f9d2c0ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:54.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.250+0000 7f9d30e6e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9d2c15e420 0x7f9d2c0d2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:54.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.250+0000 7f9d2b7fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9d2c0d0920 0x7f9d2c0ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46594/0 (socket says 172.21.15.62:46594) 2024-05-14T14:39:54.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.250+0000 7f9d2bfff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f9d2c0d1de0 0x7f9d2c0d0210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:48538/0 (socket says 172.21.15.62:48538) 2024-05-14T14:39:54.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.250+0000 7f9d2b7fe640 1 -- 172.21.15.62:0/3605997297 learned_addr learned my addr 172.21.15.62:0/3605997297 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-14T14:39:54.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.251+0000 7f9d30e6e640 1 -- 172.21.15.62:0/3605997297 >> v2:172.21.15.62:3300/0 conn(0x7f9d2c0d0920 msgr2=0x7f9d2c0ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:39:54.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.251+0000 7f9d30e6e640 1 --2- 172.21.15.62:0/3605997297 >> v2:172.21.15.62:3300/0 conn(0x7f9d2c0d0920 0x7f9d2c0ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:54.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.251+0000 7f9d30e6e640 1 -- 172.21.15.62:0/3605997297 >> v1:172.21.15.62:6789/0 conn(0x7f9d2c0d1de0 legacy=0x7f9d2c0d0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:54.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.251+0000 7f9d30e6e640 1 -- 172.21.15.62:0/3605997297 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d2c1625c0 con 0x7f9d2c15e420 2024-05-14T14:39:54.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.251+0000 7f9d2b7fe640 1 --2- 172.21.15.62:0/3605997297 >> v2:172.21.15.62:3300/0 conn(0x7f9d2c0d0920 0x7f9d2c0ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T14:39:54.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.251+0000 7f9d30e6e640 1 --2- 172.21.15.62:0/3605997297 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9d2c15e420 0x7f9d2c0d2520 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9d24009d90 tx=0x7f9d2402a540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=256d3daab822bc79 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:39:54.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.251+0000 7f9d2affd640 1 -- 172.21.15.62:0/3605997297 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d24007740 con 0x7f9d2c15e420 2024-05-14T14:39:54.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.252+0000 7f9d2affd640 1 -- 172.21.15.62:0/3605997297 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d240078e0 con 0x7f9d2c15e420 2024-05-14T14:39:54.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.252+0000 7f9d2affd640 1 -- 172.21.15.62:0/3605997297 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d24007cb0 con 0x7f9d2c15e420 2024-05-14T14:39:54.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.252+0000 7f9d328d1640 1 -- 172.21.15.62:0/3605997297 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9d2c15e420 msgr2=0x7f9d2c0d2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:54.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.252+0000 7f9d328d1640 1 --2- 172.21.15.62:0/3605997297 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9d2c15e420 0x7f9d2c0d2520 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9d24009d90 tx=0x7f9d2402a540 comp rx=0 tx=0).stop 2024-05-14T14:39:54.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.252+0000 7f9d328d1640 1 -- 172.21.15.62:0/3605997297 shutdown_connections 2024-05-14T14:39:54.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.252+0000 7f9d328d1640 1 --2- 172.21.15.62:0/3605997297 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9d2c15e420 0x7f9d2c0d2520 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:54.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.252+0000 7f9d328d1640 1 --2- 172.21.15.62:0/3605997297 >> v2:172.21.15.62:3300/0 conn(0x7f9d2c0d0920 0x7f9d2c0ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:54.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.252+0000 7f9d328d1640 1 -- 172.21.15.62:0/3605997297 >> 172.21.15.62:0/3605997297 conn(0x7f9d2c0b5780 msgr2=0x7f9d2c0b5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:39:54.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.252+0000 7f9d328d1640 1 -- 172.21.15.62:0/3605997297 shutdown_connections 2024-05-14T14:39:54.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.252+0000 7f9d328d1640 1 -- 172.21.15.62:0/3605997297 wait complete. 2024-05-14T14:39:54.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.254+0000 7f9d328d1640 1 Processor -- start 2024-05-14T14:39:54.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.254+0000 7f9d328d1640 1 -- start start 2024-05-14T14:39:54.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.256+0000 7f9d328d1640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9d2c0d0920 0x7f9d2c0c3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:54.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.256+0000 7f9d328d1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d2c0d1de0 0x7f9d2c0c33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:54.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.256+0000 7f9d328d1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d2c15e420 0x7f9d2c152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:54.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.256+0000 7f9d328d1640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c0d2a60 con 0x7f9d2c0d1de0 2024-05-14T14:39:54.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.256+0000 7f9d328d1640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c0cf660 con 0x7f9d2c15e420 2024-05-14T14:39:54.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.256+0000 7f9d328d1640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f9d2c0d2be0 con 0x7f9d2c0d0920 2024-05-14T14:39:54.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.256+0000 7f9d2bfff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9d2c0d0920 0x7f9d2c0c3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:54.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.256+0000 7f9d30e6e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d2c15e420 0x7f9d2c152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:54.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.256+0000 7f9d30e6e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d2c15e420 0x7f9d2c152060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46610/0 (socket says 172.21.15.62:46610) 2024-05-14T14:39:54.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.256+0000 7f9d2bfff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9d2c0d0920 0x7f9d2c0c3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.62:34924/0 (socket says 172.21.15.62:34924) 2024-05-14T14:39:54.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.256+0000 7f9d30e6e640 1 -- 172.21.15.62:0/1933748886 learned_addr learned my addr 172.21.15.62:0/1933748886 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-14T14:39:54.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.256+0000 7f9d2b7fe640 1 --2- 172.21.15.62:0/1933748886 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d2c0d1de0 0x7f9d2c0c33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:54.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.256+0000 7f9d30e6e640 1 -- 172.21.15.62:0/1933748886 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9d2c0d0920 msgr2=0x7f9d2c0c3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:54.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.256+0000 7f9d30e6e640 1 --2- 172.21.15.62:0/1933748886 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9d2c0d0920 0x7f9d2c0c3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:54.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.256+0000 7f9d30e6e640 1 -- 172.21.15.62:0/1933748886 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d2c0d1de0 msgr2=0x7f9d2c0c33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:54.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.256+0000 7f9d30e6e640 1 --2- 172.21.15.62:0/1933748886 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d2c0d1de0 0x7f9d2c0c33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:54.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.256+0000 7f9d30e6e640 1 -- 172.21.15.62:0/1933748886 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d2c15fce0 con 0x7f9d2c15e420 2024-05-14T14:39:54.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.256+0000 7f9d2bfff640 1 --2- 172.21.15.62:0/1933748886 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9d2c0d0920 0x7f9d2c0c3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T14:39:54.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.256+0000 7f9d30e6e640 1 --2- 172.21.15.62:0/1933748886 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d2c15e420 0x7f9d2c152060 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9d2402ab30 tx=0x7f9d24004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:39:54.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.257+0000 7f9d28ff9640 1 -- 172.21.15.62:0/1933748886 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2403f070 con 0x7f9d2c15e420 2024-05-14T14:39:54.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.257+0000 7f9d28ff9640 1 -- 172.21.15.62:0/1933748886 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d24031bc0 con 0x7f9d2c15e420 2024-05-14T14:39:54.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.257+0000 7f9d328d1640 1 -- 172.21.15.62:0/1933748886 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d2c15ffc0 con 0x7f9d2c15e420 2024-05-14T14:39:54.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.257+0000 7f9d28ff9640 1 -- 172.21.15.62:0/1933748886 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d24009450 con 0x7f9d2c15e420 2024-05-14T14:39:54.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.257+0000 7f9d328d1640 1 -- 172.21.15.62:0/1933748886 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d2c160580 con 0x7f9d2c15e420 2024-05-14T14:39:54.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.257+0000 7f9d28ff9640 1 -- 172.21.15.62:0/1933748886 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9d24044460 con 0x7f9d2c15e420 2024-05-14T14:39:54.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.257+0000 7f9d28ff9640 1 -- 172.21.15.62:0/1933748886 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f9d2403ba40 con 0x7f9d2c15e420 2024-05-14T14:39:54.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.258+0000 7f9d328d1640 1 -- 172.21.15.62:0/1933748886 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d2c076aa0 con 0x7f9d2c15e420 2024-05-14T14:39:54.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.262+0000 7f9d28ff9640 1 -- 172.21.15.62:0/1933748886 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f9d2403bce0 con 0x7f9d2c15e420 2024-05-14T14:39:54.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.335+0000 7f9d328d1640 1 -- 172.21.15.62:0/1933748886 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ad8950a5-70bd-488c-8f29-010515cc4a04", "id": 6} v 0) -- 0x7f9d2c0b5e00 con 0x7f9d2c15e420 2024-05-14T14:39:54.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.346+0000 7f9d28ff9640 1 -- 172.21.15.62:0/1933748886 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ad8950a5-70bd-488c-8f29-010515cc4a04", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f9d2403b410 con 0x7f9d2c15e420 2024-05-14T14:39:54.331 INFO:teuthology.orchestra.run.smithi062.stdout:6 2024-05-14T14:39:54.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.347+0000 7f9d328d1640 1 -- 172.21.15.62:0/1933748886 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d2c15e420 msgr2=0x7f9d2c152060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:54.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.347+0000 7f9d328d1640 1 --2- 172.21.15.62:0/1933748886 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d2c15e420 0x7f9d2c152060 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9d2402ab30 tx=0x7f9d24004a40 comp rx=0 tx=0).stop 2024-05-14T14:39:54.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.347+0000 7f9d328d1640 1 -- 172.21.15.62:0/1933748886 shutdown_connections 2024-05-14T14:39:54.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.347+0000 7f9d328d1640 1 --2- 172.21.15.62:0/1933748886 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9d2c15e420 0x7f9d2c152060 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:54.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.347+0000 7f9d328d1640 1 --2- 172.21.15.62:0/1933748886 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9d2c0d1de0 0x7f9d2c0c33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:54.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.347+0000 7f9d328d1640 1 --2- 172.21.15.62:0/1933748886 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9d2c0d0920 0x7f9d2c0c3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:54.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.347+0000 7f9d328d1640 1 -- 172.21.15.62:0/1933748886 >> 172.21.15.62:0/1933748886 conn(0x7f9d2c0b5780 msgr2=0x7f9d2c0b4960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:39:54.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.347+0000 7f9d328d1640 1 -- 172.21.15.62:0/1933748886 shutdown_connections 2024-05-14T14:39:54.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.347+0000 7f9d328d1640 1 -- 172.21.15.62:0/1933748886 wait complete. 2024-05-14T14:39:54.343 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd new e0d4b8b7-3c80-4760-a342-1d508cdecc37 7 2024-05-14T14:39:54.374 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-14T14:39:54.390+0000 7fe29a510040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-14T14:39:54.436 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-14T14:39:54.452+0000 7fe29a510040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-14T14:39:54.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.503+0000 7fa295227640 1 Processor -- start 2024-05-14T14:39:54.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.503+0000 7fa295227640 1 -- start start 2024-05-14T14:39:54.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.504+0000 7fa295227640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa2900b3390 0x7fa2900b37a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:54.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.504+0000 7fa295227640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa29015fe20 0x7fa290160230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:54.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.504+0000 7fa295227640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2900d1f60 con 0x7fa290163e30 2024-05-14T14:39:54.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.504+0000 7fa295227640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fa2900d2ae0 con 0x7fa29015fe20 2024-05-14T14:39:54.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.504+0000 7fa295227640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fa290160770 con 0x7fa2900b3390 2024-05-14T14:39:54.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.505+0000 7fa28ed9d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa2900b3390 0x7fa2900b37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:54.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.505+0000 7fa28ed9d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa2900b3390 0x7fa2900b37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46620/0 (socket says 172.21.15.62:46620) 2024-05-14T14:39:54.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.505+0000 7fa28f59e640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa290163e30 0x7fa290164240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:48546/0 (socket says 172.21.15.62:48546) 2024-05-14T14:39:54.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.505+0000 7fa28ed9d640 1 -- 172.21.15.62:0/4197161559 learned_addr learned my addr 172.21.15.62:0/4197161559 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-14T14:39:54.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.505+0000 7fa28e59c640 1 --2- 172.21.15.62:0/4197161559 >> v2:172.21.15.39:3300/0 conn(0x7fa29015fe20 0x7fa290160230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:54.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.505+0000 7fa28ed9d640 1 -- 172.21.15.62:0/4197161559 >> v2:172.21.15.39:3300/0 conn(0x7fa29015fe20 msgr2=0x7fa290160230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:39:54.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.505+0000 7fa28ed9d640 1 --2- 172.21.15.62:0/4197161559 >> v2:172.21.15.39:3300/0 conn(0x7fa29015fe20 0x7fa290160230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:54.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.505+0000 7fa28ed9d640 1 -- 172.21.15.62:0/4197161559 >> v1:172.21.15.62:6789/0 conn(0x7fa290163e30 legacy=0x7fa290164240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:54.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.505+0000 7fa28ed9d640 1 -- 172.21.15.62:0/4197161559 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2900d2240 con 0x7fa2900b3390 2024-05-14T14:39:54.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.505+0000 7fa28dd9b640 1 -- 172.21.15.62:0/4197161559 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 471372577 0 0) 0x7fa2900d1f60 con 0x7fa290163e30 2024-05-14T14:39:54.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.506+0000 7fa28ed9d640 1 --2- 172.21.15.62:0/4197161559 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2900b3390 0x7fa2900b37a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa2900746e0 tx=0x7fa28002a150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=724323f062ce3278 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:39:54.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.506+0000 7fa28dd9b640 1 -- 172.21.15.62:0/4197161559 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa280037070 con 0x7fa2900b3390 2024-05-14T14:39:54.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.506+0000 7fa28dd9b640 1 -- 172.21.15.62:0/4197161559 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa280032440 con 0x7fa2900b3390 2024-05-14T14:39:54.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.506+0000 7fa28dd9b640 1 -- 172.21.15.62:0/4197161559 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa280032810 con 0x7fa2900b3390 2024-05-14T14:39:54.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.507+0000 7fa295227640 1 -- 172.21.15.62:0/4197161559 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2900b3390 msgr2=0x7fa2900b37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:54.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.507+0000 7fa295227640 1 --2- 172.21.15.62:0/4197161559 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2900b3390 0x7fa2900b37a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa2900746e0 tx=0x7fa28002a150 comp rx=0 tx=0).stop 2024-05-14T14:39:54.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.507+0000 7fa295227640 1 -- 172.21.15.62:0/4197161559 shutdown_connections 2024-05-14T14:39:54.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.507+0000 7fa295227640 1 --2- 172.21.15.62:0/4197161559 >> v2:172.21.15.39:3300/0 conn(0x7fa29015fe20 0x7fa290160230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:54.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.507+0000 7fa295227640 1 --2- 172.21.15.62:0/4197161559 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2900b3390 0x7fa2900b37a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:54.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.507+0000 7fa295227640 1 -- 172.21.15.62:0/4197161559 >> 172.21.15.62:0/4197161559 conn(0x7fa29009b5f0 msgr2=0x7fa2900b7010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:39:54.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.507+0000 7fa295227640 1 -- 172.21.15.62:0/4197161559 shutdown_connections 2024-05-14T14:39:54.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.507+0000 7fa295227640 1 -- 172.21.15.62:0/4197161559 wait complete. 2024-05-14T14:39:54.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.509+0000 7fa295227640 1 Processor -- start 2024-05-14T14:39:54.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.509+0000 7fa295227640 1 -- start start 2024-05-14T14:39:54.494 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-14T14:39:54.510+0000 7fe29a510040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-14T14:39:54.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.510+0000 7fa295227640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2900b3390 0x7fa29009c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:54.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.510+0000 7fa295227640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa29015fe20 0x7fa2901546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:54.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.510+0000 7fa295227640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa290163e30 0x7fa29015e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:54.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.510+0000 7fa295227640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa2900d1bf0 con 0x7fa2900b3390 2024-05-14T14:39:54.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.510+0000 7fa295227640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa2900d2800 con 0x7fa290163e30 2024-05-14T14:39:54.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.510+0000 7fa295227640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fa29006e610 con 0x7fa29015fe20 2024-05-14T14:39:54.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.510+0000 7fa28f59e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa290163e30 0x7fa29015e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:54.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.510+0000 7fa28f59e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa290163e30 0x7fa29015e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46634/0 (socket says 172.21.15.62:46634) 2024-05-14T14:39:54.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.510+0000 7fa28e59c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa29015fe20 0x7fa2901546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:54.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.510+0000 7fa28ed9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2900b3390 0x7fa29009c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:54.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.510+0000 7fa28f59e640 1 -- 172.21.15.62:0/2154179100 learned_addr learned my addr 172.21.15.62:0/2154179100 (peer_addr_for_me v2:172.21.15.62:0/0) 2024-05-14T14:39:54.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.511+0000 7fa28ed9d640 1 -- 172.21.15.62:0/2154179100 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa29015fe20 msgr2=0x7fa2901546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:54.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.511+0000 7fa28ed9d640 1 --2- 172.21.15.62:0/2154179100 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa29015fe20 0x7fa2901546c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:54.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.511+0000 7fa28ed9d640 1 -- 172.21.15.62:0/2154179100 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa290163e30 msgr2=0x7fa29015e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:54.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.511+0000 7fa28ed9d640 1 --2- 172.21.15.62:0/2154179100 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa290163e30 0x7fa29015e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:54.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.511+0000 7fa28ed9d640 1 -- 172.21.15.62:0/2154179100 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa29009f280 con 0x7fa2900b3390 2024-05-14T14:39:54.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.511+0000 7fa28f59e640 1 --2- 172.21.15.62:0/2154179100 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa290163e30 0x7fa29015e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T14:39:54.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.511+0000 7fa28e59c640 1 --2- 172.21.15.62:0/2154179100 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa29015fe20 0x7fa2901546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T14:39:54.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.511+0000 7fa28ed9d640 1 --2- 172.21.15.62:0/2154179100 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2900b3390 0x7fa29009c0e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa280031000 tx=0x7fa2800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:39:54.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.511+0000 7fa2777fe640 1 -- 172.21.15.62:0/2154179100 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa280041020 con 0x7fa2900b3390 2024-05-14T14:39:54.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.511+0000 7fa2777fe640 1 -- 172.21.15.62:0/2154179100 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa280030640 con 0x7fa2900b3390 2024-05-14T14:39:54.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.511+0000 7fa2777fe640 1 -- 172.21.15.62:0/2154179100 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa280037040 con 0x7fa2900b3390 2024-05-14T14:39:54.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.511+0000 7fa295227640 1 -- 172.21.15.62:0/2154179100 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa29009f560 con 0x7fa2900b3390 2024-05-14T14:39:54.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.511+0000 7fa295227640 1 -- 172.21.15.62:0/2154179100 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa29009fb20 con 0x7fa2900b3390 2024-05-14T14:39:54.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.512+0000 7fa2777fe640 1 -- 172.21.15.62:0/2154179100 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa280044020 con 0x7fa2900b3390 2024-05-14T14:39:54.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.512+0000 7fa2777fe640 1 -- 172.21.15.62:0/2154179100 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fa28003dba0 con 0x7fa2900b3390 2024-05-14T14:39:54.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.512+0000 7fa295227640 1 -- 172.21.15.62:0/2154179100 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2900cff90 con 0x7fa2900b3390 2024-05-14T14:39:54.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.515+0000 7fa2777fe640 1 -- 172.21.15.62:0/2154179100 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fa28004b030 con 0x7fa2900b3390 2024-05-14T14:39:54.514 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-05-14T14:39:54.530+0000 7f21f3730040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-14T14:39:54.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.590+0000 7fa295227640 1 -- 172.21.15.62:0/2154179100 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e0d4b8b7-3c80-4760-a342-1d508cdecc37", "id": 7} v 0) -- 0x7fa290076aa0 con 0x7fa2900b3390 2024-05-14T14:39:54.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.596+0000 7fa2777fe640 1 -- 172.21.15.62:0/2154179100 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e0d4b8b7-3c80-4760-a342-1d508cdecc37", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fa280030dc0 con 0x7fa2900b3390 2024-05-14T14:39:54.580 INFO:teuthology.orchestra.run.smithi062.stdout:7 2024-05-14T14:39:54.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.597+0000 7fa295227640 1 -- 172.21.15.62:0/2154179100 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2900b3390 msgr2=0x7fa29009c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:54.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.597+0000 7fa295227640 1 --2- 172.21.15.62:0/2154179100 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2900b3390 0x7fa29009c0e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa280031000 tx=0x7fa2800046c0 comp rx=0 tx=0).stop 2024-05-14T14:39:54.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.597+0000 7fa295227640 1 -- 172.21.15.62:0/2154179100 shutdown_connections 2024-05-14T14:39:54.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.597+0000 7fa295227640 1 --2- 172.21.15.62:0/2154179100 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa290163e30 0x7fa29015e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:54.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.597+0000 7fa295227640 1 --2- 172.21.15.62:0/2154179100 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa29015fe20 0x7fa2901546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:54.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.597+0000 7fa295227640 1 --2- 172.21.15.62:0/2154179100 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa2900b3390 0x7fa29009c0e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:54.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.597+0000 7fa295227640 1 -- 172.21.15.62:0/2154179100 >> 172.21.15.62:0/2154179100 conn(0x7fa29009b5f0 msgr2=0x7fa2900b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:39:54.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.597+0000 7fa295227640 1 -- 172.21.15.62:0/2154179100 shutdown_connections 2024-05-14T14:39:54.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:39:54.597+0000 7fa295227640 1 -- 172.21.15.62:0/2154179100 wait complete. 2024-05-14T14:39:54.593 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-14T14:39:54.593 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-14T14:39:54.595 INFO:tasks.ceph.osd.0:Started 2024-05-14T14:39:54.595 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-14T14:39:54.595 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-14T14:39:54.597 INFO:tasks.ceph.osd.1:Started 2024-05-14T14:39:54.597 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-14T14:39:54.597 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-14T14:39:54.599 INFO:tasks.ceph.osd.2:Started 2024-05-14T14:39:54.600 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-14T14:39:54.600 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-14T14:39:54.602 INFO:tasks.ceph.osd.3:Started 2024-05-14T14:39:54.602 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-14T14:39:54.603 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-14T14:39:54.605 INFO:tasks.ceph.osd.4:Started 2024-05-14T14:39:54.605 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-14T14:39:54.605 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-14T14:39:54.607 INFO:tasks.ceph.osd.5:Started 2024-05-14T14:39:54.607 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-14T14:39:54.607 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-14T14:39:54.609 INFO:tasks.ceph.osd.6:Started 2024-05-14T14:39:54.609 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-14T14:39:54.610 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-14T14:39:54.612 INFO:tasks.ceph.osd.7:Started 2024-05-14T14:39:54.612 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T14:39:54.618 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-14T14:39:54.634+0000 7fe29a510040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-14T14:39:54.699 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-05-14T14:39:54.714+0000 7f21f3730040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-14T14:39:54.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.772+0000 7fd9d4ea1640 1 Processor -- start 2024-05-14T14:39:54.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.772+0000 7fd9d4ea1640 1 -- start start 2024-05-14T14:39:54.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.774+0000 7fd9d4ea1640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd9d00ce590 0x7fd9d015e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:54.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.774+0000 7fd9d4ea1640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd9d00d0200 0x7fd9d00d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:54.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.774+0000 7fd9d4ea1640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9d0162400 con 0x7fd9d0161c20 2024-05-14T14:39:54.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.774+0000 7fd9d4ea1640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fd9d00d2490 con 0x7fd9d00d0200 2024-05-14T14:39:54.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.774+0000 7fd9d4ea1640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fd9d00d2770 con 0x7fd9d00ce590 2024-05-14T14:39:54.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.774+0000 7fd9c7fff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fd9d0161c20 0x7fd9d00b6ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:54532/0 (socket says 172.21.15.39:54532) 2024-05-14T14:39:54.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.774+0000 7fd9c7fff640 1 -- 172.21.15.39:0/2368454647 learned_addr learned my addr 172.21.15.39:0/2368454647 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:39:54.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.774+0000 7fd9ce59c640 1 --2- 172.21.15.39:0/2368454647 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd9d00ce590 0x7fd9d015e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:54.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.774+0000 7fd9ced9d640 1 --2- 172.21.15.39:0/2368454647 >> v2:172.21.15.62:3300/0 conn(0x7fd9d00d0200 0x7fd9d00d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:54.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.774+0000 7fd9cdd9b640 1 -- 172.21.15.39:0/2368454647 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3457489946 0 0) 0x7fd9d0162400 con 0x7fd9d0161c20 2024-05-14T14:39:54.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.774+0000 7fd9cdd9b640 1 -- 172.21.15.39:0/2368454647 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9bc003520 con 0x7fd9d0161c20 2024-05-14T14:39:54.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.775+0000 7fd9ced9d640 1 -- 172.21.15.39:0/2368454647 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd9d00ce590 msgr2=0x7fd9d015e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:39:54.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.775+0000 7fd9ced9d640 1 --2- 172.21.15.39:0/2368454647 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd9d00ce590 0x7fd9d015e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:54.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.775+0000 7fd9ced9d640 1 -- 172.21.15.39:0/2368454647 >> v1:172.21.15.39:6789/0 conn(0x7fd9d0161c20 legacy=0x7fd9d00b6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:54.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.775+0000 7fd9ced9d640 1 -- 172.21.15.39:0/2368454647 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9d01626e0 con 0x7fd9d00d0200 2024-05-14T14:39:54.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.775+0000 7fd9ce59c640 1 --2- 172.21.15.39:0/2368454647 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd9d00ce590 0x7fd9d015e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T14:39:54.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.775+0000 7fd9ced9d640 1 --2- 172.21.15.39:0/2368454647 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9d00d0200 0x7fd9d00d0610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8009d90 tx=0x7fd9c802a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e3a06922e23a0fa server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:39:54.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.776+0000 7fd9cdd9b640 1 -- 172.21.15.39:0/2368454647 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c8031600 con 0x7fd9d00d0200 2024-05-14T14:39:54.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.776+0000 7fd9cdd9b640 1 -- 172.21.15.39:0/2368454647 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9c80317a0 con 0x7fd9d00d0200 2024-05-14T14:39:54.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.776+0000 7fd9cdd9b640 1 -- 172.21.15.39:0/2368454647 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c8031b50 con 0x7fd9d00d0200 2024-05-14T14:39:54.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.776+0000 7fd9d4ea1640 1 -- 172.21.15.39:0/2368454647 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9d00d0200 msgr2=0x7fd9d00d0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:54.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.776+0000 7fd9d4ea1640 1 --2- 172.21.15.39:0/2368454647 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9d00d0200 0x7fd9d00d0610 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8009d90 tx=0x7fd9c802a5d0 comp rx=0 tx=0).stop 2024-05-14T14:39:54.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.776+0000 7fd9d4ea1640 1 -- 172.21.15.39:0/2368454647 shutdown_connections 2024-05-14T14:39:54.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.776+0000 7fd9d4ea1640 1 --2- 172.21.15.39:0/2368454647 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9d00d0200 0x7fd9d00d0610 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:54.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.777+0000 7fd9d4ea1640 1 --2- 172.21.15.39:0/2368454647 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd9d00ce590 0x7fd9d015e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:54.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.777+0000 7fd9d4ea1640 1 -- 172.21.15.39:0/2368454647 >> 172.21.15.39:0/2368454647 conn(0x7fd9d0071660 msgr2=0x7fd9d0071a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:39:54.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.777+0000 7fd9d4ea1640 1 -- 172.21.15.39:0/2368454647 shutdown_connections 2024-05-14T14:39:54.762 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.777+0000 7fd9d4ea1640 1 -- 172.21.15.39:0/2368454647 wait complete. 2024-05-14T14:39:54.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.779+0000 7fd9d4ea1640 1 Processor -- start 2024-05-14T14:39:54.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.779+0000 7fd9d4ea1640 1 -- start start 2024-05-14T14:39:54.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.780+0000 7fd9d4ea1640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd9d00ce590 0x7fd9d0151ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:54.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.780+0000 7fd9d4ea1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9d00d0200 0x7fd9d006fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:54.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.780+0000 7fd9d4ea1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9d0161c20 0x7fd9d00b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:54.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.780+0000 7fd9d4ea1640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d00d0b50 con 0x7fd9d0161c20 2024-05-14T14:39:54.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.780+0000 7fd9d4ea1640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d015e570 con 0x7fd9d00d0200 2024-05-14T14:39:54.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.780+0000 7fd9d4ea1640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fd9d0162030 con 0x7fd9d00ce590 2024-05-14T14:39:54.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.780+0000 7fd9ce59c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd9d00ce590 0x7fd9d0151ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:54.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.780+0000 7fd9ced9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9d0161c20 0x7fd9d00b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:54.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.780+0000 7fd9c7fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9d00d0200 0x7fd9d006fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:54.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.780+0000 7fd9ce59c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd9d00ce590 0x7fd9d0151ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.39:57592/0 (socket says 172.21.15.39:57592) 2024-05-14T14:39:54.766 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.780+0000 7fd9ce59c640 1 -- 172.21.15.39:0/2399011442 learned_addr learned my addr 172.21.15.39:0/2399011442 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:39:54.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.781+0000 7fd9ce59c640 1 -- 172.21.15.39:0/2399011442 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9d00d0200 msgr2=0x7fd9d006fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:54.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.781+0000 7fd9ce59c640 1 --2- 172.21.15.39:0/2399011442 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9d00d0200 0x7fd9d006fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:54.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.781+0000 7fd9ce59c640 1 -- 172.21.15.39:0/2399011442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9d0161c20 msgr2=0x7fd9d00b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:54.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.781+0000 7fd9ce59c640 1 --2- 172.21.15.39:0/2399011442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9d0161c20 0x7fd9d00b33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:54.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.781+0000 7fd9ce59c640 1 -- 172.21.15.39:0/2399011442 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9d006e0e0 con 0x7fd9d00ce590 2024-05-14T14:39:54.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.781+0000 7fd9ce59c640 1 --2- 172.21.15.39:0/2399011442 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd9d00ce590 0x7fd9d0151ab0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd9c000e990 tx=0x7fd9c000ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:39:54.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.781+0000 7fd9c6ffd640 1 -- 172.21.15.39:0/2399011442 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c0017070 con 0x7fd9d00ce590 2024-05-14T14:39:54.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.781+0000 7fd9c6ffd640 1 -- 172.21.15.39:0/2399011442 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9c000c9e0 con 0x7fd9d00ce590 2024-05-14T14:39:54.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.781+0000 7fd9d4ea1640 1 -- 172.21.15.39:0/2399011442 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9d0160ec0 con 0x7fd9d00ce590 2024-05-14T14:39:54.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.781+0000 7fd9c6ffd640 1 -- 172.21.15.39:0/2399011442 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c000cdb0 con 0x7fd9d00ce590 2024-05-14T14:39:54.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.781+0000 7fd9d4ea1640 1 -- 172.21.15.39:0/2399011442 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9d006ffc0 con 0x7fd9d00ce590 2024-05-14T14:39:54.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.781+0000 7fd9c6ffd640 1 -- 172.21.15.39:0/2399011442 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd9c001a070 con 0x7fd9d00ce590 2024-05-14T14:39:54.767 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.781+0000 7fd9c6ffd640 1 -- 172.21.15.39:0/2399011442 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fd9c0006020 con 0x7fd9d00ce590 2024-05-14T14:39:54.768 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.782+0000 7fd9d4ea1640 1 -- 172.21.15.39:0/2399011442 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9d0076aa0 con 0x7fd9d00ce590 2024-05-14T14:39:54.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.784+0000 7fd9c6ffd640 1 -- 172.21.15.39:0/2399011442 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fd9c0006520 con 0x7fd9d00ce590 2024-05-14T14:39:54.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.848+0000 7fd9d4ea1640 1 -- 172.21.15.39:0/2399011442 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd9d00d1d60 con 0x7fd9d00ce590 2024-05-14T14:39:54.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.848+0000 7fd9c6ffd640 1 -- 172.21.15.39:0/2399011442 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fd9c0006700 con 0x7fd9d00ce590 2024-05-14T14:39:54.833 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:39:54.833 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":10,"fsid":"d7983fec-79c7-4991-b19c-1aecead64611","created":"2024-05-14T14:39:52.157167+0000","modified":"2024-05-14T14:39:54.591920+0000","last_up_change":"0.000000","last_in_change":"2024-05-14T14:39:54.591920+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c4ec4534-6301-4dd7-b4d6-d560b096d442","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"93f91b0e-096e-4bdf-aed0-d1136f73f136","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c590b1e0-67eb-452e-8e80-d2208da17d09","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d57661b0-44f6-4355-9115-83eceb9b8f71","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b131436f-f6e1-4d72-a86e-de200afdcebb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"12e10b40-28b1-410f-9ce0-7b427daa111e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ad8950a5-70bd-488c-8f29-010515cc4a04","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e0d4b8b7-3c80-4760-a342-1d508cdecc37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T14:39:54.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.849+0000 7fd9d4ea1640 1 -- 172.21.15.39:0/2399011442 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd9d00ce590 msgr2=0x7fd9d0151ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:54.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.849+0000 7fd9d4ea1640 1 --2- 172.21.15.39:0/2399011442 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd9d00ce590 0x7fd9d0151ab0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd9c000e990 tx=0x7fd9c000ee50 comp rx=0 tx=0).stop 2024-05-14T14:39:54.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.849+0000 7fd9d4ea1640 1 -- 172.21.15.39:0/2399011442 shutdown_connections 2024-05-14T14:39:54.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.849+0000 7fd9d4ea1640 1 --2- 172.21.15.39:0/2399011442 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9d0161c20 0x7fd9d00b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:54.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.849+0000 7fd9d4ea1640 1 --2- 172.21.15.39:0/2399011442 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9d00d0200 0x7fd9d006fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:54.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.849+0000 7fd9d4ea1640 1 --2- 172.21.15.39:0/2399011442 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd9d00ce590 0x7fd9d0151ab0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:54.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.849+0000 7fd9d4ea1640 1 -- 172.21.15.39:0/2399011442 >> 172.21.15.39:0/2399011442 conn(0x7fd9d0071660 msgr2=0x7fd9d00d4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:39:54.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.849+0000 7fd9d4ea1640 1 -- 172.21.15.39:0/2399011442 shutdown_connections 2024-05-14T14:39:54.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:39:54.849+0000 7fd9d4ea1640 1 -- 172.21.15.39:0/2399011442 wait complete. 2024-05-14T14:39:54.845 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-14T14:39:54.845 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-14T14:39:54.989 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-05-14T14:39:55.005+0000 7f21f3730040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-14T14:39:55.044 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-05-14T14:39:55.060+0000 7f21f3730040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-14T14:39:55.055 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-14T14:39:55.070+0000 7fe29a510040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-14T14:39:55.166 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-05-14T14:39:55.182+0000 7f21f3730040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-14T14:39:55.201 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-14T14:39:55.217+0000 7fe29a510040 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-14T14:39:55.229 INFO:tasks.ceph.osd.0.smithi039.stderr:2024-05-14T14:39:55.244+0000 7f65b460f640 -1 Falling back to public interface 2024-05-14T14:39:55.230 INFO:tasks.ceph.osd.2.smithi039.stderr:2024-05-14T14:39:55.246+0000 7f2814a2f640 -1 Falling back to public interface 2024-05-14T14:39:55.232 INFO:tasks.ceph.osd.5.smithi062.stderr:2024-05-14T14:39:55.247+0000 7fa62ce33640 -1 Falling back to public interface 2024-05-14T14:39:55.240 INFO:tasks.ceph.osd.7.smithi062.stderr:2024-05-14T14:39:55.255+0000 7fb176c0f640 -1 Falling back to public interface 2024-05-14T14:39:55.242 INFO:tasks.ceph.osd.1.smithi039.stderr:2024-05-14T14:39:55.258+0000 7fcb2c820640 -1 Falling back to public interface 2024-05-14T14:39:55.250 INFO:tasks.ceph.osd.6.smithi062.stderr:2024-05-14T14:39:55.265+0000 7fb2d09cb640 -1 Falling back to public interface 2024-05-14T14:39:55.253 INFO:tasks.ceph.osd.3.smithi039.stderr:2024-05-14T14:39:55.269+0000 7ff8655a1640 -1 Falling back to public interface 2024-05-14T14:39:55.258 INFO:tasks.ceph.osd.4.smithi062.stderr:2024-05-14T14:39:55.273+0000 7fe14d416640 -1 Falling back to public interface 2024-05-14T14:39:55.479 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-05-14T14:39:55.495+0000 7f21f3730040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-14T14:39:55.479 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-14T14:39:55.495+0000 7fe29a510040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-14T14:39:55.529 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-05-14T14:39:55.545+0000 7f21f3730040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-14T14:39:55.535 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-14T14:39:55.550+0000 7fe29a510040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-14T14:39:55.651 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-14T14:39:55.658 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-14T14:39:55.673+0000 7fe29a510040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-14T14:39:55.696 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-05-14T14:39:55.712+0000 7f21f3730040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-14T14:39:55.758 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.774+0000 7f159e386640 1 Processor -- start 2024-05-14T14:39:55.759 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.774+0000 7f159e386640 1 -- start start 2024-05-14T14:39:55.760 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.775+0000 7f159e386640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1598147cf0 0x7f15980d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:55.760 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.775+0000 7f159e386640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f15980b7650 0x7f15980b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:55.761 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.775+0000 7f159e386640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f15980b7a60 0x7f15980ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:55.761 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.775+0000 7f159e386640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f1598148100 con 0x7f15980b7a60 2024-05-14T14:39:55.761 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.775+0000 7f159e386640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f15980d1850 con 0x7f1598147cf0 2024-05-14T14:39:55.761 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.775+0000 7f159e386640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f15980d1b30 con 0x7f15980b7650 2024-05-14T14:39:55.761 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.776+0000 7f159c923640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f15980b7a60 0x7f15980ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:55.761 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.776+0000 7f159c923640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f15980b7a60 0x7f15980ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37592/0 (socket says 172.21.15.39:37592) 2024-05-14T14:39:55.761 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.776+0000 7f159c923640 1 -- 172.21.15.39:0/1971167035 learned_addr learned my addr 172.21.15.39:0/1971167035 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:39:55.761 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.776+0000 7f1597fff640 1 --2- 172.21.15.39:0/1971167035 >> v2:172.21.15.62:3300/0 conn(0x7f1598147cf0 0x7f15980d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:55.761 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.776+0000 7f15977fe640 1 --2- 172.21.15.39:0/1971167035 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f15980b7650 0x7f15980b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:55.761 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.776+0000 7f159c923640 1 -- 172.21.15.39:0/1971167035 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f15980b7650 msgr2=0x7f15980b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:39:55.761 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.776+0000 7f159c923640 1 --2- 172.21.15.39:0/1971167035 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f15980b7650 0x7f15980b22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:55.761 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.776+0000 7f159c923640 1 -- 172.21.15.39:0/1971167035 >> v2:172.21.15.62:3300/0 conn(0x7f1598147cf0 msgr2=0x7f15980d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:39:55.761 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.776+0000 7f159c923640 1 --2- 172.21.15.39:0/1971167035 >> v2:172.21.15.62:3300/0 conn(0x7f1598147cf0 0x7f15980d11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:55.761 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.776+0000 7f159c923640 1 -- 172.21.15.39:0/1971167035 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15980d1e10 con 0x7f15980b7a60 2024-05-14T14:39:55.763 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.777+0000 7f159c923640 1 --2- 172.21.15.39:0/1971167035 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15980b7a60 0x7f15980ce840 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1598074350 tx=0x7f159002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a540fa1384c2fad6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:39:55.763 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.777+0000 7f1596ffd640 1 -- 172.21.15.39:0/1971167035 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1590036070 con 0x7f15980b7a60 2024-05-14T14:39:55.763 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.777+0000 7f1596ffd640 1 -- 172.21.15.39:0/1971167035 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1590031600 con 0x7f15980b7a60 2024-05-14T14:39:55.763 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.777+0000 7f1596ffd640 1 -- 172.21.15.39:0/1971167035 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15900319d0 con 0x7f15980b7a60 2024-05-14T14:39:55.763 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.778+0000 7f159e386640 1 -- 172.21.15.39:0/1971167035 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15980b7a60 msgr2=0x7f15980ce840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:55.763 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.778+0000 7f159e386640 1 --2- 172.21.15.39:0/1971167035 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15980b7a60 0x7f15980ce840 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1598074350 tx=0x7f159002a610 comp rx=0 tx=0).stop 2024-05-14T14:39:55.763 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.778+0000 7f159e386640 1 -- 172.21.15.39:0/1971167035 shutdown_connections 2024-05-14T14:39:55.763 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.778+0000 7f159e386640 1 --2- 172.21.15.39:0/1971167035 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15980b7a60 0x7f15980ce840 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:55.763 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.778+0000 7f159e386640 1 --2- 172.21.15.39:0/1971167035 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f15980b7650 0x7f15980b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:55.763 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.778+0000 7f159e386640 1 --2- 172.21.15.39:0/1971167035 >> v2:172.21.15.62:3300/0 conn(0x7f1598147cf0 0x7f15980d11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:55.763 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.778+0000 7f159e386640 1 -- 172.21.15.39:0/1971167035 >> 172.21.15.39:0/1971167035 conn(0x7f1598073e30 msgr2=0x7f159809b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:39:55.763 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.778+0000 7f159e386640 1 -- 172.21.15.39:0/1971167035 shutdown_connections 2024-05-14T14:39:55.763 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.778+0000 7f159e386640 1 -- 172.21.15.39:0/1971167035 wait complete. 2024-05-14T14:39:55.764 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.780+0000 7f159e386640 1 Processor -- start 2024-05-14T14:39:55.764 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.780+0000 7f159e386640 1 -- start start 2024-05-14T14:39:55.767 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.781+0000 7f159e386640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15980b7650 0x7f1598150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:55.767 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.781+0000 7f159e386640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15980b7a60 0x7f159809fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:55.767 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.781+0000 7f159e386640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1598147cf0 0x7f159809d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:39:55.767 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.781+0000 7f159e386640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f15980b27e0 con 0x7f15980b7a60 2024-05-14T14:39:55.768 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.781+0000 7f159e386640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f15980b1d80 con 0x7f15980b7650 2024-05-14T14:39:55.768 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.781+0000 7f159e386640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f15980b2960 con 0x7f1598147cf0 2024-05-14T14:39:55.768 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.781+0000 7f15977fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15980b7a60 0x7f159809fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:55.768 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.781+0000 7f15977fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15980b7a60 0x7f159809fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:37606/0 (socket says 172.21.15.39:37606) 2024-05-14T14:39:55.768 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.781+0000 7f15977fe640 1 -- 172.21.15.39:0/2153773270 learned_addr learned my addr 172.21.15.39:0/2153773270 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:39:55.768 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.781+0000 7f1597fff640 1 --2- 172.21.15.39:0/2153773270 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15980b7650 0x7f1598150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:55.768 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.781+0000 7f159c923640 1 --2- 172.21.15.39:0/2153773270 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1598147cf0 0x7f159809d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:39:55.768 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.782+0000 7f15977fe640 1 -- 172.21.15.39:0/2153773270 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1598147cf0 msgr2=0x7f159809d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:55.768 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.782+0000 7f15977fe640 1 --2- 172.21.15.39:0/2153773270 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1598147cf0 0x7f159809d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:55.768 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.782+0000 7f15977fe640 1 -- 172.21.15.39:0/2153773270 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15980b7650 msgr2=0x7f1598150730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:55.768 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.782+0000 7f15977fe640 1 --2- 172.21.15.39:0/2153773270 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15980b7650 0x7f1598150730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:55.768 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.782+0000 7f15977fe640 1 -- 172.21.15.39:0/2153773270 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f159809ff80 con 0x7f15980b7a60 2024-05-14T14:39:55.769 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.782+0000 7f15977fe640 1 --2- 172.21.15.39:0/2153773270 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15980b7a60 0x7f159809fa40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f158c00e8a0 tx=0x7f158c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:39:55.769 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.782+0000 7f1594ff9640 1 -- 172.21.15.39:0/2153773270 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158c017070 con 0x7f15980b7a60 2024-05-14T14:39:55.769 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.782+0000 7f1594ff9640 1 -- 172.21.15.39:0/2153773270 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f158c00ee90 con 0x7f15980b7a60 2024-05-14T14:39:55.769 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.782+0000 7f159e386640 1 -- 172.21.15.39:0/2153773270 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f159814e330 con 0x7f15980b7a60 2024-05-14T14:39:55.769 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.782+0000 7f1594ff9640 1 -- 172.21.15.39:0/2153773270 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158c00cb80 con 0x7f15980b7a60 2024-05-14T14:39:55.769 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.782+0000 7f159e386640 1 -- 172.21.15.39:0/2153773270 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f159814e8f0 con 0x7f15980b7a60 2024-05-14T14:39:55.769 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.782+0000 7f1594ff9640 1 -- 172.21.15.39:0/2153773270 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f158c01a070 con 0x7f15980b7a60 2024-05-14T14:39:55.769 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.782+0000 7f1594ff9640 1 -- 172.21.15.39:0/2153773270 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f158c013b40 con 0x7f15980b7a60 2024-05-14T14:39:55.769 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.783+0000 7f159e386640 1 -- 172.21.15.39:0/2153773270 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1598076aa0 con 0x7f15980b7a60 2024-05-14T14:39:55.769 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.785+0000 7f1594ff9640 1 -- 172.21.15.39:0/2153773270 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f158c00cd20 con 0x7f15980b7a60 2024-05-14T14:39:55.832 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.848+0000 7f159e386640 1 -- 172.21.15.39:0/2153773270 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f15980cf420 con 0x7f15980b7a60 2024-05-14T14:39:55.833 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.849+0000 7f1594ff9640 1 -- 172.21.15.39:0/2153773270 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f158c013e20 con 0x7f15980b7a60 2024-05-14T14:39:55.833 INFO:teuthology.misc.health.smithi039.stdout: 2024-05-14T14:39:55.833 INFO:teuthology.misc.health.smithi039.stdout:{"epoch":10,"fsid":"d7983fec-79c7-4991-b19c-1aecead64611","created":"2024-05-14T14:39:52.157167+0000","modified":"2024-05-14T14:39:54.591920+0000","last_up_change":"0.000000","last_in_change":"2024-05-14T14:39:54.591920+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c4ec4534-6301-4dd7-b4d6-d560b096d442","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"93f91b0e-096e-4bdf-aed0-d1136f73f136","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c590b1e0-67eb-452e-8e80-d2208da17d09","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d57661b0-44f6-4355-9115-83eceb9b8f71","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b131436f-f6e1-4d72-a86e-de200afdcebb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"12e10b40-28b1-410f-9ce0-7b427daa111e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ad8950a5-70bd-488c-8f29-010515cc4a04","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e0d4b8b7-3c80-4760-a342-1d508cdecc37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T14:39:55.834 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.849+0000 7f159e386640 1 -- 172.21.15.39:0/2153773270 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15980b7a60 msgr2=0x7f159809fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:39:55.834 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.849+0000 7f159e386640 1 --2- 172.21.15.39:0/2153773270 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15980b7a60 0x7f159809fa40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f158c00e8a0 tx=0x7f158c00ed60 comp rx=0 tx=0).stop 2024-05-14T14:39:55.834 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.849+0000 7f159e386640 1 -- 172.21.15.39:0/2153773270 shutdown_connections 2024-05-14T14:39:55.834 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.849+0000 7f159e386640 1 --2- 172.21.15.39:0/2153773270 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1598147cf0 0x7f159809d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:55.834 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.849+0000 7f159e386640 1 --2- 172.21.15.39:0/2153773270 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f15980b7a60 0x7f159809fa40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:55.834 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.849+0000 7f159e386640 1 --2- 172.21.15.39:0/2153773270 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f15980b7650 0x7f1598150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:39:55.834 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.849+0000 7f159e386640 1 -- 172.21.15.39:0/2153773270 >> 172.21.15.39:0/2153773270 conn(0x7f1598073e30 msgr2=0x7f15980705a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:39:55.834 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.850+0000 7f159e386640 1 -- 172.21.15.39:0/2153773270 shutdown_connections 2024-05-14T14:39:55.835 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:39:55.850+0000 7f159e386640 1 -- 172.21.15.39:0/2153773270 wait complete. 2024-05-14T14:39:55.843 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-14T14:39:55.846 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-05-14T14:39:55.862+0000 7f21f3730040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-14T14:39:55.898 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-05-14T14:39:55.914+0000 7f21f3730040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-14T14:39:55.967 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-14T14:39:55.983+0000 7fe29a510040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-14T14:39:55.972 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-05-14T14:39:55.987+0000 7f21f3730040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-14T14:39:56.017 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-14T14:39:56.033+0000 7fe29a510040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-14T14:39:56.019 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-05-14T14:39:56.035+0000 7f21f3730040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-14T14:39:56.184 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-14T14:39:56.200+0000 7fe29a510040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-14T14:39:56.329 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-14T14:39:56.345+0000 7fe29a510040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-14T14:39:56.382 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-14T14:39:56.398+0000 7fe29a510040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-14T14:39:56.456 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-14T14:39:56.472+0000 7fe29a510040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-14T14:39:56.504 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-14T14:39:56.520+0000 7fe29a510040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-14T14:39:56.523 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-05-14T14:39:56.539+0000 7f21f3730040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-14T14:39:56.645 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-05-14T14:39:56.661+0000 7f21f3730040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-14T14:39:57.014 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-14T14:39:57.029+0000 7fe29a510040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-14T14:39:57.136 INFO:tasks.ceph.mgr.x.smithi062.stderr:2024-05-14T14:39:57.152+0000 7fe29a510040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-14T14:39:57.665 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-05-14T14:39:57.679+0000 7f2193980640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-14T14:39:57.665 INFO:tasks.ceph.mgr.y.smithi039.stderr:2024-05-14T14:39:57.680+0000 7f2193980640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-14T14:39:58.709 INFO:tasks.ceph.osd.0.smithi039.stderr:2024-05-14T14:39:58.724+0000 7f65b460f640 -1 osd.0 0 log_to_monitors true 2024-05-14T14:39:58.712 INFO:tasks.ceph.osd.7.smithi062.stderr:2024-05-14T14:39:58.727+0000 7fb176c0f640 -1 osd.7 0 log_to_monitors true 2024-05-14T14:39:58.726 INFO:tasks.ceph.osd.5.smithi062.stderr:2024-05-14T14:39:58.742+0000 7fa62ce33640 -1 osd.5 0 log_to_monitors true 2024-05-14T14:39:58.746 INFO:tasks.ceph.osd.2.smithi039.stderr:2024-05-14T14:39:58.759+0000 7f2814a2f640 -1 osd.2 0 log_to_monitors true 2024-05-14T14:39:58.748 INFO:tasks.ceph.osd.6.smithi062.stderr:2024-05-14T14:39:58.764+0000 7fb2d09cb640 -1 osd.6 0 log_to_monitors true 2024-05-14T14:39:58.772 INFO:tasks.ceph.osd.1.smithi039.stderr:2024-05-14T14:39:58.786+0000 7fcb2c820640 -1 osd.1 0 log_to_monitors true 2024-05-14T14:39:58.773 INFO:tasks.ceph.osd.4.smithi062.stderr:2024-05-14T14:39:58.789+0000 7fe14d416640 -1 osd.4 0 log_to_monitors true 2024-05-14T14:39:58.778 INFO:tasks.ceph.osd.3.smithi039.stderr:2024-05-14T14:39:58.793+0000 7ff8655a1640 -1 osd.3 0 log_to_monitors true 2024-05-14T14:40:02.650 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-14T14:40:02.808 INFO:tasks.ceph.osd.7.smithi062.stderr:2024-05-14T14:40:02.823+0000 7fb1725ff640 -1 osd.7 0 waiting for initial osdmap 2024-05-14T14:40:02.827 INFO:tasks.ceph.osd.6.smithi062.stderr:2024-05-14T14:40:02.843+0000 7fb2cc961640 -1 osd.6 0 waiting for initial osdmap 2024-05-14T14:40:02.828 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.840+0000 7fda36042640 1 Processor -- start 2024-05-14T14:40:02.828 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.840+0000 7fda36042640 1 -- start start 2024-05-14T14:40:02.828 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.842+0000 7fda36042640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fda3006ddc0 0x7fda300cd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:02.828 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.842+0000 7fda36042640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda300d0500 con 0x7fda300d0eb0 2024-05-14T14:40:02.829 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.842+0000 7fda36042640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda300d07e0 con 0x7fda3016d0a0 2024-05-14T14:40:02.829 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.842+0000 7fda36042640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fda3016d4b0 con 0x7fda3006ddc0 2024-05-14T14:40:02.829 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.842+0000 7fda2effd640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fda300d0eb0 0x7fda3006d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:57832/0 (socket says 172.21.15.39:57832) 2024-05-14T14:40:02.829 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.842+0000 7fda2effd640 1 -- 172.21.15.39:0/433048924 learned_addr learned my addr 172.21.15.39:0/433048924 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:02.829 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.843+0000 7fda2ffff640 1 --2- 172.21.15.39:0/433048924 >> v2:172.21.15.39:3300/0 conn(0x7fda3006ddc0 0x7fda300cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:02.829 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.844+0000 7fda2ffff640 1 -- 172.21.15.39:0/433048924 >> v1:172.21.15.62:6789/0 conn(0x7fda3016d0a0 legacy=0x7fda3006f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:02.829 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.844+0000 7fda2ffff640 1 -- 172.21.15.39:0/433048924 >> v1:172.21.15.39:6789/0 conn(0x7fda300d0eb0 legacy=0x7fda3006d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:02.829 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.844+0000 7fda2ffff640 1 -- 172.21.15.39:0/433048924 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda300ccd30 con 0x7fda3006ddc0 2024-05-14T14:40:02.831 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.846+0000 7fda2ffff640 1 --2- 172.21.15.39:0/433048924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda3006ddc0 0x7fda300cd530 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fda20009c00 tx=0x7fda2002a4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80bfcc565d036277 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:02.832 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.846+0000 7fda2e7fc640 1 -- 172.21.15.39:0/433048924 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda20036070 con 0x7fda3006ddc0 2024-05-14T14:40:02.832 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.847+0000 7fda2e7fc640 1 -- 172.21.15.39:0/433048924 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda20007690 con 0x7fda3006ddc0 2024-05-14T14:40:02.832 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.847+0000 7fda2e7fc640 1 -- 172.21.15.39:0/433048924 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda20036070 con 0x7fda3006ddc0 2024-05-14T14:40:02.834 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.848+0000 7fda36042640 1 -- 172.21.15.39:0/433048924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda3006ddc0 msgr2=0x7fda300cd530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:02.834 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.848+0000 7fda36042640 1 --2- 172.21.15.39:0/433048924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda3006ddc0 0x7fda300cd530 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fda20009c00 tx=0x7fda2002a4d0 comp rx=0 tx=0).stop 2024-05-14T14:40:02.834 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.849+0000 7fda36042640 1 -- 172.21.15.39:0/433048924 shutdown_connections 2024-05-14T14:40:02.834 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.849+0000 7fda36042640 1 --2- 172.21.15.39:0/433048924 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda3006ddc0 0x7fda300cd530 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:02.834 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.849+0000 7fda36042640 1 -- 172.21.15.39:0/433048924 >> 172.21.15.39:0/433048924 conn(0x7fda300732b0 msgr2=0x7fda300736c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:02.834 INFO:tasks.ceph.osd.7.smithi062.stderr:2024-05-14T14:40:02.850+0000 7fb16a3fa640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T14:40:02.838 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.850+0000 7fda36042640 1 -- 172.21.15.39:0/433048924 shutdown_connections 2024-05-14T14:40:02.838 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.850+0000 7fda36042640 1 -- 172.21.15.39:0/433048924 wait complete. 2024-05-14T14:40:02.838 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.853+0000 7fda36042640 1 Processor -- start 2024-05-14T14:40:02.843 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.853+0000 7fda36042640 1 -- start start 2024-05-14T14:40:02.843 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.856+0000 7fda36042640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda300d0eb0 0x7fda3009cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:02.843 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.856+0000 7fda36042640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fda3016d0a0 0x7fda301711b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:02.843 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.856+0000 7fda2f7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda300d0eb0 0x7fda3009cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:02.843 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.856+0000 7fda2f7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda300d0eb0 0x7fda3009cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.39:37578/0 (socket says 172.21.15.39:37578) 2024-05-14T14:40:02.843 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.856+0000 7fda36042640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda302139a0 0x7fda3009d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:02.844 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.856+0000 7fda36042640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fda300d0120 con 0x7fda302139a0 2024-05-14T14:40:02.844 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.856+0000 7fda36042640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fda300cc9e0 con 0x7fda300d0eb0 2024-05-14T14:40:02.844 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.856+0000 7fda36042640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fda300d02a0 con 0x7fda3016d0a0 2024-05-14T14:40:02.844 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.856+0000 7fda2f7fe640 1 -- 172.21.15.39:0/4176393050 learned_addr learned my addr 172.21.15.39:0/4176393050 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:02.844 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.856+0000 7fda2effd640 1 --2- 172.21.15.39:0/4176393050 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fda3016d0a0 0x7fda301711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:02.844 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.857+0000 7fda2effd640 1 -- 172.21.15.39:0/4176393050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda300d0eb0 msgr2=0x7fda3009cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:02.844 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.857+0000 7fda2effd640 1 --2- 172.21.15.39:0/4176393050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda300d0eb0 0x7fda3009cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:02.844 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.857+0000 7fda2effd640 1 -- 172.21.15.39:0/4176393050 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda302139a0 msgr2=0x7fda3009d950 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-14T14:40:02.844 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.857+0000 7fda2ffff640 1 --2- 172.21.15.39:0/4176393050 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda302139a0 0x7fda3009d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:02.844 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.857+0000 7fda2effd640 1 --2- 172.21.15.39:0/4176393050 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda302139a0 0x7fda3009d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:02.844 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.857+0000 7fda2effd640 1 -- 172.21.15.39:0/4176393050 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda3009c130 con 0x7fda3016d0a0 2024-05-14T14:40:02.844 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.858+0000 7fda2effd640 1 --2- 172.21.15.39:0/4176393050 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fda3016d0a0 0x7fda301711b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fda2800cab0 tx=0x7fda2800cf70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:02.844 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.858+0000 7fda2ffff640 1 --2- 172.21.15.39:0/4176393050 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda302139a0 0x7fda3009d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:40:02.844 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.858+0000 7fda17fff640 1 -- 172.21.15.39:0/4176393050 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda2800ac30 con 0x7fda3016d0a0 2024-05-14T14:40:02.845 INFO:tasks.ceph.osd.6.smithi062.stderr:2024-05-14T14:40:02.859+0000 7fb2c475c640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T14:40:02.845 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.858+0000 7fda36042640 1 -- 172.21.15.39:0/4176393050 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda3009c410 con 0x7fda3016d0a0 2024-05-14T14:40:02.846 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.858+0000 7fda36042640 1 -- 172.21.15.39:0/4176393050 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fda3016e820 con 0x7fda3016d0a0 2024-05-14T14:40:02.846 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.859+0000 7fda17fff640 1 -- 172.21.15.39:0/4176393050 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda2800add0 con 0x7fda3016d0a0 2024-05-14T14:40:02.846 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.859+0000 7fda17fff640 1 -- 172.21.15.39:0/4176393050 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda28012600 con 0x7fda3016d0a0 2024-05-14T14:40:02.847 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.862+0000 7fda36042640 1 -- 172.21.15.39:0/4176393050 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda10005290 con 0x7fda3016d0a0 2024-05-14T14:40:02.849 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.862+0000 7fda17fff640 1 -- 172.21.15.39:0/4176393050 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 4) ==== 98145+0+0 (secure 0 0 0) 0x7fda280127a0 con 0x7fda3016d0a0 2024-05-14T14:40:02.849 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.863+0000 7fda17fff640 1 --2- 172.21.15.39:0/4176393050 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fda1c076340 0x7fda1c078850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:02.849 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.863+0000 7fda17fff640 1 -- 172.21.15.39:0/4176393050 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7fda28096d70 con 0x7fda3016d0a0 2024-05-14T14:40:02.849 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.864+0000 7fda2f7fe640 1 --2- 172.21.15.39:0/4176393050 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fda1c076340 0x7fda1c078850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:02.849 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.865+0000 7fda2f7fe640 1 --2- 172.21.15.39:0/4176393050 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fda1c076340 0x7fda1c078850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fda24000f60 tx=0x7fda24009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:02.856 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:02.871+0000 7fda17fff640 1 -- 172.21.15.39:0/4176393050 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fda28061490 con 0x7fda3016d0a0 2024-05-14T14:40:02.887 INFO:tasks.ceph.osd.2.smithi039.stderr:2024-05-14T14:40:02.901+0000 7f280ff80640 -1 osd.2 0 waiting for initial osdmap 2024-05-14T14:40:02.902 INFO:tasks.ceph.osd.2.smithi039.stderr:2024-05-14T14:40:02.917+0000 7f2807d8c640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T14:40:02.916 INFO:tasks.ceph.osd.5.smithi062.stderr:2024-05-14T14:40:02.931+0000 7fa628380640 -1 osd.5 0 waiting for initial osdmap 2024-05-14T14:40:02.931 INFO:tasks.ceph.osd.5.smithi062.stderr:2024-05-14T14:40:02.947+0000 7fa62018c640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T14:40:03.077 INFO:tasks.ceph.osd.4.smithi062.stderr:2024-05-14T14:40:03.092+0000 7fe148ca5640 -1 osd.4 0 waiting for initial osdmap 2024-05-14T14:40:03.088 INFO:tasks.ceph.osd.4.smithi062.stderr:2024-05-14T14:40:03.104+0000 7fe140aa0640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T14:40:03.092 INFO:tasks.ceph.osd.0.smithi039.stderr:2024-05-14T14:40:03.107+0000 7f65aff98640 -1 osd.0 0 waiting for initial osdmap 2024-05-14T14:40:03.103 INFO:tasks.ceph.osd.1.smithi039.stderr:2024-05-14T14:40:03.117+0000 7fcb28212640 -1 osd.1 0 waiting for initial osdmap 2024-05-14T14:40:03.106 INFO:tasks.ceph.osd.3.smithi039.stderr:2024-05-14T14:40:03.121+0000 7ff861537640 -1 osd.3 0 waiting for initial osdmap 2024-05-14T14:40:03.108 INFO:tasks.ceph.osd.0.smithi039.stderr:2024-05-14T14:40:03.123+0000 7f65a7d93640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T14:40:03.116 INFO:tasks.ceph.osd.1.smithi039.stderr:2024-05-14T14:40:03.131+0000 7fcb2000d640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T14:40:03.124 INFO:tasks.ceph.osd.3.smithi039.stderr:2024-05-14T14:40:03.139+0000 7ff859332640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T14:40:03.172 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:03.187+0000 7fda36042640 1 -- 172.21.15.39:0/4176393050 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fda10005580 con 0x7fda3016d0a0 2024-05-14T14:40:03.173 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:03.188+0000 7fda17fff640 1 -- 172.21.15.39:0/4176393050 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7fda28060d90 con 0x7fda3016d0a0 2024-05-14T14:40:03.173 INFO:teuthology.misc.health.smithi039.stdout: 2024-05-14T14:40:03.173 INFO:teuthology.misc.health.smithi039.stdout:{"epoch":12,"fsid":"d7983fec-79c7-4991-b19c-1aecead64611","created":"2024-05-14T14:39:52.157167+0000","modified":"2024-05-14T14:40:00.693007+0000","last_up_change":"0.000000","last_in_change":"2024-05-14T14:39:54.591920+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c4ec4534-6301-4dd7-b4d6-d560b096d442","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"93f91b0e-096e-4bdf-aed0-d1136f73f136","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c590b1e0-67eb-452e-8e80-d2208da17d09","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d57661b0-44f6-4355-9115-83eceb9b8f71","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b131436f-f6e1-4d72-a86e-de200afdcebb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"12e10b40-28b1-410f-9ce0-7b427daa111e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ad8950a5-70bd-488c-8f29-010515cc4a04","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e0d4b8b7-3c80-4760-a342-1d508cdecc37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T14:40:03.176 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:03.190+0000 7fda36042640 1 -- 172.21.15.39:0/4176393050 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fda1c076340 msgr2=0x7fda1c078850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:03.176 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:03.190+0000 7fda36042640 1 --2- 172.21.15.39:0/4176393050 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fda1c076340 0x7fda1c078850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fda24000f60 tx=0x7fda24009040 comp rx=0 tx=0).stop 2024-05-14T14:40:03.176 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:03.190+0000 7fda36042640 1 -- 172.21.15.39:0/4176393050 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fda3016d0a0 msgr2=0x7fda301711b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:03.176 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:03.190+0000 7fda36042640 1 --2- 172.21.15.39:0/4176393050 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fda3016d0a0 0x7fda301711b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fda2800cab0 tx=0x7fda2800cf70 comp rx=0 tx=0).stop 2024-05-14T14:40:03.176 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:03.190+0000 7fda36042640 1 -- 172.21.15.39:0/4176393050 shutdown_connections 2024-05-14T14:40:03.176 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:03.190+0000 7fda36042640 1 --2- 172.21.15.39:0/4176393050 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fda1c076340 0x7fda1c078850 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:03.176 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:03.190+0000 7fda36042640 1 --2- 172.21.15.39:0/4176393050 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fda302139a0 0x7fda3009d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:03.176 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:03.190+0000 7fda36042640 1 --2- 172.21.15.39:0/4176393050 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fda3016d0a0 0x7fda301711b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:03.176 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:03.190+0000 7fda36042640 1 --2- 172.21.15.39:0/4176393050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fda300d0eb0 0x7fda3009cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:03.177 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:03.190+0000 7fda36042640 1 -- 172.21.15.39:0/4176393050 >> 172.21.15.39:0/4176393050 conn(0x7fda300732b0 msgr2=0x7fda300b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:03.177 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:03.190+0000 7fda36042640 1 -- 172.21.15.39:0/4176393050 shutdown_connections 2024-05-14T14:40:03.177 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:03.191+0000 7fda36042640 1 -- 172.21.15.39:0/4176393050 wait complete. 2024-05-14T14:40:03.186 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-14T14:40:09.993 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-14T14:40:10.111 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.126+0000 7f415f50d640 1 Processor -- start 2024-05-14T14:40:10.112 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.126+0000 7f415f50d640 1 -- start start 2024-05-14T14:40:10.114 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.128+0000 7f415f50d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4158160800 0x7f41580cfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:10.114 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.128+0000 7f415f50d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f41580d0420 0x7f41580d0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:10.114 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.128+0000 7f415f50d640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41580d0d70 con 0x7f41580d15e0 2024-05-14T14:40:10.114 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.128+0000 7f415f50d640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f4158160c10 con 0x7f41580d0420 2024-05-14T14:40:10.114 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.128+0000 7f415f50d640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f4158163f00 con 0x7f4158160800 2024-05-14T14:40:10.114 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.128+0000 7f415daaa640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f41580d0420 0x7f41580d0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:10.114 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.128+0000 7f415daaa640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f41580d0420 0x7f41580d0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34560/0 (socket says 172.21.15.39:34560) 2024-05-14T14:40:10.114 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.128+0000 7f415daaa640 1 -- 172.21.15.39:0/1065962484 learned_addr learned my addr 172.21.15.39:0/1065962484 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:10.114 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.128+0000 7f415d2a9640 1 --2- 172.21.15.39:0/1065962484 >> v2:172.21.15.62:3300/0 conn(0x7f4158160800 0x7f41580cfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:10.114 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.128+0000 7f415daaa640 1 -- 172.21.15.39:0/1065962484 >> v2:172.21.15.62:3300/0 conn(0x7f4158160800 msgr2=0x7f41580cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:10.114 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.128+0000 7f415daaa640 1 --2- 172.21.15.39:0/1065962484 >> v2:172.21.15.62:3300/0 conn(0x7f4158160800 0x7f41580cfd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:10.115 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.128+0000 7f415daaa640 1 -- 172.21.15.39:0/1065962484 >> v1:172.21.15.62:6789/0 conn(0x7f41580d15e0 legacy=0x7f415806e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:10.115 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.128+0000 7f415daaa640 1 -- 172.21.15.39:0/1065962484 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4158160e50 con 0x7f41580d0420 2024-05-14T14:40:10.115 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.128+0000 7f415d2a9640 1 --2- 172.21.15.39:0/1065962484 >> v2:172.21.15.62:3300/0 conn(0x7f4158160800 0x7f41580cfd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:40:10.116 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.129+0000 7f415daaa640 1 --2- 172.21.15.39:0/1065962484 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41580d0420 0x7f41580d0830 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4158073f70 tx=0x7f415002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfdb572ad3059921 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:10.116 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.129+0000 7f414ffff640 1 -- 172.21.15.39:0/1065962484 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4150036070 con 0x7f41580d0420 2024-05-14T14:40:10.116 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.129+0000 7f414ffff640 1 -- 172.21.15.39:0/1065962484 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4150031600 con 0x7f41580d0420 2024-05-14T14:40:10.116 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.129+0000 7f414ffff640 1 -- 172.21.15.39:0/1065962484 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41500319d0 con 0x7f41580d0420 2024-05-14T14:40:10.116 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.130+0000 7f415f50d640 1 -- 172.21.15.39:0/1065962484 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41580d0420 msgr2=0x7f41580d0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:10.116 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.130+0000 7f415f50d640 1 --2- 172.21.15.39:0/1065962484 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41580d0420 0x7f41580d0830 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4158073f70 tx=0x7f415002a6a0 comp rx=0 tx=0).stop 2024-05-14T14:40:10.117 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.130+0000 7f415f50d640 1 -- 172.21.15.39:0/1065962484 shutdown_connections 2024-05-14T14:40:10.117 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.130+0000 7f415f50d640 1 --2- 172.21.15.39:0/1065962484 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41580d0420 0x7f41580d0830 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:10.117 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.130+0000 7f415f50d640 1 --2- 172.21.15.39:0/1065962484 >> v2:172.21.15.62:3300/0 conn(0x7f4158160800 0x7f41580cfd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:10.117 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.130+0000 7f415f50d640 1 -- 172.21.15.39:0/1065962484 >> 172.21.15.39:0/1065962484 conn(0x7f4158071660 msgr2=0x7f4158071a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:10.117 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.130+0000 7f415f50d640 1 -- 172.21.15.39:0/1065962484 shutdown_connections 2024-05-14T14:40:10.117 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.130+0000 7f415f50d640 1 -- 172.21.15.39:0/1065962484 wait complete. 2024-05-14T14:40:10.117 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.132+0000 7f415f50d640 1 Processor -- start 2024-05-14T14:40:10.117 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.132+0000 7f415f50d640 1 -- start start 2024-05-14T14:40:10.120 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.133+0000 7f415f50d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41580d0420 0x7f41580b8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:10.120 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.133+0000 7f415f50d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41580d15e0 0x7f415814e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:10.121 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.133+0000 7f415f50d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4158160800 0x7f41580c9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:10.121 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.133+0000 7f415f50d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f415806f0f0 con 0x7f41580d0420 2024-05-14T14:40:10.121 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.133+0000 7f415f50d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4158161410 con 0x7f41580d15e0 2024-05-14T14:40:10.121 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.133+0000 7f415f50d640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f41581616f0 con 0x7f4158160800 2024-05-14T14:40:10.121 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.133+0000 7f415d2a9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41580d0420 0x7f41580b8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:10.121 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.133+0000 7f415d2a9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41580d0420 0x7f41580b8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34568/0 (socket says 172.21.15.39:34568) 2024-05-14T14:40:10.121 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.133+0000 7f415d2a9640 1 -- 172.21.15.39:0/891275799 learned_addr learned my addr 172.21.15.39:0/891275799 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:10.121 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.134+0000 7f415daaa640 1 --2- 172.21.15.39:0/891275799 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4158160800 0x7f41580c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:10.121 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.134+0000 7f415caa8640 1 --2- 172.21.15.39:0/891275799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41580d15e0 0x7f415814e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:10.121 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.134+0000 7f415d2a9640 1 -- 172.21.15.39:0/891275799 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4158160800 msgr2=0x7f41580c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:10.121 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.134+0000 7f415d2a9640 1 --2- 172.21.15.39:0/891275799 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4158160800 0x7f41580c9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:10.121 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.134+0000 7f415d2a9640 1 -- 172.21.15.39:0/891275799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41580d15e0 msgr2=0x7f415814e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:10.121 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.134+0000 7f415d2a9640 1 --2- 172.21.15.39:0/891275799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41580d15e0 0x7f415814e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:10.122 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.134+0000 7f415d2a9640 1 -- 172.21.15.39:0/891275799 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4158152160 con 0x7f41580d0420 2024-05-14T14:40:10.122 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.134+0000 7f415caa8640 1 --2- 172.21.15.39:0/891275799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41580d15e0 0x7f415814e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:40:10.122 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.134+0000 7f415d2a9640 1 --2- 172.21.15.39:0/891275799 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41580d0420 0x7f41580b8080 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f415400c7f0 tx=0x7f415400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:10.122 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.134+0000 7f414dffb640 1 -- 172.21.15.39:0/891275799 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4154015070 con 0x7f41580d0420 2024-05-14T14:40:10.122 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.134+0000 7f414dffb640 1 -- 172.21.15.39:0/891275799 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4154007820 con 0x7f41580d0420 2024-05-14T14:40:10.122 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.134+0000 7f415f50d640 1 -- 172.21.15.39:0/891275799 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41581518c0 con 0x7f41580d0420 2024-05-14T14:40:10.122 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.134+0000 7f414dffb640 1 -- 172.21.15.39:0/891275799 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4154007bf0 con 0x7f41580d0420 2024-05-14T14:40:10.122 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.134+0000 7f415f50d640 1 -- 172.21.15.39:0/891275799 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4158151e80 con 0x7f41580d0420 2024-05-14T14:40:10.122 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.135+0000 7f415f50d640 1 -- 172.21.15.39:0/891275799 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4158076aa0 con 0x7f41580d0420 2024-05-14T14:40:10.123 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.136+0000 7f414dffb640 1 -- 172.21.15.39:0/891275799 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4154018070 con 0x7f41580d0420 2024-05-14T14:40:10.123 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.137+0000 7f414dffb640 1 --2- 172.21.15.39:0/891275799 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f413c0762d0 0x7f413c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:10.123 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.137+0000 7f415caa8640 1 --2- 172.21.15.39:0/891275799 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f413c0762d0 0x7f413c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:10.123 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.137+0000 7f414dffb640 1 -- 172.21.15.39:0/891275799 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f4154097380 con 0x7f41580d0420 2024-05-14T14:40:10.123 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.137+0000 7f415caa8640 1 --2- 172.21.15.39:0/891275799 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f413c0762d0 0x7f413c0787e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f41580b9830 tx=0x7f4148008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:10.127 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.142+0000 7f414dffb640 1 -- 172.21.15.39:0/891275799 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4154061030 con 0x7f41580d0420 2024-05-14T14:40:10.320 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.334+0000 7f415f50d640 1 -- 172.21.15.39:0/891275799 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f415806e7c0 con 0x7f41580d0420 2024-05-14T14:40:10.320 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.335+0000 7f414dffb640 1 -- 172.21.15.39:0/891275799 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12824 (secure 0 0 0) 0x7f4154060930 con 0x7f41580d0420 2024-05-14T14:40:10.321 INFO:teuthology.misc.health.smithi039.stdout: 2024-05-14T14:40:10.321 INFO:teuthology.misc.health.smithi039.stdout:{"epoch":16,"fsid":"d7983fec-79c7-4991-b19c-1aecead64611","created":"2024-05-14T14:39:52.157167+0000","modified":"2024-05-14T14:40:06.889706+0000","last_up_change":"2024-05-14T14:40:03.848608+0000","last_in_change":"2024-05-14T14:39:54.591920+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T14:40:04.692846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c4ec4534-6301-4dd7-b4d6-d560b096d442","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6801","nonce":4023478848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6803","nonce":4023478848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6807","nonce":4023478848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6805","nonce":4023478848}]},"public_addr":"172.21.15.39:6801/4023478848","cluster_addr":"172.21.15.39:6803/4023478848","heartbeat_back_addr":"172.21.15.39:6807/4023478848","heartbeat_front_addr":"172.21.15.39:6805/4023478848","state":["exists","up"]},{"osd":1,"uuid":"93f91b0e-096e-4bdf-aed0-d1136f73f136","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6817","nonce":926357398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6819","nonce":926357398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6823","nonce":926357398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6821","nonce":926357398}]},"public_addr":"172.21.15.39:6817/926357398","cluster_addr":"172.21.15.39:6819/926357398","heartbeat_back_addr":"172.21.15.39:6823/926357398","heartbeat_front_addr":"172.21.15.39:6821/926357398","state":["exists","up"]},{"osd":2,"uuid":"c590b1e0-67eb-452e-8e80-d2208da17d09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6809","nonce":610616754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6811","nonce":610616754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6815","nonce":610616754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6813","nonce":610616754}]},"public_addr":"172.21.15.39:6809/610616754","cluster_addr":"172.21.15.39:6811/610616754","heartbeat_back_addr":"172.21.15.39:6815/610616754","heartbeat_front_addr":"172.21.15.39:6813/610616754","state":["exists","up"]},{"osd":3,"uuid":"d57661b0-44f6-4355-9115-83eceb9b8f71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6825","nonce":1469314579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6827","nonce":1469314579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6831","nonce":1469314579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6829","nonce":1469314579}]},"public_addr":"172.21.15.39:6825/1469314579","cluster_addr":"172.21.15.39:6827/1469314579","heartbeat_back_addr":"172.21.15.39:6831/1469314579","heartbeat_front_addr":"172.21.15.39:6829/1469314579","state":["exists","up"]},{"osd":4,"uuid":"b131436f-f6e1-4d72-a86e-de200afdcebb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6825","nonce":3481507129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6827","nonce":3481507129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6831","nonce":3481507129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6829","nonce":3481507129}]},"public_addr":"172.21.15.62:6825/3481507129","cluster_addr":"172.21.15.62:6827/3481507129","heartbeat_back_addr":"172.21.15.62:6831/3481507129","heartbeat_front_addr":"172.21.15.62:6829/3481507129","state":["exists","up"]},{"osd":5,"uuid":"12e10b40-28b1-410f-9ce0-7b427daa111e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6801","nonce":3291934116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6803","nonce":3291934116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6807","nonce":3291934116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6805","nonce":3291934116}]},"public_addr":"172.21.15.62:6801/3291934116","cluster_addr":"172.21.15.62:6803/3291934116","heartbeat_back_addr":"172.21.15.62:6807/3291934116","heartbeat_front_addr":"172.21.15.62:6805/3291934116","state":["exists","up"]},{"osd":6,"uuid":"ad8950a5-70bd-488c-8f29-010515cc4a04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6817","nonce":3005996101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6819","nonce":3005996101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6823","nonce":3005996101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6821","nonce":3005996101}]},"public_addr":"172.21.15.62:6817/3005996101","cluster_addr":"172.21.15.62:6819/3005996101","heartbeat_back_addr":"172.21.15.62:6823/3005996101","heartbeat_front_addr":"172.21.15.62:6821/3005996101","state":["exists","up"]},{"osd":7,"uuid":"e0d4b8b7-3c80-4760-a342-1d508cdecc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6809","nonce":2800379225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6811","nonce":2800379225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6815","nonce":2800379225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6813","nonce":2800379225}]},"public_addr":"172.21.15.62:6809/2800379225","cluster_addr":"172.21.15.62:6811/2800379225","heartbeat_back_addr":"172.21.15.62:6815/2800379225","heartbeat_front_addr":"172.21.15.62:6813/2800379225","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.773714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.760037+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.811225+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.752810+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.745165+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.700634+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.768477+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.747301+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T14:40:10.323 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.337+0000 7f415f50d640 1 -- 172.21.15.39:0/891275799 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f413c0762d0 msgr2=0x7f413c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:10.323 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.337+0000 7f415f50d640 1 --2- 172.21.15.39:0/891275799 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f413c0762d0 0x7f413c0787e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f41580b9830 tx=0x7f4148008040 comp rx=0 tx=0).stop 2024-05-14T14:40:10.323 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.337+0000 7f415f50d640 1 -- 172.21.15.39:0/891275799 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41580d0420 msgr2=0x7f41580b8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:10.323 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.337+0000 7f415f50d640 1 --2- 172.21.15.39:0/891275799 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41580d0420 0x7f41580b8080 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f415400c7f0 tx=0x7f415400ccb0 comp rx=0 tx=0).stop 2024-05-14T14:40:10.323 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.337+0000 7f415f50d640 1 -- 172.21.15.39:0/891275799 shutdown_connections 2024-05-14T14:40:10.323 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.337+0000 7f415f50d640 1 --2- 172.21.15.39:0/891275799 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f413c0762d0 0x7f413c0787e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:10.323 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.337+0000 7f415f50d640 1 --2- 172.21.15.39:0/891275799 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4158160800 0x7f41580c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:10.323 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.337+0000 7f415f50d640 1 --2- 172.21.15.39:0/891275799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41580d15e0 0x7f415814e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:10.323 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.337+0000 7f415f50d640 1 --2- 172.21.15.39:0/891275799 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f41580d0420 0x7f41580b8080 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:10.323 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.337+0000 7f415f50d640 1 -- 172.21.15.39:0/891275799 >> 172.21.15.39:0/891275799 conn(0x7f4158071660 msgr2=0x7f415806fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:10.323 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.338+0000 7f415f50d640 1 -- 172.21.15.39:0/891275799 shutdown_connections 2024-05-14T14:40:10.324 INFO:teuthology.misc.health.smithi039.stderr:2024-05-14T14:40:10.338+0000 7f415f50d640 1 -- 172.21.15.39:0/891275799 wait complete. 2024-05-14T14:40:10.333 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-14T14:40:10.333 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-14T14:40:10.333 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-14T14:40:10.333 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-14T14:40:10.336 INFO:tasks.ceph.mds.a:Started 2024-05-14T14:40:10.336 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-14T14:40:10.336 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-14T14:40:10.338 INFO:tasks.ceph.mds.c:Started 2024-05-14T14:40:10.338 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-14T14:40:10.339 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-14T14:40:10.341 INFO:tasks.ceph.mds.b:Started 2024-05-14T14:40:10.342 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-14T14:40:10.342 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-14T14:40:10.344 INFO:tasks.ceph.mds.d:Started 2024-05-14T14:40:10.344 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-14T14:40:10.344 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T14:40:10.426 INFO:tasks.ceph.mds.a.smithi039.stdout:starting mds.a at 2024-05-14T14:40:10.426 INFO:tasks.ceph.mds.c.smithi039.stdout:starting mds.c at 2024-05-14T14:40:10.446 INFO:tasks.ceph.mds.d.smithi062.stdout:starting mds.d at 2024-05-14T14:40:10.446 INFO:tasks.ceph.mds.b.smithi062.stdout:starting mds.b at 2024-05-14T14:40:10.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.480+0000 7ff7f1061640 1 Processor -- start 2024-05-14T14:40:10.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.480+0000 7ff7f1061640 1 -- start start 2024-05-14T14:40:10.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.482+0000 7ff7f1061640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff7ec0b4ec0 0x7ff7ec1602d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:10.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.482+0000 7ff7f1061640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff7ec0d15f0 0x7ff7ec06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:10.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.482+0000 7ff7f1061640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7ec0d5840 con 0x7ff7ec0d0ad0 2024-05-14T14:40:10.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.482+0000 7ff7f1061640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7ff7ec0d4d50 con 0x7ff7ec0b4ec0 2024-05-14T14:40:10.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.482+0000 7ff7f1061640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7ff7ec06c840 con 0x7ff7ec0d15f0 2024-05-14T14:40:10.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.482+0000 7ff7e3fff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7ff7ec0d0ad0 0x7ff7ec0d0ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:32952/0 (socket says 172.21.15.39:32952) 2024-05-14T14:40:10.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.482+0000 7ff7e3fff640 1 -- 172.21.15.39:0/4164438899 learned_addr learned my addr 172.21.15.39:0/4164438899 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:10.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.482+0000 7ff7ea59c640 1 -- 172.21.15.39:0/4164438899 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1083153182 0 0) 0x7ff7ec0d5840 con 0x7ff7ec0d0ad0 2024-05-14T14:40:10.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.482+0000 7ff7ea59c640 1 -- 172.21.15.39:0/4164438899 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7d8003520 con 0x7ff7ec0d0ad0 2024-05-14T14:40:10.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.482+0000 7ff7eb59e640 1 --2- 172.21.15.39:0/4164438899 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff7ec0d15f0 0x7ff7ec06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:10.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.482+0000 7ff7ead9d640 1 --2- 172.21.15.39:0/4164438899 >> v2:172.21.15.62:3300/0 conn(0x7ff7ec0b4ec0 0x7ff7ec1602d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:10.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.482+0000 7ff7ea59c640 1 -- 172.21.15.39:0/4164438899 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4281035663 0 0) 0x7ff7d8003520 con 0x7ff7ec0d0ad0 2024-05-14T14:40:10.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.482+0000 7ff7ea59c640 1 -- 172.21.15.39:0/4164438899 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff7ec0d15f0 msgr2=0x7ff7ec06ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:10.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.482+0000 7ff7ea59c640 1 --2- 172.21.15.39:0/4164438899 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff7ec0d15f0 0x7ff7ec06ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:10.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.482+0000 7ff7ea59c640 1 -- 172.21.15.39:0/4164438899 >> v2:172.21.15.62:3300/0 conn(0x7ff7ec0b4ec0 msgr2=0x7ff7ec1602d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:10.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.482+0000 7ff7ea59c640 1 --2- 172.21.15.39:0/4164438899 >> v2:172.21.15.62:3300/0 conn(0x7ff7ec0b4ec0 0x7ff7ec1602d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:10.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.482+0000 7ff7ea59c640 1 -- 172.21.15.39:0/4164438899 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7ec0d4fa0 con 0x7ff7ec0d0ad0 2024-05-14T14:40:10.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.482+0000 7ff7ea59c640 1 -- 172.21.15.39:0/4164438899 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1803005051 0 0) 0x7ff7d40016f0 con 0x7ff7ec0d0ad0 2024-05-14T14:40:10.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.482+0000 7ff7ea59c640 1 -- 172.21.15.39:0/4164438899 >> v1:172.21.15.39:6789/0 conn(0x7ff7ec0d0ad0 legacy=0x7ff7ec0d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:10.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.482+0000 7ff7ea59c640 1 --2- 172.21.15.39:0/4164438899 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff7ec0d15f0 0x7ff7d8003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:10.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.482+0000 7ff7ea59c640 1 --2- 172.21.15.39:0/4164438899 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7d8003fd0 0x7ff7d8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:10.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.482+0000 7ff7ea59c640 1 --2- 172.21.15.39:0/4164438899 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7d8004d40 0x7ff7d8005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:10.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.482+0000 7ff7ea59c640 1 -- 172.21.15.39:0/4164438899 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ec0d4d50 con 0x7ff7d8003fd0 2024-05-14T14:40:10.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.482+0000 7ff7ea59c640 1 -- 172.21.15.39:0/4164438899 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ec06c840 con 0x7ff7d8004d40 2024-05-14T14:40:10.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.482+0000 7ff7ea59c640 1 -- 172.21.15.39:0/4164438899 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7ff7d800bac0 con 0x7ff7ec0d15f0 2024-05-14T14:40:10.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.482+0000 7ff7e3fff640 1 --2- 172.21.15.39:0/4164438899 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7d8003fd0 0x7ff7d8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:10.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.483+0000 7ff7eb59e640 1 --2- 172.21.15.39:0/4164438899 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7d8004d40 0x7ff7d8005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:10.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.483+0000 7ff7ead9d640 1 --2- 172.21.15.39:0/4164438899 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff7ec0d15f0 0x7ff7d8003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:10.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.483+0000 7ff7e3fff640 1 -- 172.21.15.39:0/4164438899 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff7ec0d15f0 msgr2=0x7ff7d8003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:10.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.483+0000 7ff7e3fff640 1 --2- 172.21.15.39:0/4164438899 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff7ec0d15f0 0x7ff7d8003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:10.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.483+0000 7ff7e3fff640 1 -- 172.21.15.39:0/4164438899 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7d8004d40 msgr2=0x7ff7d8005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:10.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.483+0000 7ff7e3fff640 1 --2- 172.21.15.39:0/4164438899 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7d8004d40 0x7ff7d8005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:10.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.483+0000 7ff7e3fff640 1 -- 172.21.15.39:0/4164438899 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7d8003520 con 0x7ff7d8003fd0 2024-05-14T14:40:10.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.483+0000 7ff7e3fff640 1 --2- 172.21.15.39:0/4164438899 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7d8003fd0 0x7ff7d8004800 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff7d400c210 tx=0x7ff7d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a853cf3c0b485532 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:10.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.484+0000 7ff7ea59c640 1 -- 172.21.15.39:0/4164438899 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d4007d30 con 0x7ff7d8003fd0 2024-05-14T14:40:10.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.484+0000 7ff7ea59c640 1 -- 172.21.15.39:0/4164438899 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7d4005af0 con 0x7ff7d8003fd0 2024-05-14T14:40:10.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.484+0000 7ff7ea59c640 1 -- 172.21.15.39:0/4164438899 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d4007070 con 0x7ff7d8003fd0 2024-05-14T14:40:10.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.484+0000 7ff7f1061640 1 -- 172.21.15.39:0/4164438899 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7d8003fd0 msgr2=0x7ff7d8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:10.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.484+0000 7ff7f1061640 1 --2- 172.21.15.39:0/4164438899 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7d8003fd0 0x7ff7d8004800 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff7d400c210 tx=0x7ff7d8005830 comp rx=0 tx=0).stop 2024-05-14T14:40:10.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.484+0000 7ff7eb59e640 1 -- 172.21.15.39:0/4164438899 reap_dead start 2024-05-14T14:40:10.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.484+0000 7ff7f1061640 1 -- 172.21.15.39:0/4164438899 shutdown_connections 2024-05-14T14:40:10.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.484+0000 7ff7f1061640 1 -- 172.21.15.39:0/4164438899 >> 172.21.15.39:0/4164438899 conn(0x7ff7ec06f270 msgr2=0x7ff7ec0d5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:10.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.484+0000 7ff7f1061640 1 -- 172.21.15.39:0/4164438899 shutdown_connections 2024-05-14T14:40:10.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.484+0000 7ff7f1061640 1 -- 172.21.15.39:0/4164438899 wait complete. 2024-05-14T14:40:10.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.486+0000 7ff7f1061640 1 Processor -- start 2024-05-14T14:40:10.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.486+0000 7ff7f1061640 1 -- start start 2024-05-14T14:40:10.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.488+0000 7ff7f1061640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7d8003fd0 0x7ff7ec0ca170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:10.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.488+0000 7ff7f1061640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff7ec158c80 0x7ff7ec0cde90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:10.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.488+0000 7ff7f1061640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7ec0ce3d0 0x7ff7ec1f9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:10.475 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.488+0000 7ff7f1061640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ec0b5480 con 0x7ff7ec0ce3d0 2024-05-14T14:40:10.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.488+0000 7ff7f1061640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ec0d5560 con 0x7ff7d8003fd0 2024-05-14T14:40:10.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.488+0000 7ff7f1061640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7ff7ec06ccd0 con 0x7ff7ec158c80 2024-05-14T14:40:10.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.488+0000 7ff7eb59e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7ec0ce3d0 0x7ff7ec1f9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:10.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.488+0000 7ff7eb59e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7ec0ce3d0 0x7ff7ec1f9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34620/0 (socket says 172.21.15.39:34620) 2024-05-14T14:40:10.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.488+0000 7ff7eb59e640 1 -- 172.21.15.39:0/2089846423 learned_addr learned my addr 172.21.15.39:0/2089846423 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:10.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.488+0000 7ff7e3fff640 1 --2- 172.21.15.39:0/2089846423 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff7ec158c80 0x7ff7ec0cde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:10.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.488+0000 7ff7ead9d640 1 --2- 172.21.15.39:0/2089846423 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7d8003fd0 0x7ff7ec0ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:10.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.488+0000 7ff7eb59e640 1 -- 172.21.15.39:0/2089846423 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff7ec158c80 msgr2=0x7ff7ec0cde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:10.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.488+0000 7ff7eb59e640 1 --2- 172.21.15.39:0/2089846423 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff7ec158c80 0x7ff7ec0cde90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:10.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.488+0000 7ff7eb59e640 1 -- 172.21.15.39:0/2089846423 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7d8003fd0 msgr2=0x7ff7ec0ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:10.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.488+0000 7ff7eb59e640 1 --2- 172.21.15.39:0/2089846423 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7d8003fd0 0x7ff7ec0ca170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:10.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.488+0000 7ff7eb59e640 1 -- 172.21.15.39:0/2089846423 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7ec0ce7e0 con 0x7ff7ec0ce3d0 2024-05-14T14:40:10.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.488+0000 7ff7ead9d640 1 --2- 172.21.15.39:0/2089846423 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7d8003fd0 0x7ff7ec0ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:40:10.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.488+0000 7ff7eb59e640 1 --2- 172.21.15.39:0/2089846423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7ec0ce3d0 0x7ff7ec1f9e70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec08e6f0 tx=0x7ff7e400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:10.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.488+0000 7ff7e37fe640 1 -- 172.21.15.39:0/2089846423 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e400fde0 con 0x7ff7ec0ce3d0 2024-05-14T14:40:10.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.489+0000 7ff7e37fe640 1 -- 172.21.15.39:0/2089846423 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7e401d070 con 0x7ff7ec0ce3d0 2024-05-14T14:40:10.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.489+0000 7ff7f1061640 1 -- 172.21.15.39:0/2089846423 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7ec1f6c90 con 0x7ff7ec0ce3d0 2024-05-14T14:40:10.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.489+0000 7ff7e37fe640 1 -- 172.21.15.39:0/2089846423 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e4015670 con 0x7ff7ec0ce3d0 2024-05-14T14:40:10.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.489+0000 7ff7f1061640 1 -- 172.21.15.39:0/2089846423 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7ec1f7250 con 0x7ff7ec0ce3d0 2024-05-14T14:40:10.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.489+0000 7ff7f1061640 1 -- 172.21.15.39:0/2089846423 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7ec076aa0 con 0x7ff7ec0ce3d0 2024-05-14T14:40:10.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.490+0000 7ff7e37fe640 1 -- 172.21.15.39:0/2089846423 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff7e4015810 con 0x7ff7ec0ce3d0 2024-05-14T14:40:10.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.491+0000 7ff7e37fe640 1 --2- 172.21.15.39:0/2089846423 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7ff7cc076300 0x7ff7cc078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:10.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.491+0000 7ff7e37fe640 1 -- 172.21.15.39:0/2089846423 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7ff7e4097b80 con 0x7ff7ec0ce3d0 2024-05-14T14:40:10.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.491+0000 7ff7ead9d640 1 --2- 172.21.15.39:0/2089846423 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7ff7cc076300 0x7ff7cc078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:10.478 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.491+0000 7ff7ead9d640 1 --2- 172.21.15.39:0/2089846423 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7ff7cc076300 0x7ff7cc078810 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc009ab0 tx=0x7ff7dc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:10.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.496+0000 7ff7e37fe640 1 -- 172.21.15.39:0/2089846423 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff7ec0ce7e0 con 0x7ff7ec0ce3d0 2024-05-14T14:40:10.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.725+0000 7ff7f1061640 1 -- 172.21.15.39:0/2089846423 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff7ec1f7ab0 con 0x7ff7ec0ce3d0 2024-05-14T14:40:10.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.725+0000 7ff7e37fe640 1 -- 172.21.15.39:0/2089846423 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1386 (secure 0 0 0) 0x7ff7e4010040 con 0x7ff7ec0ce3d0 2024-05-14T14:40:10.711 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:40:10.711 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/97693396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6835","nonce":97693396},{"type":"v1","addr":"172.21.15.39:6837","nonce":97693396}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-14T14:40:10.711 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 2 2024-05-14T14:40:10.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.728+0000 7ff7f1061640 1 -- 172.21.15.39:0/2089846423 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7ff7cc076300 msgr2=0x7ff7cc078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:10.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.728+0000 7ff7f1061640 1 --2- 172.21.15.39:0/2089846423 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7ff7cc076300 0x7ff7cc078810 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc009ab0 tx=0x7ff7dc008040 comp rx=0 tx=0).stop 2024-05-14T14:40:10.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.728+0000 7ff7f1061640 1 -- 172.21.15.39:0/2089846423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7ec0ce3d0 msgr2=0x7ff7ec1f9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:10.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.728+0000 7ff7f1061640 1 --2- 172.21.15.39:0/2089846423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7ec0ce3d0 0x7ff7ec1f9e70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec08e6f0 tx=0x7ff7e400f580 comp rx=0 tx=0).stop 2024-05-14T14:40:10.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.728+0000 7ff7f1061640 1 -- 172.21.15.39:0/2089846423 shutdown_connections 2024-05-14T14:40:10.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.728+0000 7ff7f1061640 1 --2- 172.21.15.39:0/2089846423 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7ff7cc076300 0x7ff7cc078810 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:10.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.728+0000 7ff7f1061640 1 --2- 172.21.15.39:0/2089846423 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7ec0ce3d0 0x7ff7ec1f9e70 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:10.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.728+0000 7ff7f1061640 1 --2- 172.21.15.39:0/2089846423 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff7ec158c80 0x7ff7ec0cde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:10.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.728+0000 7ff7f1061640 1 --2- 172.21.15.39:0/2089846423 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7d8003fd0 0x7ff7ec0ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:10.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.728+0000 7ff7f1061640 1 -- 172.21.15.39:0/2089846423 >> 172.21.15.39:0/2089846423 conn(0x7ff7ec06f270 msgr2=0x7ff7ec0d57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:10.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.728+0000 7ff7f1061640 1 -- 172.21.15.39:0/2089846423 shutdown_connections 2024-05-14T14:40:10.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:10.728+0000 7ff7f1061640 1 -- 172.21.15.39:0/2089846423 wait complete. 2024-05-14T14:40:12.230 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:40:12.233 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:40:12.725 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T14:40:12.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.869+0000 7f168bd34640 1 Processor -- start 2024-05-14T14:40:12.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.870+0000 7f168bd34640 1 -- start start 2024-05-14T14:40:12.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.871+0000 7f168bd34640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1684160420 0x7f16840d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:12.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.871+0000 7f168bd34640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f16840d1140 0x7f168406d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:12.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.871+0000 7f168bd34640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f168406d5f0 0x7f16840d49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:12.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.871+0000 7f168bd34640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f16840b9310 con 0x7f1684160420 2024-05-14T14:40:12.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.871+0000 7f168bd34640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f16840d1550 con 0x7f168406d5f0 2024-05-14T14:40:12.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.871+0000 7f168bd34640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f168406dd70 con 0x7f16840d1140 2024-05-14T14:40:12.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.871+0000 7f1689ad0640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1684160420 0x7f16840d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:12.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.871+0000 7f1689ad0640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1684160420 0x7f16840d0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34632/0 (socket says 172.21.15.39:34632) 2024-05-14T14:40:12.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.871+0000 7f1689ad0640 1 -- 172.21.15.39:0/1461162312 learned_addr learned my addr 172.21.15.39:0/1461162312 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:12.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.871+0000 7f168a2d1640 1 --2- 172.21.15.39:0/1461162312 >> v2:172.21.15.62:3300/0 conn(0x7f168406d5f0 0x7f16840d49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:12.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.871+0000 7f16892cf640 1 --2- 172.21.15.39:0/1461162312 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f16840d1140 0x7f168406d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:12.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.871+0000 7f1689ad0640 1 -- 172.21.15.39:0/1461162312 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f16840d1140 msgr2=0x7f168406d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:12.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.871+0000 7f1689ad0640 1 --2- 172.21.15.39:0/1461162312 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f16840d1140 0x7f168406d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:12.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.871+0000 7f1689ad0640 1 -- 172.21.15.39:0/1461162312 >> v2:172.21.15.62:3300/0 conn(0x7f168406d5f0 msgr2=0x7f16840d49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:12.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.871+0000 7f1689ad0640 1 --2- 172.21.15.39:0/1461162312 >> v2:172.21.15.62:3300/0 conn(0x7f168406d5f0 0x7f16840d49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:12.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.871+0000 7f1689ad0640 1 -- 172.21.15.39:0/1461162312 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16840b9590 con 0x7f1684160420 2024-05-14T14:40:12.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.872+0000 7f1689ad0640 1 --2- 172.21.15.39:0/1461162312 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1684160420 0x7f16840d0c00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f16840ccd20 tx=0x7f168002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fa305ba7110764a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:12.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.872+0000 7f1688ace640 1 -- 172.21.15.39:0/1461162312 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1680037070 con 0x7f1684160420 2024-05-14T14:40:12.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.872+0000 7f1688ace640 1 -- 172.21.15.39:0/1461162312 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1680032440 con 0x7f1684160420 2024-05-14T14:40:12.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.872+0000 7f1688ace640 1 -- 172.21.15.39:0/1461162312 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1680032810 con 0x7f1684160420 2024-05-14T14:40:12.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.873+0000 7f168bd34640 1 -- 172.21.15.39:0/1461162312 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1684160420 msgr2=0x7f16840d0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:12.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.873+0000 7f168bd34640 1 --2- 172.21.15.39:0/1461162312 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1684160420 0x7f16840d0c00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f16840ccd20 tx=0x7f168002a140 comp rx=0 tx=0).stop 2024-05-14T14:40:12.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.873+0000 7f168bd34640 1 -- 172.21.15.39:0/1461162312 shutdown_connections 2024-05-14T14:40:12.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.873+0000 7f168bd34640 1 --2- 172.21.15.39:0/1461162312 >> v2:172.21.15.62:3300/0 conn(0x7f168406d5f0 0x7f16840d49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:12.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.873+0000 7f168bd34640 1 --2- 172.21.15.39:0/1461162312 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f16840d1140 0x7f168406d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:12.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.873+0000 7f168bd34640 1 --2- 172.21.15.39:0/1461162312 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1684160420 0x7f16840d0c00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:12.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.873+0000 7f168bd34640 1 -- 172.21.15.39:0/1461162312 >> 172.21.15.39:0/1461162312 conn(0x7f16840d27d0 msgr2=0x7f16840d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:12.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.873+0000 7f168bd34640 1 -- 172.21.15.39:0/1461162312 shutdown_connections 2024-05-14T14:40:12.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.873+0000 7f168bd34640 1 -- 172.21.15.39:0/1461162312 wait complete. 2024-05-14T14:40:12.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.875+0000 7f168bd34640 1 Processor -- start 2024-05-14T14:40:12.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.875+0000 7f168bd34640 1 -- start start 2024-05-14T14:40:12.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.876+0000 7f168bd34640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f168406d5f0 0x7f1684146fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:12.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.876+0000 7f168bd34640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16840d1140 0x7f1684148f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:12.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.876+0000 7f168bd34640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1684160420 0x7f16840c9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:12.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.876+0000 7f168bd34640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1684160830 con 0x7f16840d1140 2024-05-14T14:40:12.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.876+0000 7f168bd34640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f16840b9b50 con 0x7f168406d5f0 2024-05-14T14:40:12.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.876+0000 7f168bd34640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f168406da00 con 0x7f1684160420 2024-05-14T14:40:12.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.877+0000 7f16892cf640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16840d1140 0x7f1684148f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:12.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.877+0000 7f16892cf640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16840d1140 0x7f1684148f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34648/0 (socket says 172.21.15.39:34648) 2024-05-14T14:40:12.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.877+0000 7f16892cf640 1 -- 172.21.15.39:0/57528990 learned_addr learned my addr 172.21.15.39:0/57528990 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:12.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.877+0000 7f1689ad0640 1 --2- 172.21.15.39:0/57528990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f168406d5f0 0x7f1684146fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:12.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.877+0000 7f168a2d1640 1 --2- 172.21.15.39:0/57528990 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1684160420 0x7f16840c9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:12.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.877+0000 7f16892cf640 1 -- 172.21.15.39:0/57528990 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1684160420 msgr2=0x7f16840c9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:12.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.877+0000 7f16892cf640 1 --2- 172.21.15.39:0/57528990 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1684160420 0x7f16840c9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:12.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.877+0000 7f16892cf640 1 -- 172.21.15.39:0/57528990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f168406d5f0 msgr2=0x7f1684146fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:12.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.877+0000 7f16892cf640 1 --2- 172.21.15.39:0/57528990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f168406d5f0 0x7f1684146fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:12.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.877+0000 7f16892cf640 1 -- 172.21.15.39:0/57528990 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1684147ee0 con 0x7f16840d1140 2024-05-14T14:40:12.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.877+0000 7f16892cf640 1 --2- 172.21.15.39:0/57528990 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16840d1140 0x7f1684148f80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f167400d620 tx=0x7f167400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:12.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.877+0000 7f167a7fc640 1 -- 172.21.15.39:0/57528990 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16740125f0 con 0x7f16840d1140 2024-05-14T14:40:12.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.877+0000 7f167a7fc640 1 -- 172.21.15.39:0/57528990 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1674019070 con 0x7f16840d1140 2024-05-14T14:40:12.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.877+0000 7f168bd34640 1 -- 172.21.15.39:0/57528990 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16841481c0 con 0x7f16840d1140 2024-05-14T14:40:12.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.877+0000 7f167a7fc640 1 -- 172.21.15.39:0/57528990 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16740129d0 con 0x7f16840d1140 2024-05-14T14:40:12.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.877+0000 7f168bd34640 1 -- 172.21.15.39:0/57528990 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1684148780 con 0x7f16840d1140 2024-05-14T14:40:12.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.879+0000 7f168bd34640 1 -- 172.21.15.39:0/57528990 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1684076aa0 con 0x7f16840d1140 2024-05-14T14:40:12.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.879+0000 7f167a7fc640 1 -- 172.21.15.39:0/57528990 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1674012b70 con 0x7f16840d1140 2024-05-14T14:40:12.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.880+0000 7f167a7fc640 1 --2- 172.21.15.39:0/57528990 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1668076300 0x7f1668078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:12.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.880+0000 7f1689ad0640 1 --2- 172.21.15.39:0/57528990 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1668076300 0x7f1668078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:12.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.880+0000 7f167a7fc640 1 -- 172.21.15.39:0/57528990 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f1674097500 con 0x7f16840d1140 2024-05-14T14:40:12.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.881+0000 7f1689ad0640 1 --2- 172.21.15.39:0/57528990 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1668076300 0x7f1668078810 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1680034000 tx=0x7f168002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:12.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:12.885+0000 7f167a7fc640 1 -- 172.21.15.39:0/57528990 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1674060b60 con 0x7f16840d1140 2024-05-14T14:40:13.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.114+0000 7f168bd34640 1 -- 172.21.15.39:0/57528990 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1684069030 con 0x7f16840d1140 2024-05-14T14:40:13.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.115+0000 7f167a7fc640 1 -- 172.21.15.39:0/57528990 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3858 (secure 0 0 0) 0x7f1674064e60 con 0x7f16840d1140 2024-05-14T14:40:13.100 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:40:13.100 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/3753262818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3753262818},{"type":"v1","addr":"172.21.15.62:6834","nonce":3753262818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/97693396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6835","nonce":97693396},{"type":"v1","addr":"172.21.15.39:6837","nonce":97693396}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6836/1648047942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":1648047942},{"type":"v1","addr":"172.21.15.39:6836","nonce":1648047942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/1519798364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":1519798364},{"type":"v1","addr":"172.21.15.62:6835","nonce":1519798364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-14T14:40:13.101 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 3 2024-05-14T14:40:13.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.117+0000 7f168bd34640 1 -- 172.21.15.39:0/57528990 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1668076300 msgr2=0x7f1668078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:13.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.117+0000 7f168bd34640 1 --2- 172.21.15.39:0/57528990 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1668076300 0x7f1668078810 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1680034000 tx=0x7f168002e000 comp rx=0 tx=0).stop 2024-05-14T14:40:13.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.117+0000 7f168bd34640 1 -- 172.21.15.39:0/57528990 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16840d1140 msgr2=0x7f1684148f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:13.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.117+0000 7f168bd34640 1 --2- 172.21.15.39:0/57528990 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16840d1140 0x7f1684148f80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f167400d620 tx=0x7f167400dae0 comp rx=0 tx=0).stop 2024-05-14T14:40:13.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.117+0000 7f168bd34640 1 -- 172.21.15.39:0/57528990 shutdown_connections 2024-05-14T14:40:13.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.117+0000 7f168bd34640 1 --2- 172.21.15.39:0/57528990 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1668076300 0x7f1668078810 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:13.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.117+0000 7f168bd34640 1 --2- 172.21.15.39:0/57528990 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1684160420 0x7f16840c9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:13.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.117+0000 7f168bd34640 1 --2- 172.21.15.39:0/57528990 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f16840d1140 0x7f1684148f80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:13.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.117+0000 7f168bd34640 1 --2- 172.21.15.39:0/57528990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f168406d5f0 0x7f1684146fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:13.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.117+0000 7f168bd34640 1 -- 172.21.15.39:0/57528990 >> 172.21.15.39:0/57528990 conn(0x7f16840d27d0 msgr2=0x7f168406cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:13.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.117+0000 7f168bd34640 1 -- 172.21.15.39:0/57528990 shutdown_connections 2024-05-14T14:40:13.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.117+0000 7f168bd34640 1 -- 172.21.15.39:0/57528990 wait complete. 2024-05-14T14:40:13.113 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-14T14:40:13.227 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.242+0000 7fe0d0786640 1 Processor -- start 2024-05-14T14:40:13.228 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.242+0000 7fe0d0786640 1 -- start start 2024-05-14T14:40:13.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.244+0000 7fe0d0786640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe0c80d3e40 0x7fe0c806c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:13.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.244+0000 7fe0d0786640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe0c80b9190 0x7fe0c80b95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:13.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.244+0000 7fe0d0786640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0c806df90 con 0x7fe0c80d09e0 2024-05-14T14:40:13.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.244+0000 7fe0d0786640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fe0c806db00 con 0x7fe0c80d3e40 2024-05-14T14:40:13.230 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.244+0000 7fe0d0786640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fe0c806cef0 con 0x7fe0c80b9190 2024-05-14T14:40:13.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.244+0000 7fe0ce522640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe0c80d3e40 0x7fe0c806c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:13.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.244+0000 7fe0ce522640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe0c80d3e40 0x7fe0c806c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34662/0 (socket says 172.21.15.39:34662) 2024-05-14T14:40:13.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.244+0000 7fe0ce522640 1 -- 172.21.15.39:0/3272359259 learned_addr learned my addr 172.21.15.39:0/3272359259 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:13.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.244+0000 7fe0ced23640 1 --2- 172.21.15.39:0/3272359259 >> v2:172.21.15.62:3300/0 conn(0x7fe0c80b9190 0x7fe0c80b95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:13.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.244+0000 7fe0ce522640 1 -- 172.21.15.39:0/3272359259 >> v2:172.21.15.62:3300/0 conn(0x7fe0c80b9190 msgr2=0x7fe0c80b95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:13.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.244+0000 7fe0ce522640 1 --2- 172.21.15.39:0/3272359259 >> v2:172.21.15.62:3300/0 conn(0x7fe0c80b9190 0x7fe0c80b95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:13.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.244+0000 7fe0ce522640 1 -- 172.21.15.39:0/3272359259 >> v1:172.21.15.62:6789/0 conn(0x7fe0c80d09e0 legacy=0x7fe0c80d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:13.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.244+0000 7fe0ce522640 1 -- 172.21.15.39:0/3272359259 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c806d1d0 con 0x7fe0c80d3e40 2024-05-14T14:40:13.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.244+0000 7fe0ced23640 1 --2- 172.21.15.39:0/3272359259 >> v2:172.21.15.62:3300/0 conn(0x7fe0c80b9190 0x7fe0c80b95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:40:13.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.245+0000 7fe0ce522640 1 --2- 172.21.15.39:0/3272359259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0c80d3e40 0x7fe0c806c6a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe0c80b8f60 tx=0x7fe0b802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75760054d649584d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:13.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.245+0000 7fe0cd520640 1 -- 172.21.15.39:0/3272359259 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b8036070 con 0x7fe0c80d3e40 2024-05-14T14:40:13.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.245+0000 7fe0cd520640 1 -- 172.21.15.39:0/3272359259 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0b8031600 con 0x7fe0c80d3e40 2024-05-14T14:40:13.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.245+0000 7fe0cd520640 1 -- 172.21.15.39:0/3272359259 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b80319d0 con 0x7fe0c80d3e40 2024-05-14T14:40:13.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.246+0000 7fe0d0786640 1 -- 172.21.15.39:0/3272359259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0c80d3e40 msgr2=0x7fe0c806c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:13.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.246+0000 7fe0d0786640 1 --2- 172.21.15.39:0/3272359259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0c80d3e40 0x7fe0c806c6a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe0c80b8f60 tx=0x7fe0b802a610 comp rx=0 tx=0).stop 2024-05-14T14:40:13.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.246+0000 7fe0d0786640 1 -- 172.21.15.39:0/3272359259 shutdown_connections 2024-05-14T14:40:13.232 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.246+0000 7fe0d0786640 1 --2- 172.21.15.39:0/3272359259 >> v2:172.21.15.62:3300/0 conn(0x7fe0c80b9190 0x7fe0c80b95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:13.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.246+0000 7fe0d0786640 1 --2- 172.21.15.39:0/3272359259 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0c80d3e40 0x7fe0c806c6a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:13.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.246+0000 7fe0d0786640 1 -- 172.21.15.39:0/3272359259 >> 172.21.15.39:0/3272359259 conn(0x7fe0c80d2eb0 msgr2=0x7fe0c80d5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:13.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.246+0000 7fe0d0786640 1 -- 172.21.15.39:0/3272359259 shutdown_connections 2024-05-14T14:40:13.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.246+0000 7fe0d0786640 1 -- 172.21.15.39:0/3272359259 wait complete. 2024-05-14T14:40:13.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.248+0000 7fe0d0786640 1 Processor -- start 2024-05-14T14:40:13.233 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.248+0000 7fe0d0786640 1 -- start start 2024-05-14T14:40:13.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.249+0000 7fe0d0786640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0c80b9190 0x7fe0c81e9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:13.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.249+0000 7fe0d0786640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0c80d09e0 0x7fe0c81e9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:13.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.249+0000 7fe0d0786640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe0c80d3e40 0x7fe0c80c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:13.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.249+0000 7fe0d0786640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c806cbe0 con 0x7fe0c80d09e0 2024-05-14T14:40:13.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.249+0000 7fe0d0786640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c806d790 con 0x7fe0c80b9190 2024-05-14T14:40:13.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.249+0000 7fe0d0786640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe0c8160590 con 0x7fe0c80d3e40 2024-05-14T14:40:13.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.249+0000 7fe0cdd21640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0c80d09e0 0x7fe0c81e9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:13.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.249+0000 7fe0cdd21640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0c80d09e0 0x7fe0c81e9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34672/0 (socket says 172.21.15.39:34672) 2024-05-14T14:40:13.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.249+0000 7fe0cdd21640 1 -- 172.21.15.39:0/1091335069 learned_addr learned my addr 172.21.15.39:0/1091335069 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:13.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.249+0000 7fe0ce522640 1 --2- 172.21.15.39:0/1091335069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0c80b9190 0x7fe0c81e9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:13.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.249+0000 7fe0ced23640 1 --2- 172.21.15.39:0/1091335069 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe0c80d3e40 0x7fe0c80c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:13.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.250+0000 7fe0cdd21640 1 -- 172.21.15.39:0/1091335069 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe0c80d3e40 msgr2=0x7fe0c80c97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:13.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.250+0000 7fe0cdd21640 1 --2- 172.21.15.39:0/1091335069 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe0c80d3e40 0x7fe0c80c97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:13.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.250+0000 7fe0cdd21640 1 -- 172.21.15.39:0/1091335069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0c80b9190 msgr2=0x7fe0c81e9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:13.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.250+0000 7fe0cdd21640 1 --2- 172.21.15.39:0/1091335069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0c80b9190 0x7fe0c81e9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:13.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.250+0000 7fe0cdd21640 1 -- 172.21.15.39:0/1091335069 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c81ea1d0 con 0x7fe0c80d09e0 2024-05-14T14:40:13.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.250+0000 7fe0ced23640 1 --2- 172.21.15.39:0/1091335069 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe0c80d3e40 0x7fe0c80c97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:40:13.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.250+0000 7fe0cdd21640 1 --2- 172.21.15.39:0/1091335069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0c80d09e0 0x7fe0c81e9770 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc00b3f0 tx=0x7fe0bc00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:13.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.250+0000 7fe0c6ffd640 1 -- 172.21.15.39:0/1091335069 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc015020 con 0x7fe0c80d09e0 2024-05-14T14:40:13.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.250+0000 7fe0c6ffd640 1 -- 172.21.15.39:0/1091335069 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0bc011830 con 0x7fe0c80d09e0 2024-05-14T14:40:13.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.250+0000 7fe0d0786640 1 -- 172.21.15.39:0/1091335069 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0c81ea4b0 con 0x7fe0c80d09e0 2024-05-14T14:40:13.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.250+0000 7fe0c6ffd640 1 -- 172.21.15.39:0/1091335069 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc011c20 con 0x7fe0c80d09e0 2024-05-14T14:40:13.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.250+0000 7fe0d0786640 1 -- 172.21.15.39:0/1091335069 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0c81f6540 con 0x7fe0c80d09e0 2024-05-14T14:40:13.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.251+0000 7fe0d0786640 1 -- 172.21.15.39:0/1091335069 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0c806c6a0 con 0x7fe0c80d09e0 2024-05-14T14:40:13.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.252+0000 7fe0c6ffd640 1 -- 172.21.15.39:0/1091335069 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe0bc018020 con 0x7fe0c80d09e0 2024-05-14T14:40:13.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.252+0000 7fe0c6ffd640 1 --2- 172.21.15.39:0/1091335069 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe0b40762d0 0x7fe0b40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:13.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.252+0000 7fe0c6ffd640 1 -- 172.21.15.39:0/1091335069 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fe0bc096e60 con 0x7fe0c80d09e0 2024-05-14T14:40:13.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.252+0000 7fe0ce522640 1 --2- 172.21.15.39:0/1091335069 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe0b40762d0 0x7fe0b40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:13.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.253+0000 7fe0ce522640 1 --2- 172.21.15.39:0/1091335069 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe0b40762d0 0x7fe0b40787e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe0b8033000 tx=0x7fe0b8009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:13.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.257+0000 7fe0c6ffd640 1 -- 172.21.15.39:0/1091335069 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe0c806c6a0 con 0x7fe0c80d09e0 2024-05-14T14:40:13.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.450+0000 7fe0d0786640 1 -- 172.21.15.39:0/1091335069 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fe0c8076aa0 con 0x7fe0c80d09e0 2024-05-14T14:40:13.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.451+0000 7fe0c6ffd640 1 -- 172.21.15.39:0/1091335069 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7fe0bc01f030 con 0x7fe0c80d09e0 2024-05-14T14:40:13.436 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:40:13.436 INFO:teuthology.orchestra.run.smithi039.stdout:[ 2024-05-14T14:40:13.436 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-14T14:40:13.436 INFO:teuthology.orchestra.run.smithi039.stdout: "poolnum": 1, 2024-05-14T14:40:13.436 INFO:teuthology.orchestra.run.smithi039.stdout: "poolname": ".mgr" 2024-05-14T14:40:13.436 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-14T14:40:13.437 INFO:teuthology.orchestra.run.smithi039.stdout:] 2024-05-14T14:40:13.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.453+0000 7fe0d0786640 1 -- 172.21.15.39:0/1091335069 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe0b40762d0 msgr2=0x7fe0b40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:13.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.453+0000 7fe0d0786640 1 --2- 172.21.15.39:0/1091335069 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe0b40762d0 0x7fe0b40787e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe0b8033000 tx=0x7fe0b8009000 comp rx=0 tx=0).stop 2024-05-14T14:40:13.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.453+0000 7fe0d0786640 1 -- 172.21.15.39:0/1091335069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0c80d09e0 msgr2=0x7fe0c81e9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:13.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.453+0000 7fe0d0786640 1 --2- 172.21.15.39:0/1091335069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0c80d09e0 0x7fe0c81e9770 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc00b3f0 tx=0x7fe0bc00b8b0 comp rx=0 tx=0).stop 2024-05-14T14:40:13.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.453+0000 7fe0d0786640 1 -- 172.21.15.39:0/1091335069 shutdown_connections 2024-05-14T14:40:13.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.453+0000 7fe0d0786640 1 --2- 172.21.15.39:0/1091335069 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe0b40762d0 0x7fe0b40787e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:13.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.453+0000 7fe0d0786640 1 --2- 172.21.15.39:0/1091335069 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe0c80d3e40 0x7fe0c80c97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:13.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.453+0000 7fe0d0786640 1 --2- 172.21.15.39:0/1091335069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe0c80d09e0 0x7fe0c81e9770 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:13.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.453+0000 7fe0d0786640 1 --2- 172.21.15.39:0/1091335069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0c80b9190 0x7fe0c81e9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:13.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.453+0000 7fe0d0786640 1 -- 172.21.15.39:0/1091335069 >> 172.21.15.39:0/1091335069 conn(0x7fe0c80d2eb0 msgr2=0x7fe0c80bb130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:13.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.453+0000 7fe0d0786640 1 -- 172.21.15.39:0/1091335069 shutdown_connections 2024-05-14T14:40:13.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.453+0000 7fe0d0786640 1 -- 172.21.15.39:0/1091335069 wait complete. 2024-05-14T14:40:13.449 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-14T14:40:13.449 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-14T14:40:13.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.582+0000 7f62fa772640 1 Processor -- start 2024-05-14T14:40:13.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.582+0000 7f62fa772640 1 -- start start 2024-05-14T14:40:13.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.584+0000 7f62fa772640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f62f40d3ee0 0x7f62f41602e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:13.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.584+0000 7f62fa772640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62f406d010 con 0x7f62f406c6a0 2024-05-14T14:40:13.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.584+0000 7f62fa772640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62f406d2f0 con 0x7f62f40d1190 2024-05-14T14:40:13.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.584+0000 7f62fa772640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f62f406d5d0 con 0x7f62f40d3ee0 2024-05-14T14:40:13.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.584+0000 7f62ebfff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f62f406c6a0 0x7f62f40d0a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:32958/0 (socket says 172.21.15.39:32958) 2024-05-14T14:40:13.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.584+0000 7f62ebfff640 1 -- 172.21.15.39:0/3093717054 learned_addr learned my addr 172.21.15.39:0/3093717054 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:13.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.584+0000 7f62f3fff640 1 --2- 172.21.15.39:0/3093717054 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f62f40d3ee0 0x7f62f41602e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:13.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.584+0000 7f62f37fe640 1 -- 172.21.15.39:0/3093717054 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3730591881 0 0) 0x7f62f406d010 con 0x7f62f406c6a0 2024-05-14T14:40:13.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.584+0000 7f62f37fe640 1 -- 172.21.15.39:0/3093717054 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62e0003520 con 0x7f62f406c6a0 2024-05-14T14:40:13.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.584+0000 7f62f37fe640 1 -- 172.21.15.39:0/3093717054 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3443044168 0 0) 0x7f62f406d2f0 con 0x7f62f40d1190 2024-05-14T14:40:13.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.584+0000 7f62f37fe640 1 -- 172.21.15.39:0/3093717054 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62f406d010 con 0x7f62f40d1190 2024-05-14T14:40:13.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.584+0000 7f62f37fe640 1 -- 172.21.15.39:0/3093717054 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4060708690 0 0) 0x7f62e0003520 con 0x7f62f406c6a0 2024-05-14T14:40:13.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.584+0000 7f62f37fe640 1 -- 172.21.15.39:0/3093717054 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f62f40d3ee0 msgr2=0x7f62f41602e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:13.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.584+0000 7f62f37fe640 1 --2- 172.21.15.39:0/3093717054 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f62f40d3ee0 0x7f62f41602e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:13.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.584+0000 7f62f37fe640 1 -- 172.21.15.39:0/3093717054 >> v1:172.21.15.62:6789/0 conn(0x7f62f40d1190 legacy=0x7f62f40b9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:13.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.584+0000 7f62f37fe640 1 -- 172.21.15.39:0/3093717054 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f406d8b0 con 0x7f62f406c6a0 2024-05-14T14:40:13.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.584+0000 7f62f37fe640 1 -- 172.21.15.39:0/3093717054 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1803005051 0 0) 0x7f62dc0016f0 con 0x7f62f406c6a0 2024-05-14T14:40:13.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.584+0000 7f62f3fff640 1 --2- 172.21.15.39:0/3093717054 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f62f40d3ee0 0x7f62f41602e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T14:40:13.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.584+0000 7f62f37fe640 1 -- 172.21.15.39:0/3093717054 >> v1:172.21.15.39:6789/0 conn(0x7f62f406c6a0 legacy=0x7f62f40d0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:13.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.585+0000 7f62f37fe640 1 --2- 172.21.15.39:0/3093717054 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f62f40d3ee0 0x7f62e0003c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:13.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.585+0000 7f62f37fe640 1 --2- 172.21.15.39:0/3093717054 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62e00041c0 0x7f62e0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:13.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.585+0000 7f62f37fe640 1 --2- 172.21.15.39:0/3093717054 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62e0004d90 0x7f62e0005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:13.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.585+0000 7f62f37fe640 1 -- 172.21.15.39:0/3093717054 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f62f406d5d0 con 0x7f62e00041c0 2024-05-14T14:40:13.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.585+0000 7f62f37fe640 1 -- 172.21.15.39:0/3093717054 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f62e000bc20 con 0x7f62e0004d90 2024-05-14T14:40:13.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.585+0000 7f62f37fe640 1 -- 172.21.15.39:0/3093717054 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f62e000be20 con 0x7f62f40d3ee0 2024-05-14T14:40:13.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.585+0000 7f62ebfff640 1 --2- 172.21.15.39:0/3093717054 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62e00041c0 0x7f62e0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:13.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.585+0000 7f62f3fff640 1 --2- 172.21.15.39:0/3093717054 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f62f40d3ee0 0x7f62e0003c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:13.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.585+0000 7f62f8d0f640 1 --2- 172.21.15.39:0/3093717054 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62e0004d90 0x7f62e0005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:13.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.585+0000 7f62ebfff640 1 -- 172.21.15.39:0/3093717054 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f62f40d3ee0 msgr2=0x7f62e0003c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:13.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.585+0000 7f62ebfff640 1 --2- 172.21.15.39:0/3093717054 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f62f40d3ee0 0x7f62e0003c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:13.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.585+0000 7f62ebfff640 1 -- 172.21.15.39:0/3093717054 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62e0004d90 msgr2=0x7f62e0005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:13.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.585+0000 7f62ebfff640 1 --2- 172.21.15.39:0/3093717054 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62e0004d90 0x7f62e0005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:13.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.585+0000 7f62ebfff640 1 -- 172.21.15.39:0/3093717054 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e0003520 con 0x7f62e00041c0 2024-05-14T14:40:13.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.585+0000 7f62f8d0f640 1 --2- 172.21.15.39:0/3093717054 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62e0004d90 0x7f62e0005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:40:13.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.586+0000 7f62ebfff640 1 --2- 172.21.15.39:0/3093717054 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62e00041c0 0x7f62e0004800 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f62dc007fd0 tx=0x7f62e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e49dfae9ed13c0a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:13.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.586+0000 7f62f37fe640 1 -- 172.21.15.39:0/3093717054 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62dc007ca0 con 0x7f62e00041c0 2024-05-14T14:40:13.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.586+0000 7f62f37fe640 1 -- 172.21.15.39:0/3093717054 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62dc005af0 con 0x7f62e00041c0 2024-05-14T14:40:13.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.586+0000 7f62f37fe640 1 -- 172.21.15.39:0/3093717054 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62dc007070 con 0x7f62e00041c0 2024-05-14T14:40:13.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.587+0000 7f62fa772640 1 -- 172.21.15.39:0/3093717054 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62e00041c0 msgr2=0x7f62e0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:13.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.587+0000 7f62fa772640 1 --2- 172.21.15.39:0/3093717054 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62e00041c0 0x7f62e0004800 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f62dc007fd0 tx=0x7f62e0005830 comp rx=0 tx=0).stop 2024-05-14T14:40:13.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.587+0000 7f62f8d0f640 1 -- 172.21.15.39:0/3093717054 reap_dead start 2024-05-14T14:40:13.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.587+0000 7f62fa772640 1 -- 172.21.15.39:0/3093717054 shutdown_connections 2024-05-14T14:40:13.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.587+0000 7f62fa772640 1 -- 172.21.15.39:0/3093717054 >> 172.21.15.39:0/3093717054 conn(0x7f62f40b7730 msgr2=0x7f62f40b7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:13.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.587+0000 7f62fa772640 1 -- 172.21.15.39:0/3093717054 shutdown_connections 2024-05-14T14:40:13.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.587+0000 7f62fa772640 1 -- 172.21.15.39:0/3093717054 wait complete. 2024-05-14T14:40:13.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.588+0000 7f62fa772640 1 Processor -- start 2024-05-14T14:40:13.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.588+0000 7f62fa772640 1 -- start start 2024-05-14T14:40:13.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.590+0000 7f62fa772640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62e00041c0 0x7f62f4155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:13.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.590+0000 7f62fa772640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f62f41580f0 0x7f62f4158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:13.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.590+0000 7f62fa772640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62f415b260 0x7f62f415b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:13.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.590+0000 7f62fa772640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f62f406cc30 con 0x7f62e00041c0 2024-05-14T14:40:13.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.590+0000 7f62fa772640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f62f406cab0 con 0x7f62f415b260 2024-05-14T14:40:13.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.590+0000 7f62fa772640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f62f406cdb0 con 0x7f62f41580f0 2024-05-14T14:40:13.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.590+0000 7f62f3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62e00041c0 0x7f62f4155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:13.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.590+0000 7f62f3fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62e00041c0 0x7f62f4155160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34688/0 (socket says 172.21.15.39:34688) 2024-05-14T14:40:13.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.590+0000 7f62f3fff640 1 -- 172.21.15.39:0/2745029263 learned_addr learned my addr 172.21.15.39:0/2745029263 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:13.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.590+0000 7f62ebfff640 1 --2- 172.21.15.39:0/2745029263 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f62f41580f0 0x7f62f4158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:13.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.590+0000 7f62f8d0f640 1 --2- 172.21.15.39:0/2745029263 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62f415b260 0x7f62f415b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:13.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.590+0000 7f62f3fff640 1 -- 172.21.15.39:0/2745029263 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f62f41580f0 msgr2=0x7f62f4158500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:13.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.590+0000 7f62f3fff640 1 --2- 172.21.15.39:0/2745029263 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f62f41580f0 0x7f62f4158500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:13.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.590+0000 7f62f3fff640 1 -- 172.21.15.39:0/2745029263 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62f415b260 msgr2=0x7f62f415b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:13.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.590+0000 7f62f3fff640 1 --2- 172.21.15.39:0/2745029263 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62f415b260 0x7f62f415b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:13.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.590+0000 7f62f3fff640 1 -- 172.21.15.39:0/2745029263 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f415bbb0 con 0x7f62e00041c0 2024-05-14T14:40:13.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.590+0000 7f62f8d0f640 1 --2- 172.21.15.39:0/2745029263 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62f415b260 0x7f62f415b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:40:13.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.590+0000 7f62f3fff640 1 --2- 172.21.15.39:0/2745029263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62e00041c0 0x7f62f4155160 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f62e40119d0 tx=0x7f62e4011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:13.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.590+0000 7f62f17fa640 1 -- 172.21.15.39:0/2745029263 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e400faf0 con 0x7f62e00041c0 2024-05-14T14:40:13.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.591+0000 7f62f17fa640 1 -- 172.21.15.39:0/2745029263 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62e400fc90 con 0x7f62e00041c0 2024-05-14T14:40:13.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.591+0000 7f62fa772640 1 -- 172.21.15.39:0/2745029263 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62f40ca940 con 0x7f62e00041c0 2024-05-14T14:40:13.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.591+0000 7f62f17fa640 1 -- 172.21.15.39:0/2745029263 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e4014440 con 0x7f62e00041c0 2024-05-14T14:40:13.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.591+0000 7f62fa772640 1 -- 172.21.15.39:0/2745029263 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62f40c9b80 con 0x7f62e00041c0 2024-05-14T14:40:13.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.592+0000 7f62fa772640 1 -- 172.21.15.39:0/2745029263 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62f4076aa0 con 0x7f62e00041c0 2024-05-14T14:40:13.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.592+0000 7f62f17fa640 1 -- 172.21.15.39:0/2745029263 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f62e4012040 con 0x7f62e00041c0 2024-05-14T14:40:13.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.593+0000 7f62f17fa640 1 --2- 172.21.15.39:0/2745029263 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f62d40762d0 0x7f62d40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:13.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.593+0000 7f62f17fa640 1 -- 172.21.15.39:0/2745029263 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f62e4097870 con 0x7f62e00041c0 2024-05-14T14:40:13.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.593+0000 7f62ebfff640 1 --2- 172.21.15.39:0/2745029263 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f62d40762d0 0x7f62d40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:13.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.593+0000 7f62ebfff640 1 --2- 172.21.15.39:0/2745029263 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f62d40762d0 0x7f62d40787e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f62dc032000 tx=0x7f62dc009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:13.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.597+0000 7f62f17fa640 1 -- 172.21.15.39:0/2745029263 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f62f415bbb0 con 0x7f62e00041c0 2024-05-14T14:40:13.774 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.789+0000 7f62fa772640 1 -- 172.21.15.39:0/2745029263 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f62f40d1390 con 0x7f62e00041c0 2024-05-14T14:40:13.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.920+0000 7f62f17fa640 1 -- 172.21.15.39:0/2745029263 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7f62e4019030 con 0x7f62e00041c0 2024-05-14T14:40:13.908 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_metadata' created 2024-05-14T14:40:13.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.922+0000 7f62fa772640 1 -- 172.21.15.39:0/2745029263 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f62d40762d0 msgr2=0x7f62d40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:13.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.922+0000 7f62fa772640 1 --2- 172.21.15.39:0/2745029263 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f62d40762d0 0x7f62d40787e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f62dc032000 tx=0x7f62dc009030 comp rx=0 tx=0).stop 2024-05-14T14:40:13.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.922+0000 7f62fa772640 1 -- 172.21.15.39:0/2745029263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62e00041c0 msgr2=0x7f62f4155160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:13.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.922+0000 7f62fa772640 1 --2- 172.21.15.39:0/2745029263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62e00041c0 0x7f62f4155160 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f62e40119d0 tx=0x7f62e4011e90 comp rx=0 tx=0).stop 2024-05-14T14:40:13.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.922+0000 7f62fa772640 1 -- 172.21.15.39:0/2745029263 shutdown_connections 2024-05-14T14:40:13.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.922+0000 7f62fa772640 1 --2- 172.21.15.39:0/2745029263 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f62d40762d0 0x7f62d40787e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:13.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.922+0000 7f62fa772640 1 --2- 172.21.15.39:0/2745029263 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62f415b260 0x7f62f415b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:13.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.922+0000 7f62fa772640 1 --2- 172.21.15.39:0/2745029263 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f62f41580f0 0x7f62f4158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:13.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.922+0000 7f62fa772640 1 --2- 172.21.15.39:0/2745029263 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f62e00041c0 0x7f62f4155160 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:13.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.922+0000 7f62fa772640 1 -- 172.21.15.39:0/2745029263 >> 172.21.15.39:0/2745029263 conn(0x7f62f40b7730 msgr2=0x7f62f4161de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:13.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.923+0000 7f62fa772640 1 -- 172.21.15.39:0/2745029263 shutdown_connections 2024-05-14T14:40:13.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:13.923+0000 7f62fa772640 1 -- 172.21.15.39:0/2745029263 wait complete. 2024-05-14T14:40:13.924 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-05-14T14:40:14.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.060+0000 7f10ac46e640 1 Processor -- start 2024-05-14T14:40:14.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.060+0000 7f10ac46e640 1 -- start start 2024-05-14T14:40:14.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.062+0000 7f10ac46e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f10a40d11c0 0x7f10a4160340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:14.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.062+0000 7f10ac46e640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f10a4161340 0x7f10a406cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:14.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.062+0000 7f10ac46e640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10a41644c0 con 0x7f10a4163e70 2024-05-14T14:40:14.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.062+0000 7f10ac46e640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f10a4164280 con 0x7f10a4161340 2024-05-14T14:40:14.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.062+0000 7f10ac46e640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f10a41647a0 con 0x7f10a40d11c0 2024-05-14T14:40:14.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.062+0000 7f10aaa0b640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f10a4161340 0x7f10a406cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:14.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.062+0000 7f10aaa0b640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f10a4161340 0x7f10a406cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34696/0 (socket says 172.21.15.39:34696) 2024-05-14T14:40:14.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.062+0000 7f10aaa0b640 1 -- 172.21.15.39:0/4273889487 learned_addr learned my addr 172.21.15.39:0/4273889487 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:14.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.062+0000 7f10a9a09640 1 --2- 172.21.15.39:0/4273889487 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f10a40d11c0 0x7f10a4160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:14.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.062+0000 7f10aaa0b640 1 -- 172.21.15.39:0/4273889487 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f10a40d11c0 msgr2=0x7f10a4160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:14.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.062+0000 7f10aaa0b640 1 --2- 172.21.15.39:0/4273889487 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f10a40d11c0 0x7f10a4160340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:14.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.062+0000 7f10aaa0b640 1 -- 172.21.15.39:0/4273889487 >> v1:172.21.15.62:6789/0 conn(0x7f10a4163e70 legacy=0x7f10a40d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:14.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.062+0000 7f10aaa0b640 1 -- 172.21.15.39:0/4273889487 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a4164a80 con 0x7f10a4161340 2024-05-14T14:40:14.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.062+0000 7f10a9a09640 1 --2- 172.21.15.39:0/4273889487 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f10a40d11c0 0x7f10a4160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:40:14.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.063+0000 7f10aaa0b640 1 --2- 172.21.15.39:0/4273889487 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10a4161340 0x7f10a406cc20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f109c009870 tx=0x7f109c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b614815820203365 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:14.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.063+0000 7f10a9208640 1 -- 172.21.15.39:0/4273889487 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109c037070 con 0x7f10a4161340 2024-05-14T14:40:14.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.063+0000 7f10a9208640 1 -- 172.21.15.39:0/4273889487 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f109c032440 con 0x7f10a4161340 2024-05-14T14:40:14.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.063+0000 7f10a9208640 1 -- 172.21.15.39:0/4273889487 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109c032810 con 0x7f10a4161340 2024-05-14T14:40:14.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.064+0000 7f10ac46e640 1 -- 172.21.15.39:0/4273889487 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10a4161340 msgr2=0x7f10a406cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:14.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.064+0000 7f10ac46e640 1 --2- 172.21.15.39:0/4273889487 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10a4161340 0x7f10a406cc20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f109c009870 tx=0x7f109c02a1c0 comp rx=0 tx=0).stop 2024-05-14T14:40:14.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.064+0000 7f10ac46e640 1 -- 172.21.15.39:0/4273889487 shutdown_connections 2024-05-14T14:40:14.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.064+0000 7f10ac46e640 1 --2- 172.21.15.39:0/4273889487 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10a4161340 0x7f10a406cc20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:14.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.064+0000 7f10ac46e640 1 --2- 172.21.15.39:0/4273889487 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f10a40d11c0 0x7f10a4160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:14.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.064+0000 7f10ac46e640 1 -- 172.21.15.39:0/4273889487 >> 172.21.15.39:0/4273889487 conn(0x7f10a40b77f0 msgr2=0x7f10a40b7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:14.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.064+0000 7f10ac46e640 1 -- 172.21.15.39:0/4273889487 shutdown_connections 2024-05-14T14:40:14.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.064+0000 7f10ac46e640 1 -- 172.21.15.39:0/4273889487 wait complete. 2024-05-14T14:40:14.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.066+0000 7f10ac46e640 1 Processor -- start 2024-05-14T14:40:14.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.066+0000 7f10ac46e640 1 -- start start 2024-05-14T14:40:14.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.067+0000 7f10ac46e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f10a4161340 0x7f10a40cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:14.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.067+0000 7f10ac46e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10a4163e70 0x7f10a414df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:14.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.067+0000 7f10ac46e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10a40ccdb0 0x7f10a40cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:14.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.067+0000 7f10ac46e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f10a406d160 con 0x7f10a4163e70 2024-05-14T14:40:14.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.067+0000 7f10ac46e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f10a4161750 con 0x7f10a40ccdb0 2024-05-14T14:40:14.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.067+0000 7f10ac46e640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f10a406d2e0 con 0x7f10a4161340 2024-05-14T14:40:14.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.067+0000 7f10a9a09640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10a4163e70 0x7f10a414df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:14.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.067+0000 7f10a9a09640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10a4163e70 0x7f10a414df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34708/0 (socket says 172.21.15.39:34708) 2024-05-14T14:40:14.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.067+0000 7f10a9a09640 1 -- 172.21.15.39:0/3877835134 learned_addr learned my addr 172.21.15.39:0/3877835134 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:14.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.067+0000 7f10aa20a640 1 --2- 172.21.15.39:0/3877835134 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f10a4161340 0x7f10a40cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:14.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.067+0000 7f10aaa0b640 1 --2- 172.21.15.39:0/3877835134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10a40ccdb0 0x7f10a40cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:14.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.067+0000 7f10a9a09640 1 -- 172.21.15.39:0/3877835134 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f10a4161340 msgr2=0x7f10a40cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:14.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.067+0000 7f10a9a09640 1 --2- 172.21.15.39:0/3877835134 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f10a4161340 0x7f10a40cb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:14.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.067+0000 7f10a9a09640 1 -- 172.21.15.39:0/3877835134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10a40ccdb0 msgr2=0x7f10a40cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:14.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.068+0000 7f10a9a09640 1 --2- 172.21.15.39:0/3877835134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10a40ccdb0 0x7f10a40cd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:14.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.068+0000 7f10a9a09640 1 -- 172.21.15.39:0/3877835134 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a40cd700 con 0x7f10a4163e70 2024-05-14T14:40:14.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.068+0000 7f10aaa0b640 1 --2- 172.21.15.39:0/3877835134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10a40ccdb0 0x7f10a40cd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:40:14.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.068+0000 7f10a9a09640 1 --2- 172.21.15.39:0/3877835134 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10a4163e70 0x7f10a414df60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f109400d7d0 tx=0x7f109400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:14.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.068+0000 7f109affd640 1 -- 172.21.15.39:0/3877835134 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1094004030 con 0x7f10a4163e70 2024-05-14T14:40:14.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.068+0000 7f109affd640 1 -- 172.21.15.39:0/3877835134 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10940041d0 con 0x7f10a4163e70 2024-05-14T14:40:14.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.068+0000 7f10ac46e640 1 -- 172.21.15.39:0/3877835134 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10a40cdbe0 con 0x7f10a4163e70 2024-05-14T14:40:14.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.068+0000 7f109affd640 1 -- 172.21.15.39:0/3877835134 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10940096a0 con 0x7f10a4163e70 2024-05-14T14:40:14.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.068+0000 7f10ac46e640 1 -- 172.21.15.39:0/3877835134 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10a40ca900 con 0x7f10a4163e70 2024-05-14T14:40:14.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.069+0000 7f10ac46e640 1 -- 172.21.15.39:0/3877835134 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10a4076aa0 con 0x7f10a4163e70 2024-05-14T14:40:14.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.070+0000 7f109affd640 1 -- 172.21.15.39:0/3877835134 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1094009840 con 0x7f10a4163e70 2024-05-14T14:40:14.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.070+0000 7f109affd640 1 --2- 172.21.15.39:0/3877835134 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f10880762d0 0x7f10880787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:14.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.071+0000 7f10aa20a640 1 --2- 172.21.15.39:0/3877835134 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f10880762d0 0x7f10880787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:14.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.071+0000 7f109affd640 1 -- 172.21.15.39:0/3877835134 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7f1094097640 con 0x7f10a4163e70 2024-05-14T14:40:14.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.071+0000 7f10aa20a640 1 --2- 172.21.15.39:0/3877835134 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f10880762d0 0x7f10880787e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f10a40b8fe0 tx=0x7f10a0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:14.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.076+0000 7f109affd640 1 -- 172.21.15.39:0/3877835134 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f10a40cd700 con 0x7f10a4163e70 2024-05-14T14:40:14.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.268+0000 7f10ac46e640 1 -- 172.21.15.39:0/3877835134 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f10a40ca3b0 con 0x7f10a4163e70 2024-05-14T14:40:14.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.922+0000 7f109affd640 1 -- 172.21.15.39:0/3877835134 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) ==== 171+0+0 (secure 0 0 0) 0x7f1094061180 con 0x7f10a4163e70 2024-05-14T14:40:14.908 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_data' created 2024-05-14T14:40:14.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.925+0000 7f10ac46e640 1 -- 172.21.15.39:0/3877835134 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f10880762d0 msgr2=0x7f10880787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:14.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.925+0000 7f10ac46e640 1 --2- 172.21.15.39:0/3877835134 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f10880762d0 0x7f10880787e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f10a40b8fe0 tx=0x7f10a0009040 comp rx=0 tx=0).stop 2024-05-14T14:40:14.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.925+0000 7f10ac46e640 1 -- 172.21.15.39:0/3877835134 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10a4163e70 msgr2=0x7f10a414df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:14.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.925+0000 7f10ac46e640 1 --2- 172.21.15.39:0/3877835134 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10a4163e70 0x7f10a414df60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f109400d7d0 tx=0x7f109400dc90 comp rx=0 tx=0).stop 2024-05-14T14:40:14.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.925+0000 7f10ac46e640 1 -- 172.21.15.39:0/3877835134 shutdown_connections 2024-05-14T14:40:14.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.925+0000 7f10ac46e640 1 --2- 172.21.15.39:0/3877835134 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f10880762d0 0x7f10880787e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:14.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.925+0000 7f10ac46e640 1 --2- 172.21.15.39:0/3877835134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10a40ccdb0 0x7f10a40cd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:14.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.925+0000 7f10ac46e640 1 --2- 172.21.15.39:0/3877835134 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f10a4163e70 0x7f10a414df60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:14.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.925+0000 7f10ac46e640 1 --2- 172.21.15.39:0/3877835134 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f10a4161340 0x7f10a40cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:14.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.925+0000 7f10ac46e640 1 -- 172.21.15.39:0/3877835134 >> 172.21.15.39:0/3877835134 conn(0x7f10a40b77f0 msgr2=0x7f10a415f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:14.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.925+0000 7f10ac46e640 1 -- 172.21.15.39:0/3877835134 shutdown_connections 2024-05-14T14:40:14.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:14.925+0000 7f10ac46e640 1 -- 172.21.15.39:0/3877835134 wait complete. 2024-05-14T14:40:14.938 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-14T14:40:15.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.076+0000 7fe809da8640 1 Processor -- start 2024-05-14T14:40:15.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.076+0000 7fe809da8640 1 -- start start 2024-05-14T14:40:15.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.077+0000 7fe809da8640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe8040cf8c0 0x7fe8040cfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:15.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.077+0000 7fe809da8640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe8040d0b70 0x7fe8040cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:15.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.077+0000 7fe809da8640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe804165070 con 0x7fe8040ce0e0 2024-05-14T14:40:15.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.077+0000 7fe809da8640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fe8040b68e0 con 0x7fe8040cf8c0 2024-05-14T14:40:15.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.077+0000 7fe809da8640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fe8040b8630 con 0x7fe8040d0b70 2024-05-14T14:40:15.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.077+0000 7fe8037fe640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe8040cf8c0 0x7fe8040cfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:15.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.078+0000 7fe8037fe640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe8040cf8c0 0x7fe8040cfd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34714/0 (socket says 172.21.15.39:34714) 2024-05-14T14:40:15.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.078+0000 7fe8037fe640 1 -- 172.21.15.39:0/3962652216 learned_addr learned my addr 172.21.15.39:0/3962652216 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:15.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.078+0000 7fe803fff640 1 --2- 172.21.15.39:0/3962652216 >> v2:172.21.15.62:3300/0 conn(0x7fe8040d0b70 0x7fe8040cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:15.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.078+0000 7fe8037fe640 1 -- 172.21.15.39:0/3962652216 >> v2:172.21.15.62:3300/0 conn(0x7fe8040d0b70 msgr2=0x7fe8040cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:15.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.078+0000 7fe8037fe640 1 --2- 172.21.15.39:0/3962652216 >> v2:172.21.15.62:3300/0 conn(0x7fe8040d0b70 0x7fe8040cefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:15.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.078+0000 7fe8037fe640 1 -- 172.21.15.39:0/3962652216 >> v1:172.21.15.62:6789/0 conn(0x7fe8040ce0e0 legacy=0x7fe8040d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:15.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.078+0000 7fe8037fe640 1 -- 172.21.15.39:0/3962652216 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8040b6b30 con 0x7fe8040cf8c0 2024-05-14T14:40:15.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.079+0000 7fe8037fe640 1 --2- 172.21.15.39:0/3962652216 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8040cf8c0 0x7fe8040cfd60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe8040b6a60 tx=0x7fe7f402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0feb00cfdb95418 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:15.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.079+0000 7fe8027fc640 1 -- 172.21.15.39:0/3962652216 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f4037070 con 0x7fe8040cf8c0 2024-05-14T14:40:15.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.079+0000 7fe8027fc640 1 -- 172.21.15.39:0/3962652216 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7f4032440 con 0x7fe8040cf8c0 2024-05-14T14:40:15.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.079+0000 7fe8027fc640 1 -- 172.21.15.39:0/3962652216 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f4032810 con 0x7fe8040cf8c0 2024-05-14T14:40:15.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.079+0000 7fe809da8640 1 -- 172.21.15.39:0/3962652216 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8040cf8c0 msgr2=0x7fe8040cfd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:15.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.079+0000 7fe809da8640 1 --2- 172.21.15.39:0/3962652216 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8040cf8c0 0x7fe8040cfd60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe8040b6a60 tx=0x7fe7f402a130 comp rx=0 tx=0).stop 2024-05-14T14:40:15.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.079+0000 7fe809da8640 1 -- 172.21.15.39:0/3962652216 shutdown_connections 2024-05-14T14:40:15.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.079+0000 7fe809da8640 1 --2- 172.21.15.39:0/3962652216 >> v2:172.21.15.62:3300/0 conn(0x7fe8040d0b70 0x7fe8040cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:15.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.079+0000 7fe809da8640 1 --2- 172.21.15.39:0/3962652216 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8040cf8c0 0x7fe8040cfd60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:15.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.079+0000 7fe809da8640 1 -- 172.21.15.39:0/3962652216 >> 172.21.15.39:0/3962652216 conn(0x7fe8040b5780 msgr2=0x7fe8040b5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:15.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.079+0000 7fe809da8640 1 -- 172.21.15.39:0/3962652216 shutdown_connections 2024-05-14T14:40:15.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.080+0000 7fe809da8640 1 -- 172.21.15.39:0/3962652216 wait complete. 2024-05-14T14:40:15.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.081+0000 7fe809da8640 1 Processor -- start 2024-05-14T14:40:15.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.082+0000 7fe809da8640 1 -- start start 2024-05-14T14:40:15.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.083+0000 7fe809da8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8040ce0e0 0x7fe8040c9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:15.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.083+0000 7fe809da8640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8040cf8c0 0x7fe80406ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:15.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.083+0000 7fe809da8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe80406f2a0 0x7fe80415fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:15.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.083+0000 7fe809da8640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe8040b6f90 con 0x7fe8040ce0e0 2024-05-14T14:40:15.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.083+0000 7fe809da8640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe8040b6e10 con 0x7fe80406f2a0 2024-05-14T14:40:15.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.083+0000 7fe809da8640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe8040b8ac0 con 0x7fe8040cf8c0 2024-05-14T14:40:15.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.083+0000 7fe8037fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8040ce0e0 0x7fe8040c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:15.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.083+0000 7fe8037fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8040ce0e0 0x7fe8040c9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34716/0 (socket says 172.21.15.39:34716) 2024-05-14T14:40:15.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.083+0000 7fe8037fe640 1 -- 172.21.15.39:0/1084531890 learned_addr learned my addr 172.21.15.39:0/1084531890 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:15.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.083+0000 7fe803fff640 1 --2- 172.21.15.39:0/1084531890 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe80406f2a0 0x7fe80415fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:15.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.083+0000 7fe802ffd640 1 --2- 172.21.15.39:0/1084531890 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8040cf8c0 0x7fe80406ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:15.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.083+0000 7fe8037fe640 1 -- 172.21.15.39:0/1084531890 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8040cf8c0 msgr2=0x7fe80406ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:15.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.083+0000 7fe8037fe640 1 --2- 172.21.15.39:0/1084531890 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8040cf8c0 0x7fe80406ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:15.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.083+0000 7fe8037fe640 1 -- 172.21.15.39:0/1084531890 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe80406f2a0 msgr2=0x7fe80415fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:15.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.083+0000 7fe8037fe640 1 --2- 172.21.15.39:0/1084531890 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe80406f2a0 0x7fe80415fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:15.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.083+0000 7fe8037fe640 1 -- 172.21.15.39:0/1084531890 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8041e9f50 con 0x7fe8040ce0e0 2024-05-14T14:40:15.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.083+0000 7fe8037fe640 1 --2- 172.21.15.39:0/1084531890 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8040ce0e0 0x7fe8040c9680 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe7f402a170 tx=0x7fe7f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:15.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.084+0000 7fe7ebfff640 1 -- 172.21.15.39:0/1084531890 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f4041070 con 0x7fe8040ce0e0 2024-05-14T14:40:15.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.084+0000 7fe7ebfff640 1 -- 172.21.15.39:0/1084531890 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7f403c870 con 0x7fe8040ce0e0 2024-05-14T14:40:15.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.084+0000 7fe809da8640 1 -- 172.21.15.39:0/1084531890 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8041ea210 con 0x7fe8040ce0e0 2024-05-14T14:40:15.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.084+0000 7fe7ebfff640 1 -- 172.21.15.39:0/1084531890 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f4037040 con 0x7fe8040ce0e0 2024-05-14T14:40:15.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.084+0000 7fe809da8640 1 -- 172.21.15.39:0/1084531890 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8041ea7d0 con 0x7fe8040ce0e0 2024-05-14T14:40:15.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.085+0000 7fe809da8640 1 -- 172.21.15.39:0/1084531890 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe804076aa0 con 0x7fe8040ce0e0 2024-05-14T14:40:15.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.086+0000 7fe7ebfff640 1 -- 172.21.15.39:0/1084531890 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe7f4044070 con 0x7fe8040ce0e0 2024-05-14T14:40:15.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.087+0000 7fe7ebfff640 1 --2- 172.21.15.39:0/1084531890 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe7f00762d0 0x7fe7f00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:15.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.087+0000 7fe802ffd640 1 --2- 172.21.15.39:0/1084531890 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe7f00762d0 0x7fe7f00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:15.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.087+0000 7fe7ebfff640 1 -- 172.21.15.39:0/1084531890 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7fe7f40b8350 con 0x7fe8040ce0e0 2024-05-14T14:40:15.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.087+0000 7fe802ffd640 1 --2- 172.21.15.39:0/1084531890 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe7f00762d0 0x7fe7f00787e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe80414dc90 tx=0x7fe7f8009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:15.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.091+0000 7fe7ebfff640 1 -- 172.21.15.39:0/1084531890 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe7f4081710 con 0x7fe8040ce0e0 2024-05-14T14:40:15.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.319+0000 7fe809da8640 1 -- 172.21.15.39:0/1084531890 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe8040d3330 con 0x7fe8040ce0e0 2024-05-14T14:40:15.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.957+0000 7fe7ebfff640 1 -- 172.21.15.39:0/1084531890 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fe7f4085a10 con 0x7fe8040ce0e0 2024-05-14T14:40:15.943 INFO:teuthology.orchestra.run.smithi039.stderr:new fs with metadata pool 2 and data pool 3 2024-05-14T14:40:15.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.964+0000 7fe809da8640 1 -- 172.21.15.39:0/1084531890 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe7f00762d0 msgr2=0x7fe7f00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:15.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.964+0000 7fe809da8640 1 --2- 172.21.15.39:0/1084531890 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe7f00762d0 0x7fe7f00787e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe80414dc90 tx=0x7fe7f8009060 comp rx=0 tx=0).stop 2024-05-14T14:40:15.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.964+0000 7fe809da8640 1 -- 172.21.15.39:0/1084531890 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8040ce0e0 msgr2=0x7fe8040c9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:15.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.964+0000 7fe809da8640 1 --2- 172.21.15.39:0/1084531890 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8040ce0e0 0x7fe8040c9680 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe7f402a170 tx=0x7fe7f40046c0 comp rx=0 tx=0).stop 2024-05-14T14:40:15.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.964+0000 7fe809da8640 1 -- 172.21.15.39:0/1084531890 shutdown_connections 2024-05-14T14:40:15.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.964+0000 7fe809da8640 1 --2- 172.21.15.39:0/1084531890 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe7f00762d0 0x7fe7f00787e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:15.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.964+0000 7fe809da8640 1 --2- 172.21.15.39:0/1084531890 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe80406f2a0 0x7fe80415fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:15.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.964+0000 7fe809da8640 1 --2- 172.21.15.39:0/1084531890 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8040cf8c0 0x7fe80406ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:15.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.964+0000 7fe809da8640 1 --2- 172.21.15.39:0/1084531890 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8040ce0e0 0x7fe8040c9680 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:15.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.964+0000 7fe809da8640 1 -- 172.21.15.39:0/1084531890 >> 172.21.15.39:0/1084531890 conn(0x7fe8040b5780 msgr2=0x7fe8040b3510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:15.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.964+0000 7fe809da8640 1 -- 172.21.15.39:0/1084531890 shutdown_connections 2024-05-14T14:40:15.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:15.964+0000 7fe809da8640 1 -- 172.21.15.39:0/1084531890 wait complete. 2024-05-14T14:40:15.973 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-05-14T14:40:15.973 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-05-14T14:40:16.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.113+0000 7f0d45f00640 1 Processor -- start 2024-05-14T14:40:16.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.113+0000 7f0d45f00640 1 -- start start 2024-05-14T14:40:16.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.114+0000 7f0d45f00640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0d401604e0 0x7f0d4006f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:16.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.115+0000 7f0d45f00640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d400d1a80 con 0x7f0d400ce640 2024-05-14T14:40:16.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.115+0000 7f0d45f00640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d40164470 con 0x7f0d400b5c00 2024-05-14T14:40:16.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.115+0000 7f0d45f00640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f0d40164750 con 0x7f0d401604e0 2024-05-14T14:40:16.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.115+0000 7f0d3ffff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0d401604e0 0x7f0d4006f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:16.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.115+0000 7f0d3f7fe640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f0d400ce640 0x7f0d400b54f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:32966/0 (socket says 172.21.15.39:32966) 2024-05-14T14:40:16.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.115+0000 7f0d3ffff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0d401604e0 0x7f0d4006f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34728/0 (socket says 172.21.15.39:34728) 2024-05-14T14:40:16.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.115+0000 7f0d3f7fe640 1 -- 172.21.15.39:0/2736914571 learned_addr learned my addr 172.21.15.39:0/2736914571 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:16.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.115+0000 7f0d3ffff640 1 -- 172.21.15.39:0/2736914571 >> v1:172.21.15.62:6789/0 conn(0x7f0d400b5c00 legacy=0x7f0d4006f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:16.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.115+0000 7f0d3ffff640 1 -- 172.21.15.39:0/2736914571 >> v1:172.21.15.39:6789/0 conn(0x7f0d400ce640 legacy=0x7f0d400b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:16.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.115+0000 7f0d3e7fc640 1 -- 172.21.15.39:0/2736914571 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 330588571 0 0) 0x7f0d400d1a80 con 0x7f0d400ce640 2024-05-14T14:40:16.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.115+0000 7f0d3ffff640 1 -- 172.21.15.39:0/2736914571 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d40164a30 con 0x7f0d401604e0 2024-05-14T14:40:16.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.116+0000 7f0d3ffff640 1 --2- 172.21.15.39:0/2736914571 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d401604e0 0x7f0d4006f7c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0d38009d90 tx=0x7f0d3802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=985004b3f98bdfcf server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:16.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.116+0000 7f0d3e7fc640 1 -- 172.21.15.39:0/2736914571 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d38007740 con 0x7f0d401604e0 2024-05-14T14:40:16.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.116+0000 7f0d3e7fc640 1 -- 172.21.15.39:0/2736914571 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d380078e0 con 0x7f0d401604e0 2024-05-14T14:40:16.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.116+0000 7f0d3e7fc640 1 -- 172.21.15.39:0/2736914571 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d38007cb0 con 0x7f0d401604e0 2024-05-14T14:40:16.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.117+0000 7f0d45f00640 1 -- 172.21.15.39:0/2736914571 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d401604e0 msgr2=0x7f0d4006f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:16.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.117+0000 7f0d45f00640 1 --2- 172.21.15.39:0/2736914571 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d401604e0 0x7f0d4006f7c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0d38009d90 tx=0x7f0d3802a660 comp rx=0 tx=0).stop 2024-05-14T14:40:16.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.117+0000 7f0d45f00640 1 -- 172.21.15.39:0/2736914571 shutdown_connections 2024-05-14T14:40:16.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.117+0000 7f0d45f00640 1 --2- 172.21.15.39:0/2736914571 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d401604e0 0x7f0d4006f7c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:16.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.117+0000 7f0d45f00640 1 -- 172.21.15.39:0/2736914571 >> 172.21.15.39:0/2736914571 conn(0x7f0d400d04f0 msgr2=0x7f0d400d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:16.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.117+0000 7f0d45f00640 1 -- 172.21.15.39:0/2736914571 shutdown_connections 2024-05-14T14:40:16.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.117+0000 7f0d45f00640 1 -- 172.21.15.39:0/2736914571 wait complete. 2024-05-14T14:40:16.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.118+0000 7f0d45f00640 1 Processor -- start 2024-05-14T14:40:16.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.119+0000 7f0d45f00640 1 -- start start 2024-05-14T14:40:16.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.120+0000 7f0d45f00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d400ce640 0x7f0d4015a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:16.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.120+0000 7f0d45f00640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d401604e0 0x7f0d400b8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:16.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.120+0000 7f0d45f00640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0d400b91f0 0x7f0d4015aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:16.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.120+0000 7f0d45f00640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0d4006fd00 con 0x7f0d401604e0 2024-05-14T14:40:16.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.120+0000 7f0d45f00640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0d40164d10 con 0x7f0d400ce640 2024-05-14T14:40:16.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.120+0000 7f0d45f00640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f0d4006fe80 con 0x7f0d400b91f0 2024-05-14T14:40:16.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.120+0000 7f0d3effd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d401604e0 0x7f0d400b8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:16.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.120+0000 7f0d3effd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d401604e0 0x7f0d400b8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34734/0 (socket says 172.21.15.39:34734) 2024-05-14T14:40:16.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.120+0000 7f0d3effd640 1 -- 172.21.15.39:0/3363047335 learned_addr learned my addr 172.21.15.39:0/3363047335 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:16.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.120+0000 7f0d3f7fe640 1 --2- 172.21.15.39:0/3363047335 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d400ce640 0x7f0d4015a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:16.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.120+0000 7f0d3ffff640 1 --2- 172.21.15.39:0/3363047335 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0d400b91f0 0x7f0d4015aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:16.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.120+0000 7f0d3effd640 1 -- 172.21.15.39:0/3363047335 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0d400b91f0 msgr2=0x7f0d4015aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:16.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.120+0000 7f0d3effd640 1 --2- 172.21.15.39:0/3363047335 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0d400b91f0 0x7f0d4015aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:16.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.120+0000 7f0d3effd640 1 -- 172.21.15.39:0/3363047335 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d400ce640 msgr2=0x7f0d4015a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:16.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.120+0000 7f0d3effd640 1 --2- 172.21.15.39:0/3363047335 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d400ce640 0x7f0d4015a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:16.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.120+0000 7f0d3effd640 1 -- 172.21.15.39:0/3363047335 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d400b88c0 con 0x7f0d401604e0 2024-05-14T14:40:16.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.120+0000 7f0d3ffff640 1 --2- 172.21.15.39:0/3363047335 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0d400b91f0 0x7f0d4015aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:40:16.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.121+0000 7f0d3effd640 1 --2- 172.21.15.39:0/3363047335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d401604e0 0x7f0d400b8cb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0d3400c3f0 tx=0x7f0d3400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:16.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.121+0000 7f0d27fff640 1 -- 172.21.15.39:0/3363047335 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d34017070 con 0x7f0d401604e0 2024-05-14T14:40:16.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.121+0000 7f0d27fff640 1 -- 172.21.15.39:0/3363047335 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d340052f0 con 0x7f0d401604e0 2024-05-14T14:40:16.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.121+0000 7f0d27fff640 1 -- 172.21.15.39:0/3363047335 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d34003850 con 0x7f0d401604e0 2024-05-14T14:40:16.108 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.121+0000 7f0d45f00640 1 -- 172.21.15.39:0/3363047335 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d400b7820 con 0x7f0d401604e0 2024-05-14T14:40:16.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.121+0000 7f0d45f00640 1 -- 172.21.15.39:0/3363047335 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d400b7de0 con 0x7f0d401604e0 2024-05-14T14:40:16.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.122+0000 7f0d45f00640 1 -- 172.21.15.39:0/3363047335 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d40076aa0 con 0x7f0d401604e0 2024-05-14T14:40:16.109 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.123+0000 7f0d27fff640 1 -- 172.21.15.39:0/3363047335 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0d3401a070 con 0x7f0d401604e0 2024-05-14T14:40:16.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.123+0000 7f0d27fff640 1 --2- 172.21.15.39:0/3363047335 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0d2c0762d0 0x7f0d2c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:16.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.123+0000 7f0d27fff640 1 -- 172.21.15.39:0/3363047335 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f0d340968e0 con 0x7f0d401604e0 2024-05-14T14:40:16.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.123+0000 7f0d3f7fe640 1 --2- 172.21.15.39:0/3363047335 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0d2c0762d0 0x7f0d2c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:16.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.124+0000 7f0d3f7fe640 1 --2- 172.21.15.39:0/3363047335 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0d2c0762d0 0x7f0d2c0787e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0d30000f60 tx=0x7f0d30007e40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:16.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.128+0000 7f0d27fff640 1 -- 172.21.15.39:0/3363047335 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0d400b88c0 con 0x7f0d401604e0 2024-05-14T14:40:16.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.326+0000 7f0d45f00640 1 -- 172.21.15.39:0/3363047335 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f0d4006e6a0 con 0x7f0d401604e0 2024-05-14T14:40:16.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.942+0000 7f0d27fff640 1 -- 172.21.15.39:0/3363047335 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) ==== 157+0+0 (secure 0 0 0) 0x7f0d34068230 con 0x7f0d401604e0 2024-05-14T14:40:16.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.945+0000 7f0d45f00640 1 -- 172.21.15.39:0/3363047335 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0d2c0762d0 msgr2=0x7f0d2c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:16.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.945+0000 7f0d45f00640 1 --2- 172.21.15.39:0/3363047335 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0d2c0762d0 0x7f0d2c0787e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0d30000f60 tx=0x7f0d30007e40 comp rx=0 tx=0).stop 2024-05-14T14:40:16.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.945+0000 7f0d45f00640 1 -- 172.21.15.39:0/3363047335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d401604e0 msgr2=0x7f0d400b8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:16.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.945+0000 7f0d45f00640 1 --2- 172.21.15.39:0/3363047335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d401604e0 0x7f0d400b8cb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0d3400c3f0 tx=0x7f0d3400c8b0 comp rx=0 tx=0).stop 2024-05-14T14:40:16.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.945+0000 7f0d45f00640 1 -- 172.21.15.39:0/3363047335 shutdown_connections 2024-05-14T14:40:16.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.945+0000 7f0d45f00640 1 --2- 172.21.15.39:0/3363047335 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0d2c0762d0 0x7f0d2c0787e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:16.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.945+0000 7f0d45f00640 1 --2- 172.21.15.39:0/3363047335 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0d400b91f0 0x7f0d4015aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:16.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.945+0000 7f0d45f00640 1 --2- 172.21.15.39:0/3363047335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0d401604e0 0x7f0d400b8cb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:16.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.945+0000 7f0d45f00640 1 --2- 172.21.15.39:0/3363047335 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d400ce640 0x7f0d4015a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:16.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.945+0000 7f0d45f00640 1 -- 172.21.15.39:0/3363047335 >> 172.21.15.39:0/3363047335 conn(0x7f0d400d04f0 msgr2=0x7f0d4015cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:16.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.945+0000 7f0d45f00640 1 -- 172.21.15.39:0/3363047335 shutdown_connections 2024-05-14T14:40:16.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:16.945+0000 7f0d45f00640 1 -- 172.21.15.39:0/3363047335 wait complete. 2024-05-14T14:40:16.946 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-05-14T14:40:17.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.090+0000 7fbb6f669640 1 Processor -- start 2024-05-14T14:40:17.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.090+0000 7fbb6f669640 1 -- start start 2024-05-14T14:40:17.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.092+0000 7fbb6f669640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb681603d0 0x7fbb680b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:17.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.092+0000 7fbb6f669640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbb680d2070 0x7fbb680d2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:17.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.092+0000 7fbb6f669640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb680d29c0 con 0x7fbb68073090 2024-05-14T14:40:17.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.092+0000 7fbb6f669640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fbb680b31a0 con 0x7fbb680d2070 2024-05-14T14:40:17.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.092+0000 7fbb6f669640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fbb68163d70 con 0x7fbb681603d0 2024-05-14T14:40:17.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.092+0000 7fbb6dc06640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fbb68073090 0x7fbb680734a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:32972/0 (socket says 172.21.15.39:32972) 2024-05-14T14:40:17.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.092+0000 7fbb6dc06640 1 -- 172.21.15.39:0/1912805988 learned_addr learned my addr 172.21.15.39:0/1912805988 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:17.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.092+0000 7fbb6d405640 1 --2- 172.21.15.39:0/1912805988 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb681603d0 0x7fbb680b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:17.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.092+0000 7fbb6cc04640 1 --2- 172.21.15.39:0/1912805988 >> v2:172.21.15.62:3300/0 conn(0x7fbb680d2070 0x7fbb680d2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:17.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.092+0000 7fbb5ffff640 1 -- 172.21.15.39:0/1912805988 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3580900297 0 0) 0x7fbb60001490 con 0x7fbb68073090 2024-05-14T14:40:17.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.092+0000 7fbb5ffff640 1 -- 172.21.15.39:0/1912805988 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb54003520 con 0x7fbb68073090 2024-05-14T14:40:17.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.093+0000 7fbb6d405640 1 -- 172.21.15.39:0/1912805988 >> v2:172.21.15.62:3300/0 conn(0x7fbb680d2070 msgr2=0x7fbb680d2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:17.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.093+0000 7fbb6d405640 1 --2- 172.21.15.39:0/1912805988 >> v2:172.21.15.62:3300/0 conn(0x7fbb680d2070 0x7fbb680d2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:17.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.093+0000 7fbb6d405640 1 -- 172.21.15.39:0/1912805988 >> v1:172.21.15.39:6789/0 conn(0x7fbb68073090 legacy=0x7fbb680734a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:17.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.093+0000 7fbb6d405640 1 -- 172.21.15.39:0/1912805988 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb68164050 con 0x7fbb681603d0 2024-05-14T14:40:17.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.093+0000 7fbb6cc04640 1 --2- 172.21.15.39:0/1912805988 >> v2:172.21.15.62:3300/0 conn(0x7fbb680d2070 0x7fbb680d2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T14:40:17.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.093+0000 7fbb6d405640 1 --2- 172.21.15.39:0/1912805988 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb681603d0 0x7fbb680b2c60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbb640097a0 tx=0x7fbb6402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ee73b98c256e694 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:17.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.094+0000 7fbb5ffff640 1 -- 172.21.15.39:0/1912805988 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb64037070 con 0x7fbb681603d0 2024-05-14T14:40:17.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.094+0000 7fbb5ffff640 1 -- 172.21.15.39:0/1912805988 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb64032440 con 0x7fbb681603d0 2024-05-14T14:40:17.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.094+0000 7fbb5ffff640 1 -- 172.21.15.39:0/1912805988 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb640327f0 con 0x7fbb681603d0 2024-05-14T14:40:17.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.094+0000 7fbb6f669640 1 -- 172.21.15.39:0/1912805988 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb681603d0 msgr2=0x7fbb680b2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:17.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.094+0000 7fbb6f669640 1 --2- 172.21.15.39:0/1912805988 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb681603d0 0x7fbb680b2c60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fbb640097a0 tx=0x7fbb6402a180 comp rx=0 tx=0).stop 2024-05-14T14:40:17.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.095+0000 7fbb6f669640 1 -- 172.21.15.39:0/1912805988 shutdown_connections 2024-05-14T14:40:17.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.095+0000 7fbb6f669640 1 --2- 172.21.15.39:0/1912805988 >> v2:172.21.15.62:3300/0 conn(0x7fbb680d2070 0x7fbb680d2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:17.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.095+0000 7fbb6f669640 1 --2- 172.21.15.39:0/1912805988 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb681603d0 0x7fbb680b2c60 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:17.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.095+0000 7fbb6f669640 1 -- 172.21.15.39:0/1912805988 >> 172.21.15.39:0/1912805988 conn(0x7fbb680d0510 msgr2=0x7fbb680d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:17.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.095+0000 7fbb6f669640 1 -- 172.21.15.39:0/1912805988 shutdown_connections 2024-05-14T14:40:17.081 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.095+0000 7fbb6f669640 1 -- 172.21.15.39:0/1912805988 wait complete. 2024-05-14T14:40:17.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.096+0000 7fbb6f669640 1 Processor -- start 2024-05-14T14:40:17.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.097+0000 7fbb6f669640 1 -- start start 2024-05-14T14:40:17.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.098+0000 7fbb6f669640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb68073090 0x7fbb68158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:17.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.098+0000 7fbb6f669640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb680d2070 0x7fbb680b8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:17.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.098+0000 7fbb6f669640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb68160a50 0x7fbb680b89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:17.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.098+0000 7fbb6f669640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbb681648f0 con 0x7fbb68160a50 2024-05-14T14:40:17.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.098+0000 7fbb6f669640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fbb68164610 con 0x7fbb68073090 2024-05-14T14:40:17.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.098+0000 7fbb6f669640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fbb68164bd0 con 0x7fbb680d2070 2024-05-14T14:40:17.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.098+0000 7fbb6dc06640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb68160a50 0x7fbb680b89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:17.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.098+0000 7fbb6dc06640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb68160a50 0x7fbb680b89b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:34740/0 (socket says 172.21.15.39:34740) 2024-05-14T14:40:17.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.098+0000 7fbb6dc06640 1 -- 172.21.15.39:0/651279485 learned_addr learned my addr 172.21.15.39:0/651279485 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:17.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.098+0000 7fbb6d405640 1 --2- 172.21.15.39:0/651279485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb68073090 0x7fbb68158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:17.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.098+0000 7fbb6cc04640 1 --2- 172.21.15.39:0/651279485 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb680d2070 0x7fbb680b8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:17.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.098+0000 7fbb6dc06640 1 -- 172.21.15.39:0/651279485 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb680d2070 msgr2=0x7fbb680b8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:17.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.098+0000 7fbb6dc06640 1 --2- 172.21.15.39:0/651279485 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb680d2070 0x7fbb680b8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:17.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.098+0000 7fbb6dc06640 1 -- 172.21.15.39:0/651279485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb68073090 msgr2=0x7fbb68158aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:17.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.098+0000 7fbb6dc06640 1 --2- 172.21.15.39:0/651279485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb68073090 0x7fbb68158aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:17.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.098+0000 7fbb6dc06640 1 -- 172.21.15.39:0/651279485 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb681632f0 con 0x7fbb68160a50 2024-05-14T14:40:17.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.098+0000 7fbb6dc06640 1 --2- 172.21.15.39:0/651279485 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb68160a50 0x7fbb680b89b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbb6000caa0 tx=0x7fbb6000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:17.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.099+0000 7fbb5dffb640 1 -- 172.21.15.39:0/651279485 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb6000ac00 con 0x7fbb68160a50 2024-05-14T14:40:17.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.099+0000 7fbb6f669640 1 -- 172.21.15.39:0/651279485 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb680b65c0 con 0x7fbb68160a50 2024-05-14T14:40:17.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.099+0000 7fbb5dffb640 1 -- 172.21.15.39:0/651279485 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb6000ada0 con 0x7fbb68160a50 2024-05-14T14:40:17.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.099+0000 7fbb5dffb640 1 -- 172.21.15.39:0/651279485 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb60012620 con 0x7fbb68160a50 2024-05-14T14:40:17.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.099+0000 7fbb6f669640 1 -- 172.21.15.39:0/651279485 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb680b6b80 con 0x7fbb68160a50 2024-05-14T14:40:17.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.100+0000 7fbb6f669640 1 -- 172.21.15.39:0/651279485 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb6806faa0 con 0x7fbb68160a50 2024-05-14T14:40:17.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.101+0000 7fbb5dffb640 1 -- 172.21.15.39:0/651279485 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbb600127c0 con 0x7fbb68160a50 2024-05-14T14:40:17.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.101+0000 7fbb5dffb640 1 --2- 172.21.15.39:0/651279485 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fbb4c0762d0 0x7fbb4c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:17.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.101+0000 7fbb5dffb640 1 -- 172.21.15.39:0/651279485 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 6007+0+0 (secure 0 0 0) 0x7fbb60097de0 con 0x7fbb68160a50 2024-05-14T14:40:17.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.101+0000 7fbb6d405640 1 --2- 172.21.15.39:0/651279485 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fbb4c0762d0 0x7fbb4c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:17.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.102+0000 7fbb6d405640 1 --2- 172.21.15.39:0/651279485 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fbb4c0762d0 0x7fbb4c0787e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbb64034000 tx=0x7fbb6402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:17.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.106+0000 7fbb5dffb640 1 -- 172.21.15.39:0/651279485 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbb6806faa0 con 0x7fbb68160a50 2024-05-14T14:40:17.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:17.296+0000 7fbb6f669640 1 -- 172.21.15.39:0/651279485 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fbb68076aa0 con 0x7fbb68160a50 2024-05-14T14:40:18.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:18.983+0000 7fbb5dffb640 1 -- 172.21.15.39:0/651279485 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) ==== 228+0+0 (secure 0 0 0) 0x7fbb680d29c0 con 0x7fbb68160a50 2024-05-14T14:40:18.968 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_data_ec' created 2024-05-14T14:40:18.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:18.986+0000 7fbb6f669640 1 -- 172.21.15.39:0/651279485 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fbb4c0762d0 msgr2=0x7fbb4c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:18.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:18.986+0000 7fbb6f669640 1 --2- 172.21.15.39:0/651279485 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fbb4c0762d0 0x7fbb4c0787e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbb64034000 tx=0x7fbb6402e000 comp rx=0 tx=0).stop 2024-05-14T14:40:18.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:18.986+0000 7fbb6f669640 1 -- 172.21.15.39:0/651279485 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb68160a50 msgr2=0x7fbb680b89b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:18.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:18.986+0000 7fbb6f669640 1 --2- 172.21.15.39:0/651279485 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb68160a50 0x7fbb680b89b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbb6000caa0 tx=0x7fbb6000cf60 comp rx=0 tx=0).stop 2024-05-14T14:40:18.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:18.986+0000 7fbb6f669640 1 -- 172.21.15.39:0/651279485 shutdown_connections 2024-05-14T14:40:18.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:18.986+0000 7fbb6f669640 1 --2- 172.21.15.39:0/651279485 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fbb4c0762d0 0x7fbb4c0787e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:18.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:18.986+0000 7fbb6f669640 1 --2- 172.21.15.39:0/651279485 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbb68160a50 0x7fbb680b89b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:18.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:18.986+0000 7fbb6f669640 1 --2- 172.21.15.39:0/651279485 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbb680d2070 0x7fbb680b8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:18.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:18.986+0000 7fbb6f669640 1 --2- 172.21.15.39:0/651279485 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbb68073090 0x7fbb68158aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:18.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:18.986+0000 7fbb6f669640 1 -- 172.21.15.39:0/651279485 >> 172.21.15.39:0/651279485 conn(0x7fbb680d0510 msgr2=0x7fbb6806f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:18.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:18.986+0000 7fbb6f669640 1 -- 172.21.15.39:0/651279485 shutdown_connections 2024-05-14T14:40:18.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:18.986+0000 7fbb6f669640 1 -- 172.21.15.39:0/651279485 wait complete. 2024-05-14T14:40:18.993 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-05-14T14:40:19.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.132+0000 7f091b427640 1 Processor -- start 2024-05-14T14:40:19.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.132+0000 7f091b427640 1 -- start start 2024-05-14T14:40:19.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.134+0000 7f091b427640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f09140d13d0 0x7f091406d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:19.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.134+0000 7f091b427640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f091406e080 con 0x7f09140b4eb0 2024-05-14T14:40:19.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.134+0000 7f091b427640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09140b9670 con 0x7f091406d830 2024-05-14T14:40:19.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.134+0000 7f091b427640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f09140b9950 con 0x7f09140d13d0 2024-05-14T14:40:19.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.134+0000 7f09189c2640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f09140d13d0 0x7f091406d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:19.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.134+0000 7f09191c3640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f09140b4eb0 0x7f09140d0cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:37688/0 (socket says 172.21.15.39:37688) 2024-05-14T14:40:19.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.134+0000 7f09191c3640 1 -- 172.21.15.39:0/1468940606 learned_addr learned my addr 172.21.15.39:0/1468940606 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:19.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.134+0000 7f09189c2640 1 -- 172.21.15.39:0/1468940606 >> v1:172.21.15.62:6789/0 conn(0x7f091406d830 legacy=0x7f09140ba150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:19.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.134+0000 7f09189c2640 1 -- 172.21.15.39:0/1468940606 >> v1:172.21.15.39:6789/0 conn(0x7f09140b4eb0 legacy=0x7f09140d0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:19.120 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.134+0000 7f09189c2640 1 -- 172.21.15.39:0/1468940606 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09140b9c30 con 0x7f09140d13d0 2024-05-14T14:40:19.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.135+0000 7f09189c2640 1 --2- 172.21.15.39:0/1468940606 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09140d13d0 0x7f091406d2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f09040097a0 tx=0x7f090402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ee49ab9c94b741 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:19.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.135+0000 7f090bfff640 1 -- 172.21.15.39:0/1468940606 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0904037070 con 0x7f09140d13d0 2024-05-14T14:40:19.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.135+0000 7f090bfff640 1 -- 172.21.15.39:0/1468940606 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0904032440 con 0x7f09140d13d0 2024-05-14T14:40:19.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.135+0000 7f090bfff640 1 -- 172.21.15.39:0/1468940606 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0904032810 con 0x7f09140d13d0 2024-05-14T14:40:19.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.135+0000 7f091b427640 1 -- 172.21.15.39:0/1468940606 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09140d13d0 msgr2=0x7f091406d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:19.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.135+0000 7f091b427640 1 --2- 172.21.15.39:0/1468940606 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09140d13d0 0x7f091406d2f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f09040097a0 tx=0x7f090402a230 comp rx=0 tx=0).stop 2024-05-14T14:40:19.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.135+0000 7f091b427640 1 -- 172.21.15.39:0/1468940606 shutdown_connections 2024-05-14T14:40:19.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.135+0000 7f091b427640 1 --2- 172.21.15.39:0/1468940606 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09140d13d0 0x7f091406d2f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:19.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.135+0000 7f091b427640 1 -- 172.21.15.39:0/1468940606 >> 172.21.15.39:0/1468940606 conn(0x7f09140d2b20 msgr2=0x7f09140d2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:19.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.136+0000 7f091b427640 1 -- 172.21.15.39:0/1468940606 shutdown_connections 2024-05-14T14:40:19.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.136+0000 7f091b427640 1 -- 172.21.15.39:0/1468940606 wait complete. 2024-05-14T14:40:19.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.137+0000 7f091b427640 1 Processor -- start 2024-05-14T14:40:19.122 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.137+0000 7f091b427640 1 -- start start 2024-05-14T14:40:19.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.139+0000 7f091b427640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f091406d830 0x7f09140cfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:19.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.139+0000 7f091b427640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09140b4eb0 0x7f0914160e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:19.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.139+0000 7f091b427640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09140ae400 0x7f09140ae810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:19.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.139+0000 7f091b427640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f09140b9450 con 0x7f09140ae400 2024-05-14T14:40:19.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.139+0000 7f091b427640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f09140b92d0 con 0x7f09140b4eb0 2024-05-14T14:40:19.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.139+0000 7f091b427640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f091406dc40 con 0x7f091406d830 2024-05-14T14:40:19.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.139+0000 7f09199c4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09140ae400 0x7f09140ae810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:19.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.139+0000 7f09199c4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09140ae400 0x7f09140ae810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47400/0 (socket says 172.21.15.39:47400) 2024-05-14T14:40:19.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.139+0000 7f09199c4640 1 -- 172.21.15.39:0/1176643941 learned_addr learned my addr 172.21.15.39:0/1176643941 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:19.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.139+0000 7f09189c2640 1 --2- 172.21.15.39:0/1176643941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09140b4eb0 0x7f0914160e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:19.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.139+0000 7f09191c3640 1 --2- 172.21.15.39:0/1176643941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f091406d830 0x7f09140cfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:19.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.139+0000 7f09199c4640 1 -- 172.21.15.39:0/1176643941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f091406d830 msgr2=0x7f09140cfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:19.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.139+0000 7f09199c4640 1 --2- 172.21.15.39:0/1176643941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f091406d830 0x7f09140cfdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:19.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.139+0000 7f09199c4640 1 -- 172.21.15.39:0/1176643941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09140b4eb0 msgr2=0x7f0914160e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:19.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.139+0000 7f09199c4640 1 --2- 172.21.15.39:0/1176643941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09140b4eb0 0x7f0914160e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:19.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.139+0000 7f09199c4640 1 -- 172.21.15.39:0/1176643941 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09140aed50 con 0x7f09140ae400 2024-05-14T14:40:19.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.139+0000 7f09199c4640 1 --2- 172.21.15.39:0/1176643941 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09140ae400 0x7f09140ae810 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f090c00c6b0 tx=0x7f090c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:19.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.139+0000 7f0909ffb640 1 -- 172.21.15.39:0/1176643941 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f090c003b70 con 0x7f09140ae400 2024-05-14T14:40:19.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.140+0000 7f0909ffb640 1 -- 172.21.15.39:0/1176643941 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f090c003d30 con 0x7f09140ae400 2024-05-14T14:40:19.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.140+0000 7f091b427640 1 -- 172.21.15.39:0/1176643941 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09140cfb90 con 0x7f09140ae400 2024-05-14T14:40:19.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.140+0000 7f0909ffb640 1 -- 172.21.15.39:0/1176643941 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f090c005310 con 0x7f09140ae400 2024-05-14T14:40:19.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.140+0000 7f091b427640 1 -- 172.21.15.39:0/1176643941 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09140cedd0 con 0x7f09140ae400 2024-05-14T14:40:19.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.141+0000 7f091b427640 1 -- 172.21.15.39:0/1176643941 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0914076aa0 con 0x7f09140ae400 2024-05-14T14:40:19.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.141+0000 7f0909ffb640 1 -- 172.21.15.39:0/1176643941 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f090c0054b0 con 0x7f09140ae400 2024-05-14T14:40:19.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.142+0000 7f0909ffb640 1 --2- 172.21.15.39:0/1176643941 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f08f8076300 0x7f08f8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:19.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.142+0000 7f09191c3640 1 --2- 172.21.15.39:0/1176643941 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f08f8076300 0x7f08f8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:19.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.142+0000 7f0909ffb640 1 -- 172.21.15.39:0/1176643941 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6500+0+0 (secure 0 0 0) 0x7f090c0976c0 con 0x7f09140ae400 2024-05-14T14:40:19.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.142+0000 7f09191c3640 1 --2- 172.21.15.39:0/1176643941 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f08f8076300 0x7f08f8078810 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0910000f60 tx=0x7f0910009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:19.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.147+0000 7f0909ffb640 1 -- 172.21.15.39:0/1176643941 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f09140aed50 con 0x7f09140ae400 2024-05-14T14:40:19.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.336+0000 7f091b427640 1 -- 172.21.15.39:0/1176643941 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f09140b5a90 con 0x7f09140ae400 2024-05-14T14:40:19.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.986+0000 7f0909ffb640 1 -- 172.21.15.39:0/1176643941 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) ==== 169+0+0 (secure 0 0 0) 0x7f090c060d00 con 0x7f09140ae400 2024-05-14T14:40:19.970 INFO:teuthology.orchestra.run.smithi039.stderr:set pool 4 allow_ec_overwrites to true 2024-05-14T14:40:19.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.989+0000 7f091b427640 1 -- 172.21.15.39:0/1176643941 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f08f8076300 msgr2=0x7f08f8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:19.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.989+0000 7f091b427640 1 --2- 172.21.15.39:0/1176643941 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f08f8076300 0x7f08f8078810 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0910000f60 tx=0x7f0910009040 comp rx=0 tx=0).stop 2024-05-14T14:40:19.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.989+0000 7f091b427640 1 -- 172.21.15.39:0/1176643941 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09140ae400 msgr2=0x7f09140ae810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:19.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.989+0000 7f091b427640 1 --2- 172.21.15.39:0/1176643941 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09140ae400 0x7f09140ae810 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f090c00c6b0 tx=0x7f090c00cb70 comp rx=0 tx=0).stop 2024-05-14T14:40:19.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.989+0000 7f091b427640 1 -- 172.21.15.39:0/1176643941 shutdown_connections 2024-05-14T14:40:19.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.989+0000 7f091b427640 1 --2- 172.21.15.39:0/1176643941 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f08f8076300 0x7f08f8078810 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:19.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.989+0000 7f091b427640 1 --2- 172.21.15.39:0/1176643941 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f09140ae400 0x7f09140ae810 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:19.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.989+0000 7f091b427640 1 --2- 172.21.15.39:0/1176643941 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f09140b4eb0 0x7f0914160e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:19.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.989+0000 7f091b427640 1 --2- 172.21.15.39:0/1176643941 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f091406d830 0x7f09140cfdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:19.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.989+0000 7f091b427640 1 -- 172.21.15.39:0/1176643941 >> 172.21.15.39:0/1176643941 conn(0x7f09140d2b20 msgr2=0x7f0914163310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:19.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.989+0000 7f091b427640 1 -- 172.21.15.39:0/1176643941 shutdown_connections 2024-05-14T14:40:19.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:19.989+0000 7f091b427640 1 -- 172.21.15.39:0/1176643941 wait complete. 2024-05-14T14:40:20.002 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-05-14T14:40:20.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.142+0000 7f1d53b34640 1 Processor -- start 2024-05-14T14:40:20.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.142+0000 7f1d53b34640 1 -- start start 2024-05-14T14:40:20.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.144+0000 7f1d53b34640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d4c0d4720 0x7f1d4c0b9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:20.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.144+0000 7f1d53b34640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1d4c0b9760 0x7f1d4c0b9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:20.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.144+0000 7f1d53b34640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d4c06c9b0 con 0x7f1d4c0bb9a0 2024-05-14T14:40:20.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.144+0000 7f1d53b34640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f1d4c06cc90 con 0x7f1d4c0b9760 2024-05-14T14:40:20.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.144+0000 7f1d53b34640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f1d4c06cf70 con 0x7f1d4c0d4720 2024-05-14T14:40:20.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.144+0000 7f1d518d0640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f1d4c0bb9a0 0x7f1d4c06da50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:37694/0 (socket says 172.21.15.39:37694) 2024-05-14T14:40:20.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.144+0000 7f1d518d0640 1 -- 172.21.15.39:0/3248001415 learned_addr learned my addr 172.21.15.39:0/3248001415 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:20.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.144+0000 7f1d510cf640 1 --2- 172.21.15.39:0/3248001415 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d4c0d4720 0x7f1d4c0b9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:20.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.144+0000 7f1d520d1640 1 --2- 172.21.15.39:0/3248001415 >> v2:172.21.15.62:3300/0 conn(0x7f1d4c0b9760 0x7f1d4c0b9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:20.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.144+0000 7f1d508ce640 1 -- 172.21.15.39:0/3248001415 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3807258505 0 0) 0x7f1d4c06c9b0 con 0x7f1d4c0bb9a0 2024-05-14T14:40:20.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.144+0000 7f1d508ce640 1 -- 172.21.15.39:0/3248001415 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d34003520 con 0x7f1d4c0bb9a0 2024-05-14T14:40:20.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.145+0000 7f1d508ce640 1 -- 172.21.15.39:0/3248001415 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1692689849 0 0) 0x7f1d34003520 con 0x7f1d4c0bb9a0 2024-05-14T14:40:20.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.145+0000 7f1d508ce640 1 -- 172.21.15.39:0/3248001415 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d4c0d4720 msgr2=0x7f1d4c0b9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:20.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.145+0000 7f1d508ce640 1 --2- 172.21.15.39:0/3248001415 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d4c0d4720 0x7f1d4c0b9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:20.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.145+0000 7f1d508ce640 1 -- 172.21.15.39:0/3248001415 >> v2:172.21.15.62:3300/0 conn(0x7f1d4c0b9760 msgr2=0x7f1d4c0b9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:20.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.145+0000 7f1d508ce640 1 --2- 172.21.15.39:0/3248001415 >> v2:172.21.15.62:3300/0 conn(0x7f1d4c0b9760 0x7f1d4c0b9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:20.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.145+0000 7f1d508ce640 1 -- 172.21.15.39:0/3248001415 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d4c06d250 con 0x7f1d4c0bb9a0 2024-05-14T14:40:20.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.145+0000 7f1d508ce640 1 -- 172.21.15.39:0/3248001415 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1803005051 0 0) 0x7f1d44001710 con 0x7f1d4c0bb9a0 2024-05-14T14:40:20.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.145+0000 7f1d508ce640 1 -- 172.21.15.39:0/3248001415 >> v1:172.21.15.39:6789/0 conn(0x7f1d4c0bb9a0 legacy=0x7f1d4c06da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:20.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.145+0000 7f1d508ce640 1 --2- 172.21.15.39:0/3248001415 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d34003a00 0x7f1d34003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:20.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.145+0000 7f1d508ce640 1 --2- 172.21.15.39:0/3248001415 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d34004800 0x7f1d34004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:20.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.145+0000 7f1d508ce640 1 --2- 172.21.15.39:0/3248001415 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d34005150 0x7f1d3400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:20.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.145+0000 7f1d508ce640 1 -- 172.21.15.39:0/3248001415 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4c06cc90 con 0x7f1d34005150 2024-05-14T14:40:20.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.145+0000 7f1d508ce640 1 -- 172.21.15.39:0/3248001415 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4c06cf70 con 0x7f1d34004800 2024-05-14T14:40:20.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.145+0000 7f1d508ce640 1 -- 172.21.15.39:0/3248001415 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f1d3400c030 con 0x7f1d34003a00 2024-05-14T14:40:20.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.145+0000 7f1d510cf640 1 --2- 172.21.15.39:0/3248001415 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d4c0d4720 0x7f1d4c0b9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T14:40:20.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.145+0000 7f1d520d1640 1 --2- 172.21.15.39:0/3248001415 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d34005150 0x7f1d3400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:20.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.145+0000 7f1d518d0640 1 --2- 172.21.15.39:0/3248001415 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d34003a00 0x7f1d34003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:20.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.145+0000 7f1d510cf640 1 --2- 172.21.15.39:0/3248001415 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d34004800 0x7f1d34004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:20.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.145+0000 7f1d520d1640 1 -- 172.21.15.39:0/3248001415 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d34003a00 msgr2=0x7f1d34003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:20.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.145+0000 7f1d520d1640 1 --2- 172.21.15.39:0/3248001415 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d34003a00 0x7f1d34003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:20.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.145+0000 7f1d520d1640 1 -- 172.21.15.39:0/3248001415 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d34004800 msgr2=0x7f1d34004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:20.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.145+0000 7f1d520d1640 1 --2- 172.21.15.39:0/3248001415 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d34004800 0x7f1d34004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:20.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.145+0000 7f1d520d1640 1 -- 172.21.15.39:0/3248001415 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d34003520 con 0x7f1d34005150 2024-05-14T14:40:20.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.146+0000 7f1d520d1640 1 --2- 172.21.15.39:0/3248001415 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d34005150 0x7f1d3400b9c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009fc0 tx=0x7f1d34005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21fed978bcf42c80 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:20.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.146+0000 7f1d508ce640 1 -- 172.21.15.39:0/3248001415 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c009c10 con 0x7f1d34005150 2024-05-14T14:40:20.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.146+0000 7f1d508ce640 1 -- 172.21.15.39:0/3248001415 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d3c036070 con 0x7f1d34005150 2024-05-14T14:40:20.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.146+0000 7f1d508ce640 1 -- 172.21.15.39:0/3248001415 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c02d070 con 0x7f1d34005150 2024-05-14T14:40:20.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.147+0000 7f1d53b34640 1 -- 172.21.15.39:0/3248001415 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d34005150 msgr2=0x7f1d3400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:20.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.147+0000 7f1d53b34640 1 --2- 172.21.15.39:0/3248001415 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d34005150 0x7f1d3400b9c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009fc0 tx=0x7f1d34005830 comp rx=0 tx=0).stop 2024-05-14T14:40:20.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.147+0000 7f1d520d1640 1 -- 172.21.15.39:0/3248001415 reap_dead start 2024-05-14T14:40:20.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.147+0000 7f1d53b34640 1 -- 172.21.15.39:0/3248001415 shutdown_connections 2024-05-14T14:40:20.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.147+0000 7f1d53b34640 1 -- 172.21.15.39:0/3248001415 >> 172.21.15.39:0/3248001415 conn(0x7f1d4c06f210 msgr2=0x7f1d4c0d5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:20.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.147+0000 7f1d53b34640 1 -- 172.21.15.39:0/3248001415 shutdown_connections 2024-05-14T14:40:20.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.147+0000 7f1d53b34640 1 -- 172.21.15.39:0/3248001415 wait complete. 2024-05-14T14:40:20.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.149+0000 7f1d53b34640 1 Processor -- start 2024-05-14T14:40:20.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.149+0000 7f1d53b34640 1 -- start start 2024-05-14T14:40:20.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.150+0000 7f1d53b34640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d4c158c70 0x7f1d4c0c8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:20.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.150+0000 7f1d53b34640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d4c15b5b0 0x7f1d4c161980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:20.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.150+0000 7f1d53b34640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d4c15b9c0 0x7f1d4c161ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:20.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.150+0000 7f1d53b34640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4c06c6a0 con 0x7f1d4c15b9c0 2024-05-14T14:40:20.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.150+0000 7f1d53b34640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4c0b5530 con 0x7f1d4c15b5b0 2024-05-14T14:40:20.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.150+0000 7f1d53b34640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f1d4c0b9220 con 0x7f1d4c158c70 2024-05-14T14:40:20.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.150+0000 7f1d520d1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d4c15b9c0 0x7f1d4c161ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:20.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.150+0000 7f1d520d1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d4c15b9c0 0x7f1d4c161ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47408/0 (socket says 172.21.15.39:47408) 2024-05-14T14:40:20.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.150+0000 7f1d520d1640 1 -- 172.21.15.39:0/2346178112 learned_addr learned my addr 172.21.15.39:0/2346178112 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:20.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.150+0000 7f1d518d0640 1 --2- 172.21.15.39:0/2346178112 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d4c158c70 0x7f1d4c0c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:20.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.150+0000 7f1d510cf640 1 --2- 172.21.15.39:0/2346178112 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d4c15b5b0 0x7f1d4c161980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:20.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.150+0000 7f1d520d1640 1 -- 172.21.15.39:0/2346178112 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d4c158c70 msgr2=0x7f1d4c0c8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:20.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.150+0000 7f1d520d1640 1 --2- 172.21.15.39:0/2346178112 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d4c158c70 0x7f1d4c0c8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:20.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.150+0000 7f1d520d1640 1 -- 172.21.15.39:0/2346178112 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d4c15b5b0 msgr2=0x7f1d4c161980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:20.138 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.150+0000 7f1d520d1640 1 --2- 172.21.15.39:0/2346178112 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d4c15b5b0 0x7f1d4c161980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:20.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.150+0000 7f1d520d1640 1 -- 172.21.15.39:0/2346178112 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d4c0c8da0 con 0x7f1d4c15b9c0 2024-05-14T14:40:20.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.151+0000 7f1d520d1640 1 --2- 172.21.15.39:0/2346178112 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d4c15b9c0 0x7f1d4c161ec0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c00e230 tx=0x7f1d3c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:20.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.151+0000 7f1d4a7fc640 1 -- 172.21.15.39:0/2346178112 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c009c10 con 0x7f1d4c15b9c0 2024-05-14T14:40:20.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.151+0000 7f1d4a7fc640 1 -- 172.21.15.39:0/2346178112 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d3c003bb0 con 0x7f1d4c15b9c0 2024-05-14T14:40:20.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.151+0000 7f1d53b34640 1 -- 172.21.15.39:0/2346178112 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d4c1e9d70 con 0x7f1d4c15b9c0 2024-05-14T14:40:20.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.151+0000 7f1d4a7fc640 1 -- 172.21.15.39:0/2346178112 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c004020 con 0x7f1d4c15b9c0 2024-05-14T14:40:20.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.151+0000 7f1d53b34640 1 -- 172.21.15.39:0/2346178112 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d4c1ea330 con 0x7f1d4c15b9c0 2024-05-14T14:40:20.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.152+0000 7f1d53b34640 1 -- 172.21.15.39:0/2346178112 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d4c076aa0 con 0x7f1d4c15b9c0 2024-05-14T14:40:20.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.153+0000 7f1d4a7fc640 1 -- 172.21.15.39:0/2346178112 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1d3c005d10 con 0x7f1d4c15b9c0 2024-05-14T14:40:20.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.153+0000 7f1d4a7fc640 1 --2- 172.21.15.39:0/2346178112 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1d380762d0 0x7f1d380787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:20.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.153+0000 7f1d518d0640 1 --2- 172.21.15.39:0/2346178112 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1d380762d0 0x7f1d380787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:20.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.153+0000 7f1d4a7fc640 1 -- 172.21.15.39:0/2346178112 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7f1d3c0b8b60 con 0x7f1d4c15b9c0 2024-05-14T14:40:20.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.154+0000 7f1d518d0640 1 --2- 172.21.15.39:0/2346178112 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1d380762d0 0x7f1d380787e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c158c20 tx=0x7f1d440078f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:20.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.158+0000 7f1d4a7fc640 1 -- 172.21.15.39:0/2346178112 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1d3c04a060 con 0x7f1d4c15b9c0 2024-05-14T14:40:20.380 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:20.396+0000 7f1d53b34640 1 -- 172.21.15.39:0/2346178112 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f1d4c0d4120 con 0x7f1d4c15b9c0 2024-05-14T14:40:20.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.008+0000 7f1d4a7fc640 1 -- 172.21.15.39:0/2346178112 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) ==== 137+0+0 (secure 0 0 0) 0x7f1d4c0c8da0 con 0x7f1d4c15b9c0 2024-05-14T14:40:20.993 INFO:teuthology.orchestra.run.smithi039.stderr:added data pool 4 to fsmap 2024-05-14T14:40:20.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.010+0000 7f1d53b34640 1 -- 172.21.15.39:0/2346178112 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1d380762d0 msgr2=0x7f1d380787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:20.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.010+0000 7f1d53b34640 1 --2- 172.21.15.39:0/2346178112 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1d380762d0 0x7f1d380787e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c158c20 tx=0x7f1d440078f0 comp rx=0 tx=0).stop 2024-05-14T14:40:20.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.010+0000 7f1d53b34640 1 -- 172.21.15.39:0/2346178112 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d4c15b9c0 msgr2=0x7f1d4c161ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:20.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.010+0000 7f1d53b34640 1 --2- 172.21.15.39:0/2346178112 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d4c15b9c0 0x7f1d4c161ec0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c00e230 tx=0x7f1d3c009750 comp rx=0 tx=0).stop 2024-05-14T14:40:20.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.011+0000 7f1d53b34640 1 -- 172.21.15.39:0/2346178112 shutdown_connections 2024-05-14T14:40:20.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.011+0000 7f1d53b34640 1 --2- 172.21.15.39:0/2346178112 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1d380762d0 0x7f1d380787e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:20.996 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.011+0000 7f1d53b34640 1 --2- 172.21.15.39:0/2346178112 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1d4c15b9c0 0x7f1d4c161ec0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:20.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.011+0000 7f1d53b34640 1 --2- 172.21.15.39:0/2346178112 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1d4c15b5b0 0x7f1d4c161980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:20.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.011+0000 7f1d53b34640 1 --2- 172.21.15.39:0/2346178112 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1d4c158c70 0x7f1d4c0c8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:20.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.011+0000 7f1d53b34640 1 -- 172.21.15.39:0/2346178112 >> 172.21.15.39:0/2346178112 conn(0x7f1d4c06f210 msgr2=0x7f1d4c068610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:20.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.011+0000 7f1d53b34640 1 -- 172.21.15.39:0/2346178112 shutdown_connections 2024-05-14T14:40:20.997 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.011+0000 7f1d53b34640 1 -- 172.21.15.39:0/2346178112 wait complete. 2024-05-14T14:40:21.009 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T14:40:21.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.146+0000 7f7fc0c42640 1 Processor -- start 2024-05-14T14:40:21.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.146+0000 7f7fc0c42640 1 -- start start 2024-05-14T14:40:21.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.147+0000 7f7fc0c42640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7fbc164c60 0x7f7fbc1638e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:21.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.148+0000 7f7fc0c42640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7fbc0b30b0 0x7f7fbc072fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:21.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.148+0000 7f7fc0c42640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fbc0cf480 0x7f7fbc073510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:21.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.148+0000 7f7fc0c42640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f7fbc0b6db0 con 0x7f7fbc0b30b0 2024-05-14T14:40:21.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.148+0000 7f7fc0c42640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f7fbc0b6ad0 con 0x7f7fbc164c60 2024-05-14T14:40:21.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.148+0000 7f7fc0c42640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f7fbc164180 con 0x7f7fbc0cf480 2024-05-14T14:40:21.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.148+0000 7f7fb3fff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7fbc0b30b0 0x7f7fbc072fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:21.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.148+0000 7f7fb3fff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7fbc0b30b0 0x7f7fbc072fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47422/0 (socket says 172.21.15.39:47422) 2024-05-14T14:40:21.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.148+0000 7f7fb3fff640 1 -- 172.21.15.39:0/3172194674 learned_addr learned my addr 172.21.15.39:0/3172194674 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:21.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.148+0000 7f7fbad9d640 1 --2- 172.21.15.39:0/3172194674 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fbc0cf480 0x7f7fbc073510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:21.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.148+0000 7f7fba59c640 1 --2- 172.21.15.39:0/3172194674 >> v2:172.21.15.62:3300/0 conn(0x7f7fbc164c60 0x7f7fbc1638e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:21.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.148+0000 7f7fb3fff640 1 -- 172.21.15.39:0/3172194674 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fbc0cf480 msgr2=0x7f7fbc073510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:21.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.148+0000 7f7fb3fff640 1 --2- 172.21.15.39:0/3172194674 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fbc0cf480 0x7f7fbc073510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:21.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.148+0000 7f7fb3fff640 1 -- 172.21.15.39:0/3172194674 >> v2:172.21.15.62:3300/0 conn(0x7f7fbc164c60 msgr2=0x7f7fbc1638e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:21.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.148+0000 7f7fb3fff640 1 --2- 172.21.15.39:0/3172194674 >> v2:172.21.15.62:3300/0 conn(0x7f7fbc164c60 0x7f7fbc1638e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:21.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.148+0000 7f7fb3fff640 1 -- 172.21.15.39:0/3172194674 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fbc164460 con 0x7f7fbc0b30b0 2024-05-14T14:40:21.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.148+0000 7f7fbad9d640 1 --2- 172.21.15.39:0/3172194674 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fbc0cf480 0x7f7fbc073510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:40:21.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.148+0000 7f7fba59c640 1 --2- 172.21.15.39:0/3172194674 >> v2:172.21.15.62:3300/0 conn(0x7f7fbc164c60 0x7f7fbc1638e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:40:21.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.149+0000 7f7fb3fff640 1 --2- 172.21.15.39:0/3172194674 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7fbc0b30b0 0x7f7fbc072fd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc074ae0 tx=0x7f7fa402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=660adccb8e21a63d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:21.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.149+0000 7f7fb9d9b640 1 -- 172.21.15.39:0/3172194674 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa4037070 con 0x7f7fbc0b30b0 2024-05-14T14:40:21.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.149+0000 7f7fb9d9b640 1 -- 172.21.15.39:0/3172194674 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fa4032440 con 0x7f7fbc0b30b0 2024-05-14T14:40:21.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.149+0000 7f7fb9d9b640 1 -- 172.21.15.39:0/3172194674 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fa4032810 con 0x7f7fbc0b30b0 2024-05-14T14:40:21.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.150+0000 7f7fc0c42640 1 -- 172.21.15.39:0/3172194674 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7fbc0b30b0 msgr2=0x7f7fbc072fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:21.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.150+0000 7f7fc0c42640 1 --2- 172.21.15.39:0/3172194674 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7fbc0b30b0 0x7f7fbc072fd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc074ae0 tx=0x7f7fa402a1e0 comp rx=0 tx=0).stop 2024-05-14T14:40:21.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.150+0000 7f7fc0c42640 1 -- 172.21.15.39:0/3172194674 shutdown_connections 2024-05-14T14:40:21.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.150+0000 7f7fc0c42640 1 --2- 172.21.15.39:0/3172194674 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7fbc0b30b0 0x7f7fbc072fd0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:21.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.150+0000 7f7fc0c42640 1 --2- 172.21.15.39:0/3172194674 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fbc0cf480 0x7f7fbc073510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:21.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.150+0000 7f7fc0c42640 1 --2- 172.21.15.39:0/3172194674 >> v2:172.21.15.62:3300/0 conn(0x7f7fbc164c60 0x7f7fbc1638e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:21.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.150+0000 7f7fc0c42640 1 -- 172.21.15.39:0/3172194674 >> 172.21.15.39:0/3172194674 conn(0x7f7fbc0d3ae0 msgr2=0x7f7fbc0d3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:21.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.150+0000 7f7fc0c42640 1 -- 172.21.15.39:0/3172194674 shutdown_connections 2024-05-14T14:40:21.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.150+0000 7f7fc0c42640 1 -- 172.21.15.39:0/3172194674 wait complete. 2024-05-14T14:40:21.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.152+0000 7f7fc0c42640 1 Processor -- start 2024-05-14T14:40:21.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.152+0000 7f7fc0c42640 1 -- start start 2024-05-14T14:40:21.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.153+0000 7f7fc0c42640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7fbc0b30b0 0x7f7fbc1eb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:21.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.153+0000 7f7fc0c42640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fbc0cf480 0x7f7fbc15c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:21.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.153+0000 7f7fc0c42640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fbc15d150 0x7f7fbc0afab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:21.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.153+0000 7f7fc0c42640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7fbc0d1b60 con 0x7f7fbc0b30b0 2024-05-14T14:40:21.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.153+0000 7f7fc0c42640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f7fbc0d19e0 con 0x7f7fbc0cf480 2024-05-14T14:40:21.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.153+0000 7f7fc0c42640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f7fbc0d1ce0 con 0x7f7fbc15d150 2024-05-14T14:40:21.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.153+0000 7f7fba59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7fbc0b30b0 0x7f7fbc1eb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:21.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.153+0000 7f7fba59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7fbc0b30b0 0x7f7fbc1eb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47432/0 (socket says 172.21.15.39:47432) 2024-05-14T14:40:21.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.153+0000 7f7fba59c640 1 -- 172.21.15.39:0/3057804414 learned_addr learned my addr 172.21.15.39:0/3057804414 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:21.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.153+0000 7f7fb3fff640 1 --2- 172.21.15.39:0/3057804414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fbc0cf480 0x7f7fbc15c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:21.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.153+0000 7f7fbad9d640 1 --2- 172.21.15.39:0/3057804414 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fbc15d150 0x7f7fbc0afab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:21.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.154+0000 7f7fba59c640 1 -- 172.21.15.39:0/3057804414 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fbc15d150 msgr2=0x7f7fbc0afab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:21.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.154+0000 7f7fba59c640 1 --2- 172.21.15.39:0/3057804414 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fbc15d150 0x7f7fbc0afab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:21.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.154+0000 7f7fba59c640 1 -- 172.21.15.39:0/3057804414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fbc0cf480 msgr2=0x7f7fbc15c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:21.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.154+0000 7f7fba59c640 1 --2- 172.21.15.39:0/3057804414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fbc0cf480 0x7f7fbc15c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:21.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.154+0000 7f7fba59c640 1 -- 172.21.15.39:0/3057804414 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fbc1ea0f0 con 0x7f7fbc0b30b0 2024-05-14T14:40:21.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.154+0000 7f7fba59c640 1 --2- 172.21.15.39:0/3057804414 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7fbc0b30b0 0x7f7fbc1eb190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7fac00d800 tx=0x7f7fac00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:21.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.154+0000 7f7fb2ffd640 1 -- 172.21.15.39:0/3057804414 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fac0096a0 con 0x7f7fbc0b30b0 2024-05-14T14:40:21.140 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.154+0000 7f7fb2ffd640 1 -- 172.21.15.39:0/3057804414 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fac019070 con 0x7f7fbc0b30b0 2024-05-14T14:40:21.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.154+0000 7f7fb2ffd640 1 -- 172.21.15.39:0/3057804414 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fac009a80 con 0x7f7fbc0b30b0 2024-05-14T14:40:21.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.154+0000 7f7fc0c42640 1 -- 172.21.15.39:0/3057804414 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fbc1ea3d0 con 0x7f7fbc0b30b0 2024-05-14T14:40:21.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.154+0000 7f7fc0c42640 1 -- 172.21.15.39:0/3057804414 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fbc1ea990 con 0x7f7fbc0b30b0 2024-05-14T14:40:21.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.155+0000 7f7fc0c42640 1 -- 172.21.15.39:0/3057804414 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fbc076aa0 con 0x7f7fbc0b30b0 2024-05-14T14:40:21.141 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.156+0000 7f7fb2ffd640 1 -- 172.21.15.39:0/3057804414 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7fac009c20 con 0x7f7fbc0b30b0 2024-05-14T14:40:21.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.156+0000 7f7fb2ffd640 1 --2- 172.21.15.39:0/3057804414 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f7f9c076300 0x7f7f9c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:21.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.156+0000 7f7fb2ffd640 1 -- 172.21.15.39:0/3057804414 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7fac097b80 con 0x7f7fbc0b30b0 2024-05-14T14:40:21.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.157+0000 7f7fb3fff640 1 --2- 172.21.15.39:0/3057804414 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f7f9c076300 0x7f7f9c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:21.142 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.157+0000 7f7fb3fff640 1 --2- 172.21.15.39:0/3057804414 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f7f9c076300 0x7f7f9c078810 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4034000 tx=0x7f7fa402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:21.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.161+0000 7f7fb2ffd640 1 -- 172.21.15.39:0/3057804414 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7fac060b50 con 0x7f7fbc0b30b0 2024-05-14T14:40:21.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.397+0000 7f7fc0c42640 1 -- 172.21.15.39:0/3057804414 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7fbc0b7b00 con 0x7f7fbc0b30b0 2024-05-14T14:40:21.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.398+0000 7f7fb2ffd640 1 -- 172.21.15.39:0/3057804414 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5171 (secure 0 0 0) 0x7f7fac064e50 con 0x7f7fbc0b30b0 2024-05-14T14:40:21.382 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:40:21.382 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/3753262818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3753262818},{"type":"v1","addr":"172.21.15.62:6834","nonce":3753262818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/97693396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6835","nonce":97693396},{"type":"v1","addr":"172.21.15.39:6837","nonce":97693396}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6836/1648047942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":1648047942},{"type":"v1","addr":"172.21.15.39:6836","nonce":1648047942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T14:40:15.320927+0000","modified":"2024-05-14T14:40:20.397850+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/1519798364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":1519798364},{"type":"v1","addr":"172.21.15.62:6835","nonce":1519798364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-05-14T14:40:21.383 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 7 2024-05-14T14:40:21.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.400+0000 7f7fc0c42640 1 -- 172.21.15.39:0/3057804414 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f7f9c076300 msgr2=0x7f7f9c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:21.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.400+0000 7f7fc0c42640 1 --2- 172.21.15.39:0/3057804414 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f7f9c076300 0x7f7f9c078810 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4034000 tx=0x7f7fa402e000 comp rx=0 tx=0).stop 2024-05-14T14:40:21.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.400+0000 7f7fc0c42640 1 -- 172.21.15.39:0/3057804414 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7fbc0b30b0 msgr2=0x7f7fbc1eb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:21.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.400+0000 7f7fc0c42640 1 --2- 172.21.15.39:0/3057804414 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7fbc0b30b0 0x7f7fbc1eb190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7fac00d800 tx=0x7f7fac00dcc0 comp rx=0 tx=0).stop 2024-05-14T14:40:21.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.400+0000 7f7fc0c42640 1 -- 172.21.15.39:0/3057804414 shutdown_connections 2024-05-14T14:40:21.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.400+0000 7f7fc0c42640 1 --2- 172.21.15.39:0/3057804414 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f7f9c076300 0x7f7f9c078810 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:21.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.400+0000 7f7fc0c42640 1 --2- 172.21.15.39:0/3057804414 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7fbc15d150 0x7f7fbc0afab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:21.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.400+0000 7f7fc0c42640 1 --2- 172.21.15.39:0/3057804414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7fbc0cf480 0x7f7fbc15c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:21.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.400+0000 7f7fc0c42640 1 --2- 172.21.15.39:0/3057804414 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7fbc0b30b0 0x7f7fbc1eb190 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:21.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.400+0000 7f7fc0c42640 1 -- 172.21.15.39:0/3057804414 >> 172.21.15.39:0/3057804414 conn(0x7f7fbc0d3ae0 msgr2=0x7f7fbc0b4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:21.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.400+0000 7f7fc0c42640 1 -- 172.21.15.39:0/3057804414 shutdown_connections 2024-05-14T14:40:21.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.400+0000 7f7fc0c42640 1 -- 172.21.15.39:0/3057804414 wait complete. 2024-05-14T14:40:21.396 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T14:40:21.457 INFO:tasks.ceph.mds.b.smithi062.stderr:2024-05-14T14:40:21.473+0000 7fc00080a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-14T14:40:21.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.526+0000 7f0edc196640 1 Processor -- start 2024-05-14T14:40:21.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.526+0000 7f0edc196640 1 -- start start 2024-05-14T14:40:21.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.528+0000 7f0edc196640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0ed4160420 0x7f0ed40d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:21.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.528+0000 7f0edc196640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ed40d1140 0x7f0ed406d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:21.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.528+0000 7f0edc196640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0ed406d5f0 0x7f0ed40d49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:21.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.528+0000 7f0edc196640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f0ed40b9310 con 0x7f0ed406d5f0 2024-05-14T14:40:21.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.528+0000 7f0edc196640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f0ed40d1550 con 0x7f0ed4160420 2024-05-14T14:40:21.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.528+0000 7f0edc196640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f0ed406dd70 con 0x7f0ed40d1140 2024-05-14T14:40:21.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.528+0000 7f0eda733640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0ed406d5f0 0x7f0ed40d49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:21.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.528+0000 7f0eda733640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0ed406d5f0 0x7f0ed40d49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47444/0 (socket says 172.21.15.39:47444) 2024-05-14T14:40:21.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.528+0000 7f0eda733640 1 -- 172.21.15.39:0/776953621 learned_addr learned my addr 172.21.15.39:0/776953621 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:21.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.528+0000 7f0ed9f32640 1 --2- 172.21.15.39:0/776953621 >> v2:172.21.15.62:3300/0 conn(0x7f0ed4160420 0x7f0ed40d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:21.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.528+0000 7f0ed9731640 1 --2- 172.21.15.39:0/776953621 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ed40d1140 0x7f0ed406d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:21.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.528+0000 7f0eda733640 1 -- 172.21.15.39:0/776953621 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ed40d1140 msgr2=0x7f0ed406d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:21.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.528+0000 7f0eda733640 1 --2- 172.21.15.39:0/776953621 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ed40d1140 0x7f0ed406d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:21.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.528+0000 7f0eda733640 1 -- 172.21.15.39:0/776953621 >> v2:172.21.15.62:3300/0 conn(0x7f0ed4160420 msgr2=0x7f0ed40d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:21.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.528+0000 7f0eda733640 1 --2- 172.21.15.39:0/776953621 >> v2:172.21.15.62:3300/0 conn(0x7f0ed4160420 0x7f0ed40d0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:21.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.528+0000 7f0eda733640 1 -- 172.21.15.39:0/776953621 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed40b9590 con 0x7f0ed406d5f0 2024-05-14T14:40:21.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.528+0000 7f0ed9731640 1 --2- 172.21.15.39:0/776953621 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ed40d1140 0x7f0ed406d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:40:21.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.529+0000 7f0eda733640 1 --2- 172.21.15.39:0/776953621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ed406d5f0 0x7f0ed40d49e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0ed40b8910 tx=0x7f0ecc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=191aaaf3e730a1ef server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:21.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.529+0000 7f0ed8f30640 1 -- 172.21.15.39:0/776953621 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc037070 con 0x7f0ed406d5f0 2024-05-14T14:40:21.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.529+0000 7f0ed8f30640 1 -- 172.21.15.39:0/776953621 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ecc032440 con 0x7f0ed406d5f0 2024-05-14T14:40:21.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.529+0000 7f0ed8f30640 1 -- 172.21.15.39:0/776953621 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc032810 con 0x7f0ed406d5f0 2024-05-14T14:40:21.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.530+0000 7f0edc196640 1 -- 172.21.15.39:0/776953621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ed406d5f0 msgr2=0x7f0ed40d49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:21.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.530+0000 7f0edc196640 1 --2- 172.21.15.39:0/776953621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ed406d5f0 0x7f0ed40d49e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0ed40b8910 tx=0x7f0ecc02a140 comp rx=0 tx=0).stop 2024-05-14T14:40:21.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.530+0000 7f0edc196640 1 -- 172.21.15.39:0/776953621 shutdown_connections 2024-05-14T14:40:21.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.530+0000 7f0edc196640 1 --2- 172.21.15.39:0/776953621 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ed406d5f0 0x7f0ed40d49e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:21.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.530+0000 7f0edc196640 1 --2- 172.21.15.39:0/776953621 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ed40d1140 0x7f0ed406d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:21.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.530+0000 7f0edc196640 1 --2- 172.21.15.39:0/776953621 >> v2:172.21.15.62:3300/0 conn(0x7f0ed4160420 0x7f0ed40d0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:21.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.530+0000 7f0edc196640 1 -- 172.21.15.39:0/776953621 >> 172.21.15.39:0/776953621 conn(0x7f0ed40d27d0 msgr2=0x7f0ed40d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:21.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.530+0000 7f0edc196640 1 -- 172.21.15.39:0/776953621 shutdown_connections 2024-05-14T14:40:21.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.530+0000 7f0edc196640 1 -- 172.21.15.39:0/776953621 wait complete. 2024-05-14T14:40:21.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.532+0000 7f0edc196640 1 Processor -- start 2024-05-14T14:40:21.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.532+0000 7f0edc196640 1 -- start start 2024-05-14T14:40:21.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.533+0000 7f0edc196640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ed406d5f0 0x7f0ed41f6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:21.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.533+0000 7f0edc196640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ed40d1140 0x7f0ed4157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:21.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.533+0000 7f0edc196640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ed4160420 0x7f0ed4158450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:21.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.533+0000 7f0edc196640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed4160830 con 0x7f0ed40d1140 2024-05-14T14:40:21.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.533+0000 7f0edc196640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed40b9b50 con 0x7f0ed4160420 2024-05-14T14:40:21.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.533+0000 7f0edc196640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f0ed406da00 con 0x7f0ed406d5f0 2024-05-14T14:40:21.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.533+0000 7f0ed9731640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ed40d1140 0x7f0ed4157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:21.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.533+0000 7f0ed9731640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ed40d1140 0x7f0ed4157270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47446/0 (socket says 172.21.15.39:47446) 2024-05-14T14:40:21.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.533+0000 7f0ed9731640 1 -- 172.21.15.39:0/1749435083 learned_addr learned my addr 172.21.15.39:0/1749435083 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:21.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.534+0000 7f0eda733640 1 --2- 172.21.15.39:0/1749435083 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ed4160420 0x7f0ed4158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:21.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.534+0000 7f0ed9f32640 1 --2- 172.21.15.39:0/1749435083 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ed406d5f0 0x7f0ed41f6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:21.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.534+0000 7f0ed9731640 1 -- 172.21.15.39:0/1749435083 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ed406d5f0 msgr2=0x7f0ed41f6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:21.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.534+0000 7f0ed9731640 1 --2- 172.21.15.39:0/1749435083 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ed406d5f0 0x7f0ed41f6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:21.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.534+0000 7f0ed9731640 1 -- 172.21.15.39:0/1749435083 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ed4160420 msgr2=0x7f0ed4158450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:21.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.534+0000 7f0ed9731640 1 --2- 172.21.15.39:0/1749435083 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ed4160420 0x7f0ed4158450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:21.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.534+0000 7f0ed9731640 1 -- 172.21.15.39:0/1749435083 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed41577b0 con 0x7f0ed40d1140 2024-05-14T14:40:21.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.534+0000 7f0ed9f32640 1 --2- 172.21.15.39:0/1749435083 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ed406d5f0 0x7f0ed41f6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:40:21.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.534+0000 7f0eda733640 1 --2- 172.21.15.39:0/1749435083 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ed4160420 0x7f0ed4158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:40:21.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.534+0000 7f0ed9731640 1 --2- 172.21.15.39:0/1749435083 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ed40d1140 0x7f0ed4157270 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0ec400d830 tx=0x7f0ec400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:21.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.534+0000 7f0eca7fc640 1 -- 172.21.15.39:0/1749435083 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4018070 con 0x7f0ed40d1140 2024-05-14T14:40:21.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.534+0000 7f0eca7fc640 1 -- 172.21.15.39:0/1749435083 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ec400be10 con 0x7f0ed40d1140 2024-05-14T14:40:21.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.534+0000 7f0edc196640 1 -- 172.21.15.39:0/1749435083 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ed40c9690 con 0x7f0ed40d1140 2024-05-14T14:40:21.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.534+0000 7f0eca7fc640 1 -- 172.21.15.39:0/1749435083 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4004250 con 0x7f0ed40d1140 2024-05-14T14:40:21.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.534+0000 7f0edc196640 1 -- 172.21.15.39:0/1749435083 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ed40c9c30 con 0x7f0ed40d1140 2024-05-14T14:40:21.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.535+0000 7f0edc196640 1 -- 172.21.15.39:0/1749435083 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ed4076aa0 con 0x7f0ed40d1140 2024-05-14T14:40:21.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.536+0000 7f0eca7fc640 1 -- 172.21.15.39:0/1749435083 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0ec4009850 con 0x7f0ed40d1140 2024-05-14T14:40:21.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.537+0000 7f0eca7fc640 1 --2- 172.21.15.39:0/1749435083 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0eb80762d0 0x7f0eb80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:21.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.537+0000 7f0ed9f32640 1 --2- 172.21.15.39:0/1749435083 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0eb80762d0 0x7f0eb80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:21.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.537+0000 7f0eca7fc640 1 -- 172.21.15.39:0/1749435083 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0ec4097b70 con 0x7f0ed40d1140 2024-05-14T14:40:21.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.537+0000 7f0ed9f32640 1 --2- 172.21.15.39:0/1749435083 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0eb80762d0 0x7f0eb80787e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0007440 tx=0x7f0ed000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:21.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.541+0000 7f0eca7fc640 1 -- 172.21.15.39:0/1749435083 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0ed41577b0 con 0x7f0ed40d1140 2024-05-14T14:40:21.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.732+0000 7f0edc196640 1 -- 172.21.15.39:0/1749435083 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0ed415a9c0 con 0x7f0ed40d1140 2024-05-14T14:40:21.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.733+0000 7f0eca7fc640 1 -- 172.21.15.39:0/1749435083 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18454 (secure 0 0 0) 0x7f0ec4061100 con 0x7f0ed40d1140 2024-05-14T14:40:21.718 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:40:21.718 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"fsid":"d7983fec-79c7-4991-b19c-1aecead64611","created":"2024-05-14T14:39:52.157167+0000","modified":"2024-05-14T14:40:20.397684+0000","last_up_change":"2024-05-14T14:40:03.848608+0000","last_in_change":"2024-05-14T14:39:54.591920+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T14:40:04.692846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T14:40:13.794415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T14:40:14.273154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T14:40:17.979457+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c4ec4534-6301-4dd7-b4d6-d560b096d442","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6801","nonce":4023478848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6803","nonce":4023478848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6807","nonce":4023478848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6805","nonce":4023478848}]},"public_addr":"172.21.15.39:6801/4023478848","cluster_addr":"172.21.15.39:6803/4023478848","heartbeat_back_addr":"172.21.15.39:6807/4023478848","heartbeat_front_addr":"172.21.15.39:6805/4023478848","state":["exists","up"]},{"osd":1,"uuid":"93f91b0e-096e-4bdf-aed0-d1136f73f136","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6817","nonce":926357398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6819","nonce":926357398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6823","nonce":926357398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6821","nonce":926357398}]},"public_addr":"172.21.15.39:6817/926357398","cluster_addr":"172.21.15.39:6819/926357398","heartbeat_back_addr":"172.21.15.39:6823/926357398","heartbeat_front_addr":"172.21.15.39:6821/926357398","state":["exists","up"]},{"osd":2,"uuid":"c590b1e0-67eb-452e-8e80-d2208da17d09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6809","nonce":610616754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6811","nonce":610616754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6815","nonce":610616754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6813","nonce":610616754}]},"public_addr":"172.21.15.39:6809/610616754","cluster_addr":"172.21.15.39:6811/610616754","heartbeat_back_addr":"172.21.15.39:6815/610616754","heartbeat_front_addr":"172.21.15.39:6813/610616754","state":["exists","up"]},{"osd":3,"uuid":"d57661b0-44f6-4355-9115-83eceb9b8f71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6825","nonce":1469314579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6827","nonce":1469314579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6831","nonce":1469314579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6829","nonce":1469314579}]},"public_addr":"172.21.15.39:6825/1469314579","cluster_addr":"172.21.15.39:6827/1469314579","heartbeat_back_addr":"172.21.15.39:6831/1469314579","heartbeat_front_addr":"172.21.15.39:6829/1469314579","state":["exists","up"]},{"osd":4,"uuid":"b131436f-f6e1-4d72-a86e-de200afdcebb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6825","nonce":3481507129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6827","nonce":3481507129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6831","nonce":3481507129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6829","nonce":3481507129}]},"public_addr":"172.21.15.62:6825/3481507129","cluster_addr":"172.21.15.62:6827/3481507129","heartbeat_back_addr":"172.21.15.62:6831/3481507129","heartbeat_front_addr":"172.21.15.62:6829/3481507129","state":["exists","up"]},{"osd":5,"uuid":"12e10b40-28b1-410f-9ce0-7b427daa111e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6801","nonce":3291934116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6803","nonce":3291934116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6807","nonce":3291934116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6805","nonce":3291934116}]},"public_addr":"172.21.15.62:6801/3291934116","cluster_addr":"172.21.15.62:6803/3291934116","heartbeat_back_addr":"172.21.15.62:6807/3291934116","heartbeat_front_addr":"172.21.15.62:6805/3291934116","state":["exists","up"]},{"osd":6,"uuid":"ad8950a5-70bd-488c-8f29-010515cc4a04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6817","nonce":3005996101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6819","nonce":3005996101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6823","nonce":3005996101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6821","nonce":3005996101}]},"public_addr":"172.21.15.62:6817/3005996101","cluster_addr":"172.21.15.62:6819/3005996101","heartbeat_back_addr":"172.21.15.62:6823/3005996101","heartbeat_front_addr":"172.21.15.62:6821/3005996101","state":["exists","up"]},{"osd":7,"uuid":"e0d4b8b7-3c80-4760-a342-1d508cdecc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6809","nonce":2800379225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6811","nonce":2800379225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6815","nonce":2800379225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6813","nonce":2800379225}]},"public_addr":"172.21.15.62:6809/2800379225","cluster_addr":"172.21.15.62:6811/2800379225","heartbeat_back_addr":"172.21.15.62:6815/2800379225","heartbeat_front_addr":"172.21.15.62:6813/2800379225","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.773714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.760037+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.811225+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.752810+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.745165+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.700634+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.768477+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.747301+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T14:40:21.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.736+0000 7f0edc196640 1 -- 172.21.15.39:0/1749435083 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0eb80762d0 msgr2=0x7f0eb80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:21.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.736+0000 7f0edc196640 1 --2- 172.21.15.39:0/1749435083 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0eb80762d0 0x7f0eb80787e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0007440 tx=0x7f0ed000b040 comp rx=0 tx=0).stop 2024-05-14T14:40:21.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.736+0000 7f0edc196640 1 -- 172.21.15.39:0/1749435083 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ed40d1140 msgr2=0x7f0ed4157270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:21.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.736+0000 7f0edc196640 1 --2- 172.21.15.39:0/1749435083 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ed40d1140 0x7f0ed4157270 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0ec400d830 tx=0x7f0ec400dcf0 comp rx=0 tx=0).stop 2024-05-14T14:40:21.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.736+0000 7f0edc196640 1 -- 172.21.15.39:0/1749435083 shutdown_connections 2024-05-14T14:40:21.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.736+0000 7f0edc196640 1 --2- 172.21.15.39:0/1749435083 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0eb80762d0 0x7f0eb80787e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:21.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.736+0000 7f0edc196640 1 --2- 172.21.15.39:0/1749435083 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ed4160420 0x7f0ed4158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:21.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.736+0000 7f0edc196640 1 --2- 172.21.15.39:0/1749435083 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0ed40d1140 0x7f0ed4157270 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:21.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.736+0000 7f0edc196640 1 --2- 172.21.15.39:0/1749435083 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0ed406d5f0 0x7f0ed41f6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:21.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.736+0000 7f0edc196640 1 -- 172.21.15.39:0/1749435083 >> 172.21.15.39:0/1749435083 conn(0x7f0ed40d27d0 msgr2=0x7f0ed40cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:21.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.736+0000 7f0edc196640 1 -- 172.21.15.39:0/1749435083 shutdown_connections 2024-05-14T14:40:21.721 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.736+0000 7f0edc196640 1 -- 172.21.15.39:0/1749435083 wait complete. 2024-05-14T14:40:21.731 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T14:40:21.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.861+0000 7fd9749e3640 1 Processor -- start 2024-05-14T14:40:21.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.861+0000 7fd9749e3640 1 -- start start 2024-05-14T14:40:21.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.863+0000 7fd9749e3640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd9700d11a0 0x7fd970160320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:21.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.863+0000 7fd9749e3640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd970161320 0x7fd97006cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:21.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.863+0000 7fd9749e3640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9701644a0 con 0x7fd970163e50 2024-05-14T14:40:21.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.863+0000 7fd9749e3640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fd970164260 con 0x7fd970161320 2024-05-14T14:40:21.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.863+0000 7fd9749e3640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fd970164780 con 0x7fd9700d11a0 2024-05-14T14:40:21.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.863+0000 7fd96ed9d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd970161320 0x7fd97006cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:21.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.863+0000 7fd96ed9d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fd970161320 0x7fd97006cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47454/0 (socket says 172.21.15.39:47454) 2024-05-14T14:40:21.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.863+0000 7fd96ed9d640 1 -- 172.21.15.39:0/3314114438 learned_addr learned my addr 172.21.15.39:0/3314114438 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:21.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.863+0000 7fd96dd9b640 1 --2- 172.21.15.39:0/3314114438 >> v2:172.21.15.62:3300/0 conn(0x7fd9700d11a0 0x7fd970160320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:21.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.863+0000 7fd96ed9d640 1 -- 172.21.15.39:0/3314114438 >> v2:172.21.15.62:3300/0 conn(0x7fd9700d11a0 msgr2=0x7fd970160320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:21.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.863+0000 7fd96ed9d640 1 --2- 172.21.15.39:0/3314114438 >> v2:172.21.15.62:3300/0 conn(0x7fd9700d11a0 0x7fd970160320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:21.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.863+0000 7fd96ed9d640 1 -- 172.21.15.39:0/3314114438 >> v1:172.21.15.62:6789/0 conn(0x7fd970163e50 legacy=0x7fd9700d0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:21.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.863+0000 7fd96ed9d640 1 -- 172.21.15.39:0/3314114438 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd970164a60 con 0x7fd970161320 2024-05-14T14:40:21.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.864+0000 7fd96ed9d640 1 --2- 172.21.15.39:0/3314114438 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd970161320 0x7fd97006cc20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd9700d57f0 tx=0x7fd96002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=665b99ea763f2e86 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:21.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.864+0000 7fd96d59a640 1 -- 172.21.15.39:0/3314114438 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd960036070 con 0x7fd970161320 2024-05-14T14:40:21.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.864+0000 7fd96d59a640 1 -- 172.21.15.39:0/3314114438 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd960031600 con 0x7fd970161320 2024-05-14T14:40:21.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.864+0000 7fd96d59a640 1 -- 172.21.15.39:0/3314114438 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9600319d0 con 0x7fd970161320 2024-05-14T14:40:21.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.865+0000 7fd9749e3640 1 -- 172.21.15.39:0/3314114438 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd970161320 msgr2=0x7fd97006cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:21.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.865+0000 7fd9749e3640 1 --2- 172.21.15.39:0/3314114438 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd970161320 0x7fd97006cc20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd9700d57f0 tx=0x7fd96002a610 comp rx=0 tx=0).stop 2024-05-14T14:40:21.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.865+0000 7fd9749e3640 1 -- 172.21.15.39:0/3314114438 shutdown_connections 2024-05-14T14:40:21.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.865+0000 7fd9749e3640 1 --2- 172.21.15.39:0/3314114438 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd970161320 0x7fd97006cc20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:21.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.865+0000 7fd9749e3640 1 --2- 172.21.15.39:0/3314114438 >> v2:172.21.15.62:3300/0 conn(0x7fd9700d11a0 0x7fd970160320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:21.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.865+0000 7fd9749e3640 1 -- 172.21.15.39:0/3314114438 >> 172.21.15.39:0/3314114438 conn(0x7fd9700b77d0 msgr2=0x7fd9700b7be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:21.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.865+0000 7fd9749e3640 1 -- 172.21.15.39:0/3314114438 shutdown_connections 2024-05-14T14:40:21.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.865+0000 7fd9749e3640 1 -- 172.21.15.39:0/3314114438 wait complete. 2024-05-14T14:40:21.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.867+0000 7fd9749e3640 1 Processor -- start 2024-05-14T14:40:21.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.867+0000 7fd9749e3640 1 -- start start 2024-05-14T14:40:21.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.868+0000 7fd9749e3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd970161320 0x7fd9700cf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:21.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.868+0000 7fd9749e3640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd970163e50 0x7fd970154830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:21.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.868+0000 7fd9749e3640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9700d4bf0 0x7fd9700d5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:21.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.868+0000 7fd9749e3640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd97006d160 con 0x7fd9700d4bf0 2024-05-14T14:40:21.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.868+0000 7fd9749e3640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd970161730 con 0x7fd970161320 2024-05-14T14:40:21.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.868+0000 7fd9749e3640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fd97006d2e0 con 0x7fd970163e50 2024-05-14T14:40:21.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.868+0000 7fd96ed9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9700d4bf0 0x7fd9700d5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:21.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.868+0000 7fd96ed9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9700d4bf0 0x7fd9700d5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47460/0 (socket says 172.21.15.39:47460) 2024-05-14T14:40:21.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.868+0000 7fd96ed9d640 1 -- 172.21.15.39:0/343915757 learned_addr learned my addr 172.21.15.39:0/343915757 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:21.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.869+0000 7fd96e59c640 1 --2- 172.21.15.39:0/343915757 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd970161320 0x7fd9700cf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:21.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.869+0000 7fd96dd9b640 1 --2- 172.21.15.39:0/343915757 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd970163e50 0x7fd970154830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:21.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.869+0000 7fd96ed9d640 1 -- 172.21.15.39:0/343915757 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd970163e50 msgr2=0x7fd970154830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:21.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.869+0000 7fd96ed9d640 1 --2- 172.21.15.39:0/343915757 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd970163e50 0x7fd970154830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:21.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.869+0000 7fd96ed9d640 1 -- 172.21.15.39:0/343915757 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd970161320 msgr2=0x7fd9700cf3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:21.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.869+0000 7fd96ed9d640 1 --2- 172.21.15.39:0/343915757 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd970161320 0x7fd9700cf3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:21.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.869+0000 7fd96ed9d640 1 -- 172.21.15.39:0/343915757 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9700d5540 con 0x7fd9700d4bf0 2024-05-14T14:40:21.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.869+0000 7fd96ed9d640 1 --2- 172.21.15.39:0/343915757 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9700d4bf0 0x7fd9700d5000 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd96002ac00 tx=0x7fd960004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:21.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.869+0000 7fd966ffd640 1 -- 172.21.15.39:0/343915757 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd960036050 con 0x7fd9700d4bf0 2024-05-14T14:40:21.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.869+0000 7fd966ffd640 1 -- 172.21.15.39:0/343915757 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd960042070 con 0x7fd9700d4bf0 2024-05-14T14:40:21.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.869+0000 7fd9749e3640 1 -- 172.21.15.39:0/343915757 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9700ccea0 con 0x7fd9700d4bf0 2024-05-14T14:40:21.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.869+0000 7fd966ffd640 1 -- 172.21.15.39:0/343915757 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd960009510 con 0x7fd9700d4bf0 2024-05-14T14:40:21.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.869+0000 7fd9749e3640 1 -- 172.21.15.39:0/343915757 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9700cd460 con 0x7fd9700d4bf0 2024-05-14T14:40:21.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.870+0000 7fd9749e3640 1 -- 172.21.15.39:0/343915757 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd970076aa0 con 0x7fd9700d4bf0 2024-05-14T14:40:21.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.871+0000 7fd966ffd640 1 -- 172.21.15.39:0/343915757 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd960007bd0 con 0x7fd9700d4bf0 2024-05-14T14:40:21.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.871+0000 7fd966ffd640 1 --2- 172.21.15.39:0/343915757 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fd9500762d0 0x7fd9500787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:21.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.872+0000 7fd96e59c640 1 --2- 172.21.15.39:0/343915757 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fd9500762d0 0x7fd9500787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:21.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.872+0000 7fd966ffd640 1 -- 172.21.15.39:0/343915757 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd9600b8730 con 0x7fd9700d4bf0 2024-05-14T14:40:21.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.872+0000 7fd96e59c640 1 --2- 172.21.15.39:0/343915757 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fd9500762d0 0x7fd9500787e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd9700b8fc0 tx=0x7fd968009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:21.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:21.876+0000 7fd966ffd640 1 -- 172.21.15.39:0/343915757 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd9700d5540 con 0x7fd9700d4bf0 2024-05-14T14:40:22.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.069+0000 7fd9749e3640 1 -- 172.21.15.39:0/343915757 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd9700d40e0 con 0x7fd9700d4bf0 2024-05-14T14:40:22.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.070+0000 7fd966ffd640 1 -- 172.21.15.39:0/343915757 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18454 (secure 0 0 0) 0x7fd960081670 con 0x7fd9700d4bf0 2024-05-14T14:40:22.054 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:40:22.054 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"fsid":"d7983fec-79c7-4991-b19c-1aecead64611","created":"2024-05-14T14:39:52.157167+0000","modified":"2024-05-14T14:40:20.397684+0000","last_up_change":"2024-05-14T14:40:03.848608+0000","last_in_change":"2024-05-14T14:39:54.591920+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T14:40:04.692846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T14:40:13.794415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T14:40:14.273154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T14:40:17.979457+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c4ec4534-6301-4dd7-b4d6-d560b096d442","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6801","nonce":4023478848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6803","nonce":4023478848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6807","nonce":4023478848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6805","nonce":4023478848}]},"public_addr":"172.21.15.39:6801/4023478848","cluster_addr":"172.21.15.39:6803/4023478848","heartbeat_back_addr":"172.21.15.39:6807/4023478848","heartbeat_front_addr":"172.21.15.39:6805/4023478848","state":["exists","up"]},{"osd":1,"uuid":"93f91b0e-096e-4bdf-aed0-d1136f73f136","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6817","nonce":926357398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6819","nonce":926357398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6823","nonce":926357398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6821","nonce":926357398}]},"public_addr":"172.21.15.39:6817/926357398","cluster_addr":"172.21.15.39:6819/926357398","heartbeat_back_addr":"172.21.15.39:6823/926357398","heartbeat_front_addr":"172.21.15.39:6821/926357398","state":["exists","up"]},{"osd":2,"uuid":"c590b1e0-67eb-452e-8e80-d2208da17d09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6809","nonce":610616754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6811","nonce":610616754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6815","nonce":610616754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6813","nonce":610616754}]},"public_addr":"172.21.15.39:6809/610616754","cluster_addr":"172.21.15.39:6811/610616754","heartbeat_back_addr":"172.21.15.39:6815/610616754","heartbeat_front_addr":"172.21.15.39:6813/610616754","state":["exists","up"]},{"osd":3,"uuid":"d57661b0-44f6-4355-9115-83eceb9b8f71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6825","nonce":1469314579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6827","nonce":1469314579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6831","nonce":1469314579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6829","nonce":1469314579}]},"public_addr":"172.21.15.39:6825/1469314579","cluster_addr":"172.21.15.39:6827/1469314579","heartbeat_back_addr":"172.21.15.39:6831/1469314579","heartbeat_front_addr":"172.21.15.39:6829/1469314579","state":["exists","up"]},{"osd":4,"uuid":"b131436f-f6e1-4d72-a86e-de200afdcebb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6825","nonce":3481507129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6827","nonce":3481507129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6831","nonce":3481507129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6829","nonce":3481507129}]},"public_addr":"172.21.15.62:6825/3481507129","cluster_addr":"172.21.15.62:6827/3481507129","heartbeat_back_addr":"172.21.15.62:6831/3481507129","heartbeat_front_addr":"172.21.15.62:6829/3481507129","state":["exists","up"]},{"osd":5,"uuid":"12e10b40-28b1-410f-9ce0-7b427daa111e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6801","nonce":3291934116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6803","nonce":3291934116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6807","nonce":3291934116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6805","nonce":3291934116}]},"public_addr":"172.21.15.62:6801/3291934116","cluster_addr":"172.21.15.62:6803/3291934116","heartbeat_back_addr":"172.21.15.62:6807/3291934116","heartbeat_front_addr":"172.21.15.62:6805/3291934116","state":["exists","up"]},{"osd":6,"uuid":"ad8950a5-70bd-488c-8f29-010515cc4a04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6817","nonce":3005996101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6819","nonce":3005996101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6823","nonce":3005996101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6821","nonce":3005996101}]},"public_addr":"172.21.15.62:6817/3005996101","cluster_addr":"172.21.15.62:6819/3005996101","heartbeat_back_addr":"172.21.15.62:6823/3005996101","heartbeat_front_addr":"172.21.15.62:6821/3005996101","state":["exists","up"]},{"osd":7,"uuid":"e0d4b8b7-3c80-4760-a342-1d508cdecc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6809","nonce":2800379225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6811","nonce":2800379225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6815","nonce":2800379225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6813","nonce":2800379225}]},"public_addr":"172.21.15.62:6809/2800379225","cluster_addr":"172.21.15.62:6811/2800379225","heartbeat_back_addr":"172.21.15.62:6815/2800379225","heartbeat_front_addr":"172.21.15.62:6813/2800379225","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.773714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.760037+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.811225+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.752810+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.745165+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.700634+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.768477+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.747301+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T14:40:22.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.072+0000 7fd9749e3640 1 -- 172.21.15.39:0/343915757 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fd9500762d0 msgr2=0x7fd9500787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:22.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.072+0000 7fd9749e3640 1 --2- 172.21.15.39:0/343915757 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fd9500762d0 0x7fd9500787e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd9700b8fc0 tx=0x7fd968009060 comp rx=0 tx=0).stop 2024-05-14T14:40:22.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.072+0000 7fd9749e3640 1 -- 172.21.15.39:0/343915757 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9700d4bf0 msgr2=0x7fd9700d5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:22.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.072+0000 7fd9749e3640 1 --2- 172.21.15.39:0/343915757 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9700d4bf0 0x7fd9700d5000 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd96002ac00 tx=0x7fd960004a40 comp rx=0 tx=0).stop 2024-05-14T14:40:22.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.072+0000 7fd9749e3640 1 -- 172.21.15.39:0/343915757 shutdown_connections 2024-05-14T14:40:22.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.072+0000 7fd9749e3640 1 --2- 172.21.15.39:0/343915757 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fd9500762d0 0x7fd9500787e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:22.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.072+0000 7fd9749e3640 1 --2- 172.21.15.39:0/343915757 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd9700d4bf0 0x7fd9700d5000 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:22.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.072+0000 7fd9749e3640 1 --2- 172.21.15.39:0/343915757 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd970163e50 0x7fd970154830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:22.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.072+0000 7fd9749e3640 1 --2- 172.21.15.39:0/343915757 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd970161320 0x7fd9700cf3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:22.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.072+0000 7fd9749e3640 1 -- 172.21.15.39:0/343915757 >> 172.21.15.39:0/343915757 conn(0x7fd9700b77d0 msgr2=0x7fd9701618b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:22.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.072+0000 7fd9749e3640 1 -- 172.21.15.39:0/343915757 shutdown_connections 2024-05-14T14:40:22.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.072+0000 7fd9749e3640 1 -- 172.21.15.39:0/343915757 wait complete. 2024-05-14T14:40:22.082 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T14:40:22.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.213+0000 7f0a82461640 1 Processor -- start 2024-05-14T14:40:22.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.213+0000 7f0a82461640 1 -- start start 2024-05-14T14:40:22.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.215+0000 7f0a82461640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0a7c0736e0 0x7f0a7c1638e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:22.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.215+0000 7f0a82461640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a7c0b6db0 con 0x7f0a7c0b30b0 2024-05-14T14:40:22.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.215+0000 7f0a82461640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a7c0b6ad0 con 0x7f0a7c164c60 2024-05-14T14:40:22.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.215+0000 7f0a82461640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f0a7c164180 con 0x7f0a7c0736e0 2024-05-14T14:40:22.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.215+0000 7f0a809fe640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f0a7c0b30b0 0x7f0a7c0ce130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:37700/0 (socket says 172.21.15.39:37700) 2024-05-14T14:40:22.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.215+0000 7f0a809fe640 1 -- 172.21.15.39:0/653227702 learned_addr learned my addr 172.21.15.39:0/653227702 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:22.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.215+0000 7f0a73fff640 1 --2- 172.21.15.39:0/653227702 >> v2:172.21.15.62:3300/0 conn(0x7f0a7c0736e0 0x7f0a7c1638e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:22.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.215+0000 7f0a7b7fe640 1 -- 172.21.15.39:0/653227702 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3460768282 0 0) 0x7f0a74001490 con 0x7f0a7c0b30b0 2024-05-14T14:40:22.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.215+0000 7f0a7b7fe640 1 -- 172.21.15.39:0/653227702 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a68003520 con 0x7f0a7c0b30b0 2024-05-14T14:40:22.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.215+0000 7f0a7b7fe640 1 -- 172.21.15.39:0/653227702 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1095677860 0 0) 0x7f0a68003520 con 0x7f0a7c0b30b0 2024-05-14T14:40:22.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.215+0000 7f0a7b7fe640 1 -- 172.21.15.39:0/653227702 >> v2:172.21.15.62:3300/0 conn(0x7f0a7c0736e0 msgr2=0x7f0a7c1638e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:22.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.215+0000 7f0a7b7fe640 1 --2- 172.21.15.39:0/653227702 >> v2:172.21.15.62:3300/0 conn(0x7f0a7c0736e0 0x7f0a7c1638e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:22.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.215+0000 7f0a7b7fe640 1 -- 172.21.15.39:0/653227702 >> v1:172.21.15.62:6789/0 conn(0x7f0a7c164c60 legacy=0x7f0a7c072fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:22.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.215+0000 7f0a7b7fe640 1 -- 172.21.15.39:0/653227702 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a7c164460 con 0x7f0a7c0b30b0 2024-05-14T14:40:22.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.215+0000 7f0a7b7fe640 1 -- 172.21.15.39:0/653227702 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1803005051 0 0) 0x7f0a74001c40 con 0x7f0a7c0b30b0 2024-05-14T14:40:22.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.216+0000 7f0a7b7fe640 1 -- 172.21.15.39:0/653227702 >> v1:172.21.15.39:6789/0 conn(0x7f0a7c0b30b0 legacy=0x7f0a7c0ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:22.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.216+0000 7f0a7b7fe640 1 --2- 172.21.15.39:0/653227702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a68003a50 0x7f0a68003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:22.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.216+0000 7f0a7b7fe640 1 --2- 172.21.15.39:0/653227702 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a68004800 0x7f0a68004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:22.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.216+0000 7f0a7b7fe640 1 --2- 172.21.15.39:0/653227702 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a68005250 0x7f0a6800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:22.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.216+0000 7f0a7b7fe640 1 -- 172.21.15.39:0/653227702 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0a7c164180 con 0x7f0a68005250 2024-05-14T14:40:22.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.216+0000 7f0a7b7fe640 1 -- 172.21.15.39:0/653227702 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0a6800c1e0 con 0x7f0a68003a50 2024-05-14T14:40:22.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.216+0000 7f0a7b7fe640 1 -- 172.21.15.39:0/653227702 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f0a6800c3e0 con 0x7f0a68004800 2024-05-14T14:40:22.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.216+0000 7f0a809fe640 1 --2- 172.21.15.39:0/653227702 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a68005250 0x7f0a6800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:22.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.216+0000 7f0a7bfff640 1 --2- 172.21.15.39:0/653227702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a68003a50 0x7f0a68003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:22.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.216+0000 7f0a73fff640 1 --2- 172.21.15.39:0/653227702 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a68004800 0x7f0a68004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:22.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.216+0000 7f0a809fe640 1 -- 172.21.15.39:0/653227702 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a68004800 msgr2=0x7f0a68004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:22.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.216+0000 7f0a809fe640 1 --2- 172.21.15.39:0/653227702 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a68004800 0x7f0a68004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:22.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.216+0000 7f0a809fe640 1 -- 172.21.15.39:0/653227702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a68003a50 msgr2=0x7f0a68003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:22.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.216+0000 7f0a809fe640 1 --2- 172.21.15.39:0/653227702 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a68003a50 0x7f0a68003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:22.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.216+0000 7f0a809fe640 1 -- 172.21.15.39:0/653227702 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a68003520 con 0x7f0a68005250 2024-05-14T14:40:22.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.217+0000 7f0a809fe640 1 -- 172.21.15.39:0/653227702 reap_dead start 2024-05-14T14:40:22.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.217+0000 7f0a809fe640 1 --2- 172.21.15.39:0/653227702 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a68005250 0x7f0a6800b9c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c0d0530 tx=0x7f0a68005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee51a656abbc1f18 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:22.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.217+0000 7f0a7b7fe640 1 -- 172.21.15.39:0/653227702 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7400a650 con 0x7f0a68005250 2024-05-14T14:40:22.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.217+0000 7f0a7b7fe640 1 -- 172.21.15.39:0/653227702 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a7402f070 con 0x7f0a68005250 2024-05-14T14:40:22.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.217+0000 7f0a7b7fe640 1 -- 172.21.15.39:0/653227702 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7402bdd0 con 0x7f0a68005250 2024-05-14T14:40:22.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.218+0000 7f0a82461640 1 -- 172.21.15.39:0/653227702 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a68005250 msgr2=0x7f0a6800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:22.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.218+0000 7f0a82461640 1 --2- 172.21.15.39:0/653227702 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a68005250 0x7f0a6800b9c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c0d0530 tx=0x7f0a68005830 comp rx=0 tx=0).stop 2024-05-14T14:40:22.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.218+0000 7f0a82461640 1 -- 172.21.15.39:0/653227702 shutdown_connections 2024-05-14T14:40:22.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.218+0000 7f0a82461640 1 --2- 172.21.15.39:0/653227702 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a68005250 0x7f0a6800b9c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:22.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.218+0000 7f0a82461640 1 -- 172.21.15.39:0/653227702 >> 172.21.15.39:0/653227702 conn(0x7f0a7c0d3ae0 msgr2=0x7f0a7c0d3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:22.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.218+0000 7f0a82461640 1 -- 172.21.15.39:0/653227702 shutdown_connections 2024-05-14T14:40:22.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.218+0000 7f0a82461640 1 -- 172.21.15.39:0/653227702 wait complete. 2024-05-14T14:40:22.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.220+0000 7f0a82461640 1 Processor -- start 2024-05-14T14:40:22.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.220+0000 7f0a82461640 1 -- start start 2024-05-14T14:40:22.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.221+0000 7f0a82461640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a68005250 0x7f0a7c15a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:22.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.221+0000 7f0a82461640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a7c0709f0 0x7f0a7c070e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:22.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.221+0000 7f0a82461640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a7c0aea10 0x7f0a7c0aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:22.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.221+0000 7f0a82461640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0a7c164de0 con 0x7f0a7c0aea10 2024-05-14T14:40:22.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.221+0000 7f0a82461640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0a7c164c60 con 0x7f0a7c0709f0 2024-05-14T14:40:22.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.221+0000 7f0a82461640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f0a7c0cf480 con 0x7f0a68005250 2024-05-14T14:40:22.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.221+0000 7f0a809fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a7c0aea10 0x7f0a7c0aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:22.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.221+0000 7f0a809fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a7c0aea10 0x7f0a7c0aee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47478/0 (socket says 172.21.15.39:47478) 2024-05-14T14:40:22.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.221+0000 7f0a809fe640 1 -- 172.21.15.39:0/984416256 learned_addr learned my addr 172.21.15.39:0/984416256 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:22.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.221+0000 7f0a73fff640 1 --2- 172.21.15.39:0/984416256 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a7c0709f0 0x7f0a7c070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:22.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.221+0000 7f0a7bfff640 1 --2- 172.21.15.39:0/984416256 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a68005250 0x7f0a7c15a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:22.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.221+0000 7f0a809fe640 1 -- 172.21.15.39:0/984416256 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a68005250 msgr2=0x7f0a7c15a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:22.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.221+0000 7f0a809fe640 1 --2- 172.21.15.39:0/984416256 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a68005250 0x7f0a7c15a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:22.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.221+0000 7f0a809fe640 1 -- 172.21.15.39:0/984416256 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a7c0709f0 msgr2=0x7f0a7c070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:22.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.221+0000 7f0a809fe640 1 --2- 172.21.15.39:0/984416256 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a7c0709f0 0x7f0a7c070e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:22.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.221+0000 7f0a809fe640 1 -- 172.21.15.39:0/984416256 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a7c0af360 con 0x7f0a7c0aea10 2024-05-14T14:40:22.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.222+0000 7f0a809fe640 1 --2- 172.21.15.39:0/984416256 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a7c0aea10 0x7f0a7c0aee20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0a7400aac0 tx=0x7f0a7c164630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:22.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.222+0000 7f0a797fa640 1 -- 172.21.15.39:0/984416256 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7400a650 con 0x7f0a7c0aea10 2024-05-14T14:40:22.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.222+0000 7f0a797fa640 1 -- 172.21.15.39:0/984416256 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a7402bd80 con 0x7f0a7c0aea10 2024-05-14T14:40:22.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.222+0000 7f0a797fa640 1 -- 172.21.15.39:0/984416256 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a74004d60 con 0x7f0a7c0aea10 2024-05-14T14:40:22.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.222+0000 7f0a82461640 1 -- 172.21.15.39:0/984416256 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a7c0b1730 con 0x7f0a7c0aea10 2024-05-14T14:40:22.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.222+0000 7f0a82461640 1 -- 172.21.15.39:0/984416256 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a7c0b1cf0 con 0x7f0a7c0aea10 2024-05-14T14:40:22.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.223+0000 7f0a82461640 1 -- 172.21.15.39:0/984416256 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a7c076aa0 con 0x7f0a7c0aea10 2024-05-14T14:40:22.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.223+0000 7f0a797fa640 1 -- 172.21.15.39:0/984416256 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0a74040480 con 0x7f0a7c0aea10 2024-05-14T14:40:22.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.224+0000 7f0a797fa640 1 --2- 172.21.15.39:0/984416256 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0a5c0762d0 0x7f0a5c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:22.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.224+0000 7f0a797fa640 1 -- 172.21.15.39:0/984416256 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0a740b7760 con 0x7f0a7c0aea10 2024-05-14T14:40:22.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.224+0000 7f0a7bfff640 1 --2- 172.21.15.39:0/984416256 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0a5c0762d0 0x7f0a5c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:22.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.224+0000 7f0a7bfff640 1 --2- 172.21.15.39:0/984416256 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0a5c0762d0 0x7f0a5c0787e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c0d4be0 tx=0x7f0a6c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:22.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.229+0000 7f0a797fa640 1 -- 172.21.15.39:0/984416256 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0a74047030 con 0x7f0a7c0aea10 2024-05-14T14:40:22.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.458+0000 7f0a82461640 1 -- 172.21.15.39:0/984416256 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0a7c0b14c0 con 0x7f0a7c0aea10 2024-05-14T14:40:22.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.458+0000 7f0a797fa640 1 -- 172.21.15.39:0/984416256 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5171 (secure 0 0 0) 0x7f0a7c0af360 con 0x7f0a7c0aea10 2024-05-14T14:40:22.443 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:40:22.443 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/3753262818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3753262818},{"type":"v1","addr":"172.21.15.62:6834","nonce":3753262818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/97693396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6835","nonce":97693396},{"type":"v1","addr":"172.21.15.39:6837","nonce":97693396}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6836/1648047942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":1648047942},{"type":"v1","addr":"172.21.15.39:6836","nonce":1648047942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T14:40:15.320927+0000","modified":"2024-05-14T14:40:20.397850+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/1519798364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":1519798364},{"type":"v1","addr":"172.21.15.62:6835","nonce":1519798364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-05-14T14:40:22.443 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 7 2024-05-14T14:40:22.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.460+0000 7f0a82461640 1 -- 172.21.15.39:0/984416256 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0a5c0762d0 msgr2=0x7f0a5c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:22.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.460+0000 7f0a82461640 1 --2- 172.21.15.39:0/984416256 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0a5c0762d0 0x7f0a5c0787e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c0d4be0 tx=0x7f0a6c009040 comp rx=0 tx=0).stop 2024-05-14T14:40:22.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.460+0000 7f0a82461640 1 -- 172.21.15.39:0/984416256 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a7c0aea10 msgr2=0x7f0a7c0aee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:22.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.460+0000 7f0a82461640 1 --2- 172.21.15.39:0/984416256 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a7c0aea10 0x7f0a7c0aee20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0a7400aac0 tx=0x7f0a7c164630 comp rx=0 tx=0).stop 2024-05-14T14:40:22.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.460+0000 7f0a82461640 1 -- 172.21.15.39:0/984416256 shutdown_connections 2024-05-14T14:40:22.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.460+0000 7f0a82461640 1 --2- 172.21.15.39:0/984416256 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0a5c0762d0 0x7f0a5c0787e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:22.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.460+0000 7f0a82461640 1 --2- 172.21.15.39:0/984416256 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0a7c0aea10 0x7f0a7c0aee20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:22.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.460+0000 7f0a82461640 1 --2- 172.21.15.39:0/984416256 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0a7c0709f0 0x7f0a7c070e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:22.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.460+0000 7f0a82461640 1 --2- 172.21.15.39:0/984416256 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0a68005250 0x7f0a7c15a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:22.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.460+0000 7f0a82461640 1 -- 172.21.15.39:0/984416256 >> 172.21.15.39:0/984416256 conn(0x7f0a7c0d3ae0 msgr2=0x7f0a7c0d21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:22.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.461+0000 7f0a82461640 1 -- 172.21.15.39:0/984416256 shutdown_connections 2024-05-14T14:40:22.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.461+0000 7f0a82461640 1 -- 172.21.15.39:0/984416256 wait complete. 2024-05-14T14:40:22.456 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T14:40:22.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.586+0000 7f413ddb2640 1 Processor -- start 2024-05-14T14:40:22.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.586+0000 7f413ddb2640 1 -- start start 2024-05-14T14:40:22.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.587+0000 7f413ddb2640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f41381638f0 0x7f413806f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:22.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.587+0000 7f413ddb2640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41380d1650 0x7f41380d1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:22.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.587+0000 7f413ddb2640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4138163ec0 0x7f41381642d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:22.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.587+0000 7f413ddb2640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f41380b32d0 con 0x7f4138163ec0 2024-05-14T14:40:22.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.587+0000 7f413ddb2640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f41380d1fa0 con 0x7f41381638f0 2024-05-14T14:40:22.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.587+0000 7f413ddb2640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f4138164810 con 0x7f41380d1650 2024-05-14T14:40:22.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.587+0000 7f4137fff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4138163ec0 0x7f41381642d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:22.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.587+0000 7f4137fff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4138163ec0 0x7f41381642d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47490/0 (socket says 172.21.15.39:47490) 2024-05-14T14:40:22.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.587+0000 7f4137fff640 1 -- 172.21.15.39:0/3838920230 learned_addr learned my addr 172.21.15.39:0/3838920230 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:22.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.588+0000 7f41377fe640 1 --2- 172.21.15.39:0/3838920230 >> v2:172.21.15.62:3300/0 conn(0x7f41381638f0 0x7f413806f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:22.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.588+0000 7f4136ffd640 1 --2- 172.21.15.39:0/3838920230 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41380d1650 0x7f41380d1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:22.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.588+0000 7f4137fff640 1 -- 172.21.15.39:0/3838920230 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41380d1650 msgr2=0x7f41380d1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:22.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.588+0000 7f4137fff640 1 --2- 172.21.15.39:0/3838920230 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41380d1650 0x7f41380d1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:22.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.588+0000 7f4137fff640 1 -- 172.21.15.39:0/3838920230 >> v2:172.21.15.62:3300/0 conn(0x7f41381638f0 msgr2=0x7f413806f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:22.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.588+0000 7f4137fff640 1 --2- 172.21.15.39:0/3838920230 >> v2:172.21.15.62:3300/0 conn(0x7f41381638f0 0x7f413806f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:22.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.588+0000 7f4137fff640 1 -- 172.21.15.39:0/3838920230 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4138164d80 con 0x7f4138163ec0 2024-05-14T14:40:22.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.589+0000 7f4137fff640 1 --2- 172.21.15.39:0/3838920230 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4138163ec0 0x7f41381642d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4138074a70 tx=0x7f413002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d30b2105b335075 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:22.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.589+0000 7f41367fc640 1 -- 172.21.15.39:0/3838920230 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4130037070 con 0x7f4138163ec0 2024-05-14T14:40:22.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.589+0000 7f41367fc640 1 -- 172.21.15.39:0/3838920230 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4130032440 con 0x7f4138163ec0 2024-05-14T14:40:22.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.589+0000 7f41367fc640 1 -- 172.21.15.39:0/3838920230 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4130032810 con 0x7f4138163ec0 2024-05-14T14:40:22.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.589+0000 7f413ddb2640 1 -- 172.21.15.39:0/3838920230 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4138163ec0 msgr2=0x7f41381642d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:22.575 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.589+0000 7f413ddb2640 1 --2- 172.21.15.39:0/3838920230 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4138163ec0 0x7f41381642d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4138074a70 tx=0x7f413002a140 comp rx=0 tx=0).stop 2024-05-14T14:40:22.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.589+0000 7f413ddb2640 1 -- 172.21.15.39:0/3838920230 shutdown_connections 2024-05-14T14:40:22.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.589+0000 7f413ddb2640 1 --2- 172.21.15.39:0/3838920230 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4138163ec0 0x7f41381642d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:22.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.589+0000 7f413ddb2640 1 --2- 172.21.15.39:0/3838920230 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41380d1650 0x7f41380d1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:22.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.589+0000 7f413ddb2640 1 --2- 172.21.15.39:0/3838920230 >> v2:172.21.15.62:3300/0 conn(0x7f41381638f0 0x7f413806f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:22.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.589+0000 7f413ddb2640 1 -- 172.21.15.39:0/3838920230 >> 172.21.15.39:0/3838920230 conn(0x7f4138071660 msgr2=0x7f4138071a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:22.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.590+0000 7f413ddb2640 1 -- 172.21.15.39:0/3838920230 shutdown_connections 2024-05-14T14:40:22.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.590+0000 7f413ddb2640 1 -- 172.21.15.39:0/3838920230 wait complete. 2024-05-14T14:40:22.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.591+0000 7f413ddb2640 1 Processor -- start 2024-05-14T14:40:22.576 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.592+0000 7f413ddb2640 1 -- start start 2024-05-14T14:40:22.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.593+0000 7f413ddb2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41380d1650 0x7f413815b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:22.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.593+0000 7f413ddb2640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41381638f0 0x7f41380cc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:22.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.593+0000 7f413ddb2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4138163ec0 0x7f413815ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:22.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.593+0000 7f413ddb2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f413806ecc0 con 0x7f4138163ec0 2024-05-14T14:40:22.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.593+0000 7f413ddb2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f413806e9e0 con 0x7f41380d1650 2024-05-14T14:40:22.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.593+0000 7f413ddb2640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f413806efa0 con 0x7f41381638f0 2024-05-14T14:40:22.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.593+0000 7f4137fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4138163ec0 0x7f413815ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:22.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.593+0000 7f4137fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4138163ec0 0x7f413815ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47494/0 (socket says 172.21.15.39:47494) 2024-05-14T14:40:22.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.593+0000 7f4137fff640 1 -- 172.21.15.39:0/2058411434 learned_addr learned my addr 172.21.15.39:0/2058411434 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:22.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.593+0000 7f41377fe640 1 --2- 172.21.15.39:0/2058411434 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41380d1650 0x7f413815b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:22.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.593+0000 7f4136ffd640 1 --2- 172.21.15.39:0/2058411434 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41381638f0 0x7f41380cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:22.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.593+0000 7f4137fff640 1 -- 172.21.15.39:0/2058411434 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41381638f0 msgr2=0x7f41380cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:22.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.593+0000 7f4137fff640 1 --2- 172.21.15.39:0/2058411434 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41381638f0 0x7f41380cc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:22.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.593+0000 7f4137fff640 1 -- 172.21.15.39:0/2058411434 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41380d1650 msgr2=0x7f413815b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:22.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.593+0000 7f4137fff640 1 --2- 172.21.15.39:0/2058411434 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41380d1650 0x7f413815b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:22.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.593+0000 7f4137fff640 1 -- 172.21.15.39:0/2058411434 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41380ccc40 con 0x7f4138163ec0 2024-05-14T14:40:22.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.593+0000 7f4137fff640 1 --2- 172.21.15.39:0/2058411434 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4138163ec0 0x7f413815ee90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f413002a180 tx=0x7f41300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:22.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.594+0000 7f411ffff640 1 -- 172.21.15.39:0/2058411434 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4130041020 con 0x7f4138163ec0 2024-05-14T14:40:22.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.594+0000 7f411ffff640 1 -- 172.21.15.39:0/2058411434 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f413003d640 con 0x7f4138163ec0 2024-05-14T14:40:22.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.594+0000 7f413ddb2640 1 -- 172.21.15.39:0/2058411434 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41380cd150 con 0x7f4138163ec0 2024-05-14T14:40:22.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.594+0000 7f411ffff640 1 -- 172.21.15.39:0/2058411434 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4130037040 con 0x7f4138163ec0 2024-05-14T14:40:22.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.594+0000 7f413ddb2640 1 -- 172.21.15.39:0/2058411434 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41380cd710 con 0x7f4138163ec0 2024-05-14T14:40:22.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.595+0000 7f413ddb2640 1 -- 172.21.15.39:0/2058411434 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41380ccec0 con 0x7f4138163ec0 2024-05-14T14:40:22.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.595+0000 7f411ffff640 1 -- 172.21.15.39:0/2058411434 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4130044020 con 0x7f4138163ec0 2024-05-14T14:40:22.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.596+0000 7f411ffff640 1 --2- 172.21.15.39:0/2058411434 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4124076300 0x7f4124078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:22.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.596+0000 7f41377fe640 1 --2- 172.21.15.39:0/2058411434 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4124076300 0x7f4124078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:22.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.596+0000 7f411ffff640 1 -- 172.21.15.39:0/2058411434 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f41300b7eb0 con 0x7f4138163ec0 2024-05-14T14:40:22.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.596+0000 7f41377fe640 1 --2- 172.21.15.39:0/2058411434 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4124076300 0x7f4124078810 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4138072650 tx=0x7f412800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:22.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.600+0000 7f411ffff640 1 -- 172.21.15.39:0/2058411434 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f413004b030 con 0x7f4138163ec0 2024-05-14T14:40:22.776 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.792+0000 7f413ddb2640 1 -- 172.21.15.39:0/2058411434 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f41380cd950 con 0x7f4138163ec0 2024-05-14T14:40:22.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.793+0000 7f411ffff640 1 -- 172.21.15.39:0/2058411434 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18454 (secure 0 0 0) 0x7f41380cd950 con 0x7f4138163ec0 2024-05-14T14:40:22.778 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:40:22.778 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"fsid":"d7983fec-79c7-4991-b19c-1aecead64611","created":"2024-05-14T14:39:52.157167+0000","modified":"2024-05-14T14:40:20.397684+0000","last_up_change":"2024-05-14T14:40:03.848608+0000","last_in_change":"2024-05-14T14:39:54.591920+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T14:40:04.692846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T14:40:13.794415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T14:40:14.273154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T14:40:17.979457+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c4ec4534-6301-4dd7-b4d6-d560b096d442","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6801","nonce":4023478848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6803","nonce":4023478848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6807","nonce":4023478848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6805","nonce":4023478848}]},"public_addr":"172.21.15.39:6801/4023478848","cluster_addr":"172.21.15.39:6803/4023478848","heartbeat_back_addr":"172.21.15.39:6807/4023478848","heartbeat_front_addr":"172.21.15.39:6805/4023478848","state":["exists","up"]},{"osd":1,"uuid":"93f91b0e-096e-4bdf-aed0-d1136f73f136","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6817","nonce":926357398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6819","nonce":926357398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6823","nonce":926357398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6821","nonce":926357398}]},"public_addr":"172.21.15.39:6817/926357398","cluster_addr":"172.21.15.39:6819/926357398","heartbeat_back_addr":"172.21.15.39:6823/926357398","heartbeat_front_addr":"172.21.15.39:6821/926357398","state":["exists","up"]},{"osd":2,"uuid":"c590b1e0-67eb-452e-8e80-d2208da17d09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6809","nonce":610616754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6811","nonce":610616754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6815","nonce":610616754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6813","nonce":610616754}]},"public_addr":"172.21.15.39:6809/610616754","cluster_addr":"172.21.15.39:6811/610616754","heartbeat_back_addr":"172.21.15.39:6815/610616754","heartbeat_front_addr":"172.21.15.39:6813/610616754","state":["exists","up"]},{"osd":3,"uuid":"d57661b0-44f6-4355-9115-83eceb9b8f71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6825","nonce":1469314579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6827","nonce":1469314579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6831","nonce":1469314579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6829","nonce":1469314579}]},"public_addr":"172.21.15.39:6825/1469314579","cluster_addr":"172.21.15.39:6827/1469314579","heartbeat_back_addr":"172.21.15.39:6831/1469314579","heartbeat_front_addr":"172.21.15.39:6829/1469314579","state":["exists","up"]},{"osd":4,"uuid":"b131436f-f6e1-4d72-a86e-de200afdcebb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6825","nonce":3481507129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6827","nonce":3481507129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6831","nonce":3481507129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6829","nonce":3481507129}]},"public_addr":"172.21.15.62:6825/3481507129","cluster_addr":"172.21.15.62:6827/3481507129","heartbeat_back_addr":"172.21.15.62:6831/3481507129","heartbeat_front_addr":"172.21.15.62:6829/3481507129","state":["exists","up"]},{"osd":5,"uuid":"12e10b40-28b1-410f-9ce0-7b427daa111e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6801","nonce":3291934116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6803","nonce":3291934116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6807","nonce":3291934116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6805","nonce":3291934116}]},"public_addr":"172.21.15.62:6801/3291934116","cluster_addr":"172.21.15.62:6803/3291934116","heartbeat_back_addr":"172.21.15.62:6807/3291934116","heartbeat_front_addr":"172.21.15.62:6805/3291934116","state":["exists","up"]},{"osd":6,"uuid":"ad8950a5-70bd-488c-8f29-010515cc4a04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6817","nonce":3005996101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6819","nonce":3005996101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6823","nonce":3005996101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6821","nonce":3005996101}]},"public_addr":"172.21.15.62:6817/3005996101","cluster_addr":"172.21.15.62:6819/3005996101","heartbeat_back_addr":"172.21.15.62:6823/3005996101","heartbeat_front_addr":"172.21.15.62:6821/3005996101","state":["exists","up"]},{"osd":7,"uuid":"e0d4b8b7-3c80-4760-a342-1d508cdecc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6809","nonce":2800379225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6811","nonce":2800379225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6815","nonce":2800379225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6813","nonce":2800379225}]},"public_addr":"172.21.15.62:6809/2800379225","cluster_addr":"172.21.15.62:6811/2800379225","heartbeat_back_addr":"172.21.15.62:6815/2800379225","heartbeat_front_addr":"172.21.15.62:6813/2800379225","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.773714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.760037+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.811225+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.752810+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.745165+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.700634+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.768477+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.747301+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T14:40:22.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.796+0000 7f413ddb2640 1 -- 172.21.15.39:0/2058411434 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4124076300 msgr2=0x7f4124078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:22.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.796+0000 7f413ddb2640 1 --2- 172.21.15.39:0/2058411434 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4124076300 0x7f4124078810 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4138072650 tx=0x7f412800b040 comp rx=0 tx=0).stop 2024-05-14T14:40:22.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.796+0000 7f413ddb2640 1 -- 172.21.15.39:0/2058411434 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4138163ec0 msgr2=0x7f413815ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:22.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.796+0000 7f413ddb2640 1 --2- 172.21.15.39:0/2058411434 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4138163ec0 0x7f413815ee90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f413002a180 tx=0x7f41300046c0 comp rx=0 tx=0).stop 2024-05-14T14:40:22.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.796+0000 7f413ddb2640 1 -- 172.21.15.39:0/2058411434 shutdown_connections 2024-05-14T14:40:22.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.796+0000 7f413ddb2640 1 --2- 172.21.15.39:0/2058411434 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4124076300 0x7f4124078810 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:22.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.796+0000 7f413ddb2640 1 --2- 172.21.15.39:0/2058411434 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4138163ec0 0x7f413815ee90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:22.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.796+0000 7f413ddb2640 1 --2- 172.21.15.39:0/2058411434 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f41381638f0 0x7f41380cc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:22.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.796+0000 7f413ddb2640 1 --2- 172.21.15.39:0/2058411434 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41380d1650 0x7f413815b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:22.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.796+0000 7f413ddb2640 1 -- 172.21.15.39:0/2058411434 >> 172.21.15.39:0/2058411434 conn(0x7f4138071660 msgr2=0x7f413815bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:22.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.796+0000 7f413ddb2640 1 -- 172.21.15.39:0/2058411434 shutdown_connections 2024-05-14T14:40:22.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:22.796+0000 7f413ddb2640 1 -- 172.21.15.39:0/2058411434 wait complete. 2024-05-14T14:40:23.195 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-14T14:40:15.320927+0000', 'modified': '2024-05-14T14:40:20.397850+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4278}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4278': {'gid': 4278, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6835/1519798364', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6833', 'nonce': 1519798364}, {'type': 'v1', 'addr': '172.21.15.62:6835', 'nonce': 1519798364}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4278, 'qdb_cluster': [4278]} 2024-05-14T14:40:23.196 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-14T14:40:23.196 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-14T14:40:23.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.331+0000 7feb03586640 1 Processor -- start 2024-05-14T14:40:23.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.331+0000 7feb03586640 1 -- start start 2024-05-14T14:40:23.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.333+0000 7feb03586640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feafc0ce590 0x7feafc15e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:23.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.333+0000 7feb03586640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7feafc0d0200 0x7feafc0d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:23.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.333+0000 7feb03586640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feafc162400 con 0x7feafc161c20 2024-05-14T14:40:23.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.333+0000 7feb03586640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7feafc0d2490 con 0x7feafc0d0200 2024-05-14T14:40:23.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.333+0000 7feb03586640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7feafc0d2770 con 0x7feafc0ce590 2024-05-14T14:40:23.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.333+0000 7feb01b23640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7feafc0d0200 0x7feafc0d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:23.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.333+0000 7feb01322640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feafc0ce590 0x7feafc15e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:23.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.333+0000 7feb01b23640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7feafc0d0200 0x7feafc0d0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.39:38238/0 (socket says 172.21.15.39:38238) 2024-05-14T14:40:23.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.333+0000 7feb01322640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feafc0ce590 0x7feafc15e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.39:43670/0 (socket says 172.21.15.39:43670) 2024-05-14T14:40:23.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.333+0000 7feb01b23640 1 -- 172.21.15.39:0/2080625980 learned_addr learned my addr 172.21.15.39:0/2080625980 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:23.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.333+0000 7feb00b21640 1 --1- 172.21.15.39:0/2080625980 >> v1:172.21.15.62:6789/0 conn(0x7feafc161c20 0x7feafc0b6ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.39:43002/0 (socket says 172.21.15.39:43002) 2024-05-14T14:40:23.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.333+0000 7feb01322640 1 -- 172.21.15.39:0/2080625980 >> v2:172.21.15.62:3300/0 conn(0x7feafc0d0200 msgr2=0x7feafc0d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:23.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.333+0000 7feb01322640 1 --2- 172.21.15.39:0/2080625980 >> v2:172.21.15.62:3300/0 conn(0x7feafc0d0200 0x7feafc0d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.333+0000 7feb01322640 1 -- 172.21.15.39:0/2080625980 >> v1:172.21.15.62:6789/0 conn(0x7feafc161c20 legacy=0x7feafc0b6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:23.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.333+0000 7feb01322640 1 -- 172.21.15.39:0/2080625980 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feafc1626e0 con 0x7feafc0ce590 2024-05-14T14:40:23.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.333+0000 7feb01b23640 1 --2- 172.21.15.39:0/2080625980 >> v2:172.21.15.62:3300/0 conn(0x7feafc0d0200 0x7feafc0d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T14:40:23.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.334+0000 7feb01322640 1 --2- 172.21.15.39:0/2080625980 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feafc0ce590 0x7feafc15e030 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7feaf40097a0 tx=0x7feaf402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f28d948a900f4c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:23.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.334+0000 7feaf3fff640 1 -- 172.21.15.39:0/2080625980 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf4037070 con 0x7feafc0ce590 2024-05-14T14:40:23.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.334+0000 7feaf3fff640 1 -- 172.21.15.39:0/2080625980 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaf402ae50 con 0x7feafc0ce590 2024-05-14T14:40:23.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.334+0000 7feaf3fff640 1 -- 172.21.15.39:0/2080625980 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf4032660 con 0x7feafc0ce590 2024-05-14T14:40:23.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.335+0000 7feb03586640 1 -- 172.21.15.39:0/2080625980 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feafc0ce590 msgr2=0x7feafc15e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:23.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.335+0000 7feb03586640 1 --2- 172.21.15.39:0/2080625980 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feafc0ce590 0x7feafc15e030 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7feaf40097a0 tx=0x7feaf402a100 comp rx=0 tx=0).stop 2024-05-14T14:40:23.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.335+0000 7feb03586640 1 -- 172.21.15.39:0/2080625980 shutdown_connections 2024-05-14T14:40:23.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.335+0000 7feb03586640 1 --2- 172.21.15.39:0/2080625980 >> v2:172.21.15.62:3300/0 conn(0x7feafc0d0200 0x7feafc0d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.335+0000 7feb03586640 1 --2- 172.21.15.39:0/2080625980 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feafc0ce590 0x7feafc15e030 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.335+0000 7feb03586640 1 -- 172.21.15.39:0/2080625980 >> 172.21.15.39:0/2080625980 conn(0x7feafc071660 msgr2=0x7feafc071a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:23.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.335+0000 7feb03586640 1 -- 172.21.15.39:0/2080625980 shutdown_connections 2024-05-14T14:40:23.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.335+0000 7feb03586640 1 -- 172.21.15.39:0/2080625980 wait complete. 2024-05-14T14:40:23.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.337+0000 7feb03586640 1 Processor -- start 2024-05-14T14:40:23.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.337+0000 7feb03586640 1 -- start start 2024-05-14T14:40:23.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.338+0000 7feb03586640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feafc0ce590 0x7feafc0cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:23.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.338+0000 7feb03586640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feafc0d0200 0x7feafc1f0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:23.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.338+0000 7feb03586640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feafc161c20 0x7feafc06eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:23.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.338+0000 7feb03586640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7feafc0d0b50 con 0x7feafc0ce590 2024-05-14T14:40:23.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.338+0000 7feb03586640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7feafc15e570 con 0x7feafc161c20 2024-05-14T14:40:23.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.338+0000 7feb03586640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7feafc162030 con 0x7feafc0d0200 2024-05-14T14:40:23.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.338+0000 7feb01322640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feafc0ce590 0x7feafc0cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:23.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.338+0000 7feb01322640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feafc0ce590 0x7feafc0cb9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47498/0 (socket says 172.21.15.39:47498) 2024-05-14T14:40:23.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.338+0000 7feb01322640 1 -- 172.21.15.39:0/921707584 learned_addr learned my addr 172.21.15.39:0/921707584 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:23.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.339+0000 7feb01b23640 1 --2- 172.21.15.39:0/921707584 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feafc161c20 0x7feafc06eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:23.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.339+0000 7feb00b21640 1 --2- 172.21.15.39:0/921707584 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feafc0d0200 0x7feafc1f0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:23.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.339+0000 7feb01322640 1 -- 172.21.15.39:0/921707584 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feafc0d0200 msgr2=0x7feafc1f0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:23.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.339+0000 7feb01322640 1 --2- 172.21.15.39:0/921707584 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feafc0d0200 0x7feafc1f0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.339+0000 7feb01322640 1 -- 172.21.15.39:0/921707584 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feafc161c20 msgr2=0x7feafc06eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:23.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.339+0000 7feb01322640 1 --2- 172.21.15.39:0/921707584 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feafc161c20 0x7feafc06eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.339+0000 7feb01322640 1 -- 172.21.15.39:0/921707584 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feafc0cbf00 con 0x7feafc0ce590 2024-05-14T14:40:23.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.339+0000 7feb01322640 1 --2- 172.21.15.39:0/921707584 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feafc0ce590 0x7feafc0cb9c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7feaf40098c0 tx=0x7feaf40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:23.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.339+0000 7feaf1ffb640 1 -- 172.21.15.39:0/921707584 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf4041020 con 0x7feafc0ce590 2024-05-14T14:40:23.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.339+0000 7feaf1ffb640 1 -- 172.21.15.39:0/921707584 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaf403c670 con 0x7feafc0ce590 2024-05-14T14:40:23.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.339+0000 7feb03586640 1 -- 172.21.15.39:0/921707584 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feafc1f0fd0 con 0x7feafc0ce590 2024-05-14T14:40:23.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.339+0000 7feaf1ffb640 1 -- 172.21.15.39:0/921707584 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf4037040 con 0x7feafc0ce590 2024-05-14T14:40:23.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.339+0000 7feb03586640 1 -- 172.21.15.39:0/921707584 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feafc0cc6f0 con 0x7feafc0ce590 2024-05-14T14:40:23.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.341+0000 7feaf1ffb640 1 -- 172.21.15.39:0/921707584 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7feaf4044020 con 0x7feafc0ce590 2024-05-14T14:40:23.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.342+0000 7feaf1ffb640 1 --2- 172.21.15.39:0/921707584 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7feae00762d0 0x7feae00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:23.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.342+0000 7feb00b21640 1 --2- 172.21.15.39:0/921707584 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7feae00762d0 0x7feae00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:23.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.342+0000 7feaf1ffb640 1 -- 172.21.15.39:0/921707584 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7feaf40b7d90 con 0x7feafc0ce590 2024-05-14T14:40:23.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.343+0000 7feb00b21640 1 --2- 172.21.15.39:0/921707584 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7feae00762d0 0x7feae00787e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7feafc1fa0b0 tx=0x7feaec000bc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:23.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.343+0000 7feb0a441740 1 Processor -- start 2024-05-14T14:40:23.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.343+0000 7feb0a441740 1 -- start start 2024-05-14T14:40:23.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.344+0000 7feb0a441740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559641e69270 0x559642236120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:23.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.345+0000 7feb0a441740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x559641e403b0 0x55964220b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:23.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.345+0000 7feb0a441740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559641e48590 0x5596422520b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:23.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.345+0000 7feb0a441740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55964216f8d0 con 0x559641e69270 2024-05-14T14:40:23.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.345+0000 7feb0a441740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559642128c10 con 0x559641e48590 2024-05-14T14:40:23.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.345+0000 7feb0a441740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x55964216b890 con 0x559641e403b0 2024-05-14T14:40:23.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.345+0000 7feb01322640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559641e69270 0x559642236120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:23.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.345+0000 7feb01322640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559641e69270 0x559642236120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47512/0 (socket says 172.21.15.39:47512) 2024-05-14T14:40:23.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.345+0000 7feb01322640 1 -- 172.21.15.39:0/3523415833 learned_addr learned my addr 172.21.15.39:0/3523415833 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:23.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.345+0000 7feb01322640 1 -- 172.21.15.39:0/3523415833 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x559641e403b0 msgr2=0x55964220b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:23.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.345+0000 7feb01322640 1 --2- 172.21.15.39:0/3523415833 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x559641e403b0 0x55964220b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.345+0000 7feb01322640 1 -- 172.21.15.39:0/3523415833 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559641e48590 msgr2=0x5596422520b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:23.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.345+0000 7feb01322640 1 --2- 172.21.15.39:0/3523415833 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559641e48590 0x5596422520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.345+0000 7feb01322640 1 -- 172.21.15.39:0/3523415833 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596421305d0 con 0x559641e69270 2024-05-14T14:40:23.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.345+0000 7feb01322640 1 --2- 172.21.15.39:0/3523415833 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559641e69270 0x559642236120 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7feaf407d2a0 tx=0x7feaf40806c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fda143ba5649d9b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:23.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.345+0000 7feae6ffd640 1 -- 172.21.15.39:0/3523415833 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf40807c0 con 0x559641e69270 2024-05-14T14:40:23.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.345+0000 7feae6ffd640 1 -- 172.21.15.39:0/3523415833 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaf402ae50 con 0x559641e69270 2024-05-14T14:40:23.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.345+0000 7feae6ffd640 1 -- 172.21.15.39:0/3523415833 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf4080cb0 con 0x559641e69270 2024-05-14T14:40:23.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.346+0000 7feb0a441740 1 -- 172.21.15.39:0/3523415833 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559641e69270 msgr2=0x559642236120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:23.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.346+0000 7feb0a441740 1 --2- 172.21.15.39:0/3523415833 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559641e69270 0x559642236120 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7feaf407d2a0 tx=0x7feaf40806c0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.346+0000 7feb0a441740 1 -- 172.21.15.39:0/3523415833 shutdown_connections 2024-05-14T14:40:23.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.346+0000 7feb0a441740 1 --2- 172.21.15.39:0/3523415833 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559641e48590 0x5596422520b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.346+0000 7feb0a441740 1 --2- 172.21.15.39:0/3523415833 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x559641e403b0 0x55964220b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.346+0000 7feb0a441740 1 --2- 172.21.15.39:0/3523415833 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559641e69270 0x559642236120 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.346+0000 7feb0a441740 1 -- 172.21.15.39:0/3523415833 >> 172.21.15.39:0/3523415833 conn(0x559641e5d3c0 msgr2=0x55964220ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:23.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.346+0000 7feb0a441740 1 -- 172.21.15.39:0/3523415833 shutdown_connections 2024-05-14T14:40:23.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.346+0000 7feb0a441740 1 -- 172.21.15.39:0/3523415833 wait complete. 2024-05-14T14:40:23.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.347+0000 7feb0a441740 1 -- start start 2024-05-14T14:40:23.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.347+0000 7feb0a441740 1 Processor -- start 2024-05-14T14:40:23.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.349+0000 7feb0a441740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x559641e403b0 0x5596422545e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:23.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.349+0000 7feb0a441740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559641e48590 0x559642254b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:23.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.349+0000 7feb0a441740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559641e69270 0x559642263580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:23.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.349+0000 7feb0a441740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55964216f8d0 con 0x559641e69270 2024-05-14T14:40:23.337 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.349+0000 7feb0a441740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55964212c760 con 0x559641e48590 2024-05-14T14:40:23.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.349+0000 7feb0a441740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x559642238200 con 0x559641e403b0 2024-05-14T14:40:23.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.349+0000 7feb0a441740 10 client.0 _ll_register_callbacks cb 0x559642165cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T14:40:23.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.349+0000 7feb01b23640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559641e69270 0x559642263580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:23.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.349+0000 7feb01b23640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559641e69270 0x559642263580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47526/0 (socket says 172.21.15.39:47526) 2024-05-14T14:40:23.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.349+0000 7feb01b23640 1 -- 172.21.15.39:0/975452413 learned_addr learned my addr 172.21.15.39:0/975452413 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:23.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.349+0000 7feb01322640 1 --2- 172.21.15.39:0/975452413 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x559641e403b0 0x5596422545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:23.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.349+0000 7feb00b21640 1 --2- 172.21.15.39:0/975452413 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559641e48590 0x559642254b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:23.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.349+0000 7feb01b23640 1 -- 172.21.15.39:0/975452413 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x559641e403b0 msgr2=0x5596422545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:23.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.349+0000 7feb01b23640 1 --2- 172.21.15.39:0/975452413 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x559641e403b0 0x5596422545e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.349+0000 7feb01b23640 1 -- 172.21.15.39:0/975452413 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559641e48590 msgr2=0x559642254b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:23.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.349+0000 7feb01b23640 1 --2- 172.21.15.39:0/975452413 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559641e48590 0x559642254b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.349+0000 7feb01b23640 1 -- 172.21.15.39:0/975452413 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559641e812d0 con 0x559641e69270 2024-05-14T14:40:23.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.349+0000 7feb00b21640 1 --2- 172.21.15.39:0/975452413 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559641e48590 0x559642254b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:40:23.338 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.349+0000 7feb01b23640 1 --2- 172.21.15.39:0/975452413 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559641e69270 0x559642263580 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7feaf8011d40 tx=0x7feaf800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c675c637a29fad3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:23.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.349+0000 7feadbfff640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-05-14T14:40:23.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.349+0000 7feadbfff640 1 -- 172.21.15.39:0/975452413 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf8019070 con 0x559641e69270 2024-05-14T14:40:23.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.349+0000 7feadbfff640 1 -- 172.21.15.39:0/975452413 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7feaf800fbb0 con 0x559641e69270 2024-05-14T14:40:23.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.349+0000 7feb0a441740 1 -- 172.21.15.39:0/975452413 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feaf402ae50 con 0x559641e69270 2024-05-14T14:40:23.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.350+0000 7feadbfff640 1 -- 172.21.15.39:0/975452413 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7feaf8023050 con 0x559641e69270 2024-05-14T14:40:23.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.350+0000 7feb0a441740 10 client.4383 fetch_fsmap learned FSMap version 7 2024-05-14T14:40:23.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.350+0000 7feb0a441740 1 -- 172.21.15.39:0/975452413 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x559641f4b6b0 con 0x559641e69270 2024-05-14T14:40:23.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.350+0000 7feadbfff640 1 -- 172.21.15.39:0/975452413 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaf402ae50 con 0x559641e69270 2024-05-14T14:40:23.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.350+0000 7feadbfff640 1 -- 172.21.15.39:0/975452413 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7feaf8026020 con 0x559641e69270 2024-05-14T14:40:23.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.350+0000 7feb0a441740 10 client.4383 fetch_fsmap finished waiting for FSMap version 7 2024-05-14T14:40:23.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.350+0000 7feb0a441740 10 client.4383 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-14T14:40:23.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.350+0000 7feb0a441740 20 client.4383 populate_metadata read hostname 'smithi039' 2024-05-14T14:40:23.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.350+0000 7feb0a441740 1 --2- 172.21.15.39:0/975452413 >> [v2:172.21.15.62:6833/1519798364,v1:172.21.15.62:6835/1519798364] conn(0x559641e27e40 0x5596422372f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:23.339 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.350+0000 7feb0a441740 4 client.4383 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T14:40:23.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.350+0000 7feb0a441740 1 -- 172.21.15.39:0/975452413 --> [v2:172.21.15.62:6833/1519798364,v1:172.21.15.62:6835/1519798364] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596420f3760 con 0x559641e27e40 2024-05-14T14:40:23.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.350+0000 7feb01322640 1 --2- 172.21.15.39:0/975452413 >> [v2:172.21.15.62:6833/1519798364,v1:172.21.15.62:6835/1519798364] conn(0x559641e27e40 0x5596422372f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:23.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.351+0000 7feb01322640 1 --2- 172.21.15.39:0/975452413 >> [v2:172.21.15.62:6833/1519798364,v1:172.21.15.62:6835/1519798364] conn(0x559641e27e40 0x5596422372f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47b749e205cb517d server_cookie=7d933bb7a420343e in_seq=0 out_seq=0 2024-05-14T14:40:23.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.351+0000 7feadbfff640 10 client.4383 ms_handle_connect on v2:172.21.15.62:6833/1519798364 2024-05-14T14:40:23.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.351+0000 7feadbfff640 1 -- 172.21.15.39:0/975452413 <== mds.0 v2:172.21.15.62:6833/1519798364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5596420f3760 con 0x559641e27e40 2024-05-14T14:40:23.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.351+0000 7feadbfff640 10 client.4383 handle_command_reply: tid=0 2024-05-14T14:40:23.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.352+0000 7feb0a441740 1 client.4383 shutdown 2024-05-14T14:40:23.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.352+0000 7feb0a441740 1 -- 172.21.15.39:0/975452413 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559641e69270 msgr2=0x559642263580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:23.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.352+0000 7feb0a441740 1 --2- 172.21.15.39:0/975452413 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559641e69270 0x559642263580 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7feaf8011d40 tx=0x7feaf800f580 comp rx=0 tx=0).stop 2024-05-14T14:40:23.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.352+0000 7feb0a441740 1 -- 172.21.15.39:0/975452413 shutdown_connections 2024-05-14T14:40:23.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.352+0000 7feb0a441740 1 --2- 172.21.15.39:0/975452413 >> [v2:172.21.15.62:6833/1519798364,v1:172.21.15.62:6835/1519798364] conn(0x559641e27e40 0x5596422372f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.352+0000 7feb0a441740 1 --2- 172.21.15.39:0/975452413 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559641e69270 0x559642263580 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.352+0000 7feb0a441740 1 --2- 172.21.15.39:0/975452413 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559641e48590 0x559642254b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.352+0000 7feadbfff640 0 client.4383 ms_handle_reset on v2:172.21.15.62:6833/1519798364 2024-05-14T14:40:23.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.352+0000 7feb0a441740 1 --2- 172.21.15.39:0/975452413 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x559641e403b0 0x5596422545e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.352+0000 7feb0a441740 1 -- 172.21.15.39:0/975452413 >> 172.21.15.39:0/975452413 conn(0x559641e5d3c0 msgr2=0x55964220ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:23.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.352+0000 7feb0a441740 1 -- 172.21.15.39:0/975452413 shutdown_connections 2024-05-14T14:40:23.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.352+0000 7feb0a441740 1 -- 172.21.15.39:0/975452413 wait complete. 2024-05-14T14:40:23.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.352+0000 7feb0a441740 20 client.4383 trim_cache size 0 max 16384 2024-05-14T14:40:23.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.371+0000 7feb0a441740 1 Processor -- start 2024-05-14T14:40:23.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.371+0000 7feb0a441740 1 -- start start 2024-05-14T14:40:23.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.372+0000 7feb0a441740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x559641e5d3c0 0x559642251050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:23.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.372+0000 7feb0a441740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559641e27e40 0x5596422534f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:23.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.372+0000 7feb0a441740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559641e403b0 0x55964222e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:23.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.372+0000 7feb0a441740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7feafc203460 con 0x559641e27e40 2024-05-14T14:40:23.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.372+0000 7feb0a441740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7feafc2027c0 con 0x559641e403b0 2024-05-14T14:40:23.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.372+0000 7feb0a441740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7feafc202e10 con 0x559641e5d3c0 2024-05-14T14:40:23.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.372+0000 7feb00b21640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559641e27e40 0x5596422534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:23.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.372+0000 7feb00b21640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559641e27e40 0x5596422534f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47540/0 (socket says 172.21.15.39:47540) 2024-05-14T14:40:23.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.372+0000 7feb00b21640 1 -- 172.21.15.39:0/2646372261 learned_addr learned my addr 172.21.15.39:0/2646372261 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:23.358 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.373+0000 7feb00b21640 1 -- 172.21.15.39:0/2646372261 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x559641e5d3c0 msgr2=0x559642251050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:23.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.373+0000 7feb00b21640 1 --2- 172.21.15.39:0/2646372261 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x559641e5d3c0 0x559642251050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.373+0000 7feb00b21640 1 -- 172.21.15.39:0/2646372261 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559641e403b0 msgr2=0x55964222e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:23.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.373+0000 7feb00b21640 1 --2- 172.21.15.39:0/2646372261 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559641e403b0 0x55964222e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.373+0000 7feb00b21640 1 -- 172.21.15.39:0/2646372261 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596422077c0 con 0x559641e27e40 2024-05-14T14:40:23.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.373+0000 7feb00b21640 1 --2- 172.21.15.39:0/2646372261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559641e27e40 0x5596422534f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7feaec004d70 tx=0x7feaec012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5025f5ce97c31200 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:23.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.373+0000 7feae67fc640 1 -- 172.21.15.39:0/2646372261 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaec015110 con 0x559641e27e40 2024-05-14T14:40:23.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.373+0000 7feae67fc640 1 -- 172.21.15.39:0/2646372261 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaec015990 con 0x559641e27e40 2024-05-14T14:40:23.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.373+0000 7feae67fc640 1 -- 172.21.15.39:0/2646372261 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaec015b80 con 0x559641e27e40 2024-05-14T14:40:23.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.374+0000 7feb0a441740 1 -- 172.21.15.39:0/2646372261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559641e27e40 msgr2=0x5596422534f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:23.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.374+0000 7feb0a441740 1 --2- 172.21.15.39:0/2646372261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559641e27e40 0x5596422534f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7feaec004d70 tx=0x7feaec012000 comp rx=0 tx=0).stop 2024-05-14T14:40:23.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.374+0000 7feb0a441740 1 -- 172.21.15.39:0/2646372261 shutdown_connections 2024-05-14T14:40:23.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.374+0000 7feb0a441740 1 --2- 172.21.15.39:0/2646372261 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559641e403b0 0x55964222e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.374+0000 7feb0a441740 1 --2- 172.21.15.39:0/2646372261 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559641e27e40 0x5596422534f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.374+0000 7feb0a441740 1 --2- 172.21.15.39:0/2646372261 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x559641e5d3c0 0x559642251050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.359 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.374+0000 7feb0a441740 1 -- 172.21.15.39:0/2646372261 >> 172.21.15.39:0/2646372261 conn(0x559642236250 msgr2=0x559642254970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:23.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.374+0000 7feb0a441740 1 -- 172.21.15.39:0/2646372261 shutdown_connections 2024-05-14T14:40:23.360 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.374+0000 7feb0a441740 1 -- 172.21.15.39:0/2646372261 wait complete. 2024-05-14T14:40:23.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.375+0000 7feb0a441740 1 -- start start 2024-05-14T14:40:23.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.375+0000 7feb0a441740 1 Processor -- start 2024-05-14T14:40:23.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.376+0000 7feb0a441740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559641e27e40 0x55964222a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:23.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.376+0000 7feb0a441740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x559641e403b0 0x5596422cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:23.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.376+0000 7feb0a441740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559641e5d3c0 0x55964225f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:23.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.376+0000 7feb0a441740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55964222ac10 con 0x559641e5d3c0 2024-05-14T14:40:23.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.376+0000 7feb0a441740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x559642237f40 con 0x559641e27e40 2024-05-14T14:40:23.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.376+0000 7feb0a441740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x559642263d50 con 0x559641e403b0 2024-05-14T14:40:23.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.376+0000 7feb0a441740 10 client.0 _ll_register_callbacks cb 0x7feaf8009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T14:40:23.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.376+0000 7feb01b23640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559641e5d3c0 0x55964225f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:23.364 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.376+0000 7feb01b23640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559641e5d3c0 0x55964225f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47544/0 (socket says 172.21.15.39:47544) 2024-05-14T14:40:23.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.376+0000 7feb01b23640 1 -- 172.21.15.39:0/3407678029 learned_addr learned my addr 172.21.15.39:0/3407678029 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:23.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.376+0000 7feb01322640 1 --2- 172.21.15.39:0/3407678029 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559641e27e40 0x55964222a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:23.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.376+0000 7feb00b21640 1 --2- 172.21.15.39:0/3407678029 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x559641e403b0 0x5596422cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:23.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.377+0000 7feb01b23640 1 -- 172.21.15.39:0/3407678029 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x559641e403b0 msgr2=0x5596422cd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:23.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.377+0000 7feb01b23640 1 --2- 172.21.15.39:0/3407678029 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x559641e403b0 0x5596422cd9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.377+0000 7feb01b23640 1 -- 172.21.15.39:0/3407678029 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559641e27e40 msgr2=0x55964222a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:23.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.377+0000 7feb01b23640 1 --2- 172.21.15.39:0/3407678029 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559641e27e40 0x55964222a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.377+0000 7feb01b23640 1 -- 172.21.15.39:0/3407678029 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559642230180 con 0x559641e5d3c0 2024-05-14T14:40:23.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.377+0000 7feb01b23640 1 --2- 172.21.15.39:0/3407678029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559641e5d3c0 0x55964225f400 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7feaf800b010 tx=0x7feaf8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29807820bc9f5e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:23.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.377+0000 7feadbfff640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-05-14T14:40:23.365 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.377+0000 7feadbfff640 1 -- 172.21.15.39:0/3407678029 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf802b020 con 0x559641e5d3c0 2024-05-14T14:40:23.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.377+0000 7feadbfff640 1 -- 172.21.15.39:0/3407678029 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7feaf8015840 con 0x559641e5d3c0 2024-05-14T14:40:23.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.377+0000 7feb0a441740 1 -- 172.21.15.39:0/3407678029 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feaec015990 con 0x559641e5d3c0 2024-05-14T14:40:23.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.377+0000 7feadbfff640 1 -- 172.21.15.39:0/3407678029 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7feaf8032050 con 0x559641e5d3c0 2024-05-14T14:40:23.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.377+0000 7feb0a441740 10 client.4389 fetch_fsmap learned FSMap version 7 2024-05-14T14:40:23.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.377+0000 7feb0a441740 1 -- 172.21.15.39:0/3407678029 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x5596422d19f0 con 0x559641e5d3c0 2024-05-14T14:40:23.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.377+0000 7feadbfff640 1 -- 172.21.15.39:0/3407678029 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaec015990 con 0x559641e5d3c0 2024-05-14T14:40:23.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.377+0000 7feadbfff640 1 -- 172.21.15.39:0/3407678029 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7feaf8035020 con 0x559641e5d3c0 2024-05-14T14:40:23.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.377+0000 7feb0a441740 10 client.4389 fetch_fsmap finished waiting for FSMap version 7 2024-05-14T14:40:23.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.377+0000 7feb0a441740 10 client.4389 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-14T14:40:23.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.377+0000 7feb0a441740 20 client.4389 populate_metadata read hostname 'smithi039' 2024-05-14T14:40:23.366 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.377+0000 7feb0a441740 1 --2- 172.21.15.39:0/3407678029 >> [v2:172.21.15.62:6833/1519798364,v1:172.21.15.62:6835/1519798364] conn(0x559641e69270 0x559642251c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:23.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.377+0000 7feb0a441740 4 client.4389 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T14:40:23.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.378+0000 7feb0a441740 1 -- 172.21.15.39:0/3407678029 --> [v2:172.21.15.62:6833/1519798364,v1:172.21.15.62:6835/1519798364] -- command(tid 0: {"prefix": "status"}) -- 0x55964217d4e0 con 0x559641e69270 2024-05-14T14:40:23.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.378+0000 7feb01322640 1 --2- 172.21.15.39:0/3407678029 >> [v2:172.21.15.62:6833/1519798364,v1:172.21.15.62:6835/1519798364] conn(0x559641e69270 0x559642251c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:23.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.378+0000 7feadbfff640 10 client.4389 ms_handle_connect on v2:172.21.15.62:6833/1519798364 2024-05-14T14:40:23.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.378+0000 7feb01322640 1 --2- 172.21.15.39:0/3407678029 >> [v2:172.21.15.62:6833/1519798364,v1:172.21.15.62:6835/1519798364] conn(0x559641e69270 0x559642251c20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1729d1751845c43b server_cookie=aee8b30722e315a0 in_seq=0 out_seq=0 2024-05-14T14:40:23.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.378+0000 7feadbfff640 1 -- 172.21.15.39:0/3407678029 <== mds.0 v2:172.21.15.62:6833/1519798364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55964217d4e0 con 0x559641e69270 2024-05-14T14:40:23.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.378+0000 7feadbfff640 10 client.4389 handle_command_reply: tid=0 2024-05-14T14:40:23.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.378+0000 7feb0a441740 1 client.4389 shutdown 2024-05-14T14:40:23.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.378+0000 7feb0a441740 1 -- 172.21.15.39:0/3407678029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559641e5d3c0 msgr2=0x55964225f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:23.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.378+0000 7feb0a441740 1 --2- 172.21.15.39:0/3407678029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559641e5d3c0 0x55964225f400 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7feaf800b010 tx=0x7feaf8004ab0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.379+0000 7feb0a441740 1 -- 172.21.15.39:0/3407678029 shutdown_connections 2024-05-14T14:40:23.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.379+0000 7feb0a441740 1 --2- 172.21.15.39:0/3407678029 >> [v2:172.21.15.62:6833/1519798364,v1:172.21.15.62:6835/1519798364] conn(0x559641e69270 0x559642251c20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.379+0000 7feb0a441740 1 --2- 172.21.15.39:0/3407678029 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x559641e5d3c0 0x55964225f400 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.367 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.379+0000 7feb0a441740 1 --2- 172.21.15.39:0/3407678029 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x559641e403b0 0x5596422cd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.379+0000 7feadbfff640 0 client.4389 ms_handle_reset on v2:172.21.15.62:6833/1519798364 2024-05-14T14:40:23.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.379+0000 7feb0a441740 1 --2- 172.21.15.39:0/3407678029 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x559641e27e40 0x55964222a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.379+0000 7feb0a441740 1 -- 172.21.15.39:0/3407678029 >> 172.21.15.39:0/3407678029 conn(0x559642236250 msgr2=0x559642235970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:23.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.379+0000 7feb0a441740 1 -- 172.21.15.39:0/3407678029 shutdown_connections 2024-05-14T14:40:23.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.379+0000 7feb0a441740 1 -- 172.21.15.39:0/3407678029 wait complete. 2024-05-14T14:40:23.368 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.379+0000 7feb0a441740 20 client.4389 trim_cache size 0 max 16384 2024-05-14T14:40:23.368 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-05-14T14:40:23.368 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "d7983fec-79c7-4991-b19c-1aecead64611", 2024-05-14T14:40:23.368 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 0, 2024-05-14T14:40:23.368 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 4278, 2024-05-14T14:40:23.368 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-05-14T14:40:23.369 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-05-14T14:40:23.369 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-05-14T14:40:23.369 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 7.4162969429999999, 2024-05-14T14:40:23.369 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 7, 2024-05-14T14:40:23.369 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 24, 2024-05-14T14:40:23.369 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 24, 2024-05-14T14:40:23.369 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 12.913953675 2024-05-14T14:40:23.369 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-05-14T14:40:23.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.379+0000 7feb03586640 1 -- 172.21.15.39:0/921707584 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7feae00762d0 msgr2=0x7feae00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:23.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.379+0000 7feb03586640 1 --2- 172.21.15.39:0/921707584 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7feae00762d0 0x7feae00787e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7feafc1fa0b0 tx=0x7feaec000bc0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.379+0000 7feb03586640 1 -- 172.21.15.39:0/921707584 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feafc0ce590 msgr2=0x7feafc0cb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:23.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.379+0000 7feb03586640 1 --2- 172.21.15.39:0/921707584 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feafc0ce590 0x7feafc0cb9c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7feaf40098c0 tx=0x7feaf40046c0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.379+0000 7feb03586640 1 -- 172.21.15.39:0/921707584 shutdown_connections 2024-05-14T14:40:23.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.379+0000 7feb03586640 1 --2- 172.21.15.39:0/921707584 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7feae00762d0 0x7feae00787e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.379+0000 7feb03586640 1 --2- 172.21.15.39:0/921707584 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feafc161c20 0x7feafc06eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.379+0000 7feb03586640 1 --2- 172.21.15.39:0/921707584 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7feafc0d0200 0x7feafc1f0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.379+0000 7feb03586640 1 --2- 172.21.15.39:0/921707584 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7feafc0ce590 0x7feafc0cb9c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.379+0000 7feb03586640 1 -- 172.21.15.39:0/921707584 >> 172.21.15.39:0/921707584 conn(0x7feafc071660 msgr2=0x7feafc071a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:23.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.379+0000 7feb03586640 1 -- 172.21.15.39:0/921707584 shutdown_connections 2024-05-14T14:40:23.371 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.379+0000 7feb03586640 1 -- 172.21.15.39:0/921707584 wait complete. 2024-05-14T14:40:23.374 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-14T14:40:23.375 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-14T14:40:23.375 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-14T14:40:23.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.505+0000 7f4e3f013640 1 Processor -- start 2024-05-14T14:40:23.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.505+0000 7f4e3f013640 1 -- start start 2024-05-14T14:40:23.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.506+0000 7f4e3f013640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4e380b4820 0x7f4e38163da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:23.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.506+0000 7f4e3f013640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4e381602f0 0x7f4e381642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:23.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.506+0000 7f4e3f013640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e380b4fc0 con 0x7f4e38164820 2024-05-14T14:40:23.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.506+0000 7f4e3f013640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f4e38164c30 con 0x7f4e380b4820 2024-05-14T14:40:23.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.506+0000 7f4e3f013640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f4e380b4d70 con 0x7f4e381602f0 2024-05-14T14:40:23.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.506+0000 7f4e3cdaf640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4e380b4820 0x7f4e38163da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:23.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.506+0000 7f4e3d5b0640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f4e38164820 0x7f4e380d0930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:37710/0 (socket says 172.21.15.39:37710) 2024-05-14T14:40:23.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.506+0000 7f4e3d5b0640 1 -- 172.21.15.39:0/1507208291 learned_addr learned my addr 172.21.15.39:0/1507208291 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:23.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.506+0000 7f4e37fff640 1 --2- 172.21.15.39:0/1507208291 >> v2:172.21.15.62:3300/0 conn(0x7f4e381602f0 0x7f4e381642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:23.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.506+0000 7f4e3cdaf640 1 -- 172.21.15.39:0/1507208291 >> v2:172.21.15.62:3300/0 conn(0x7f4e381602f0 msgr2=0x7f4e381642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:23.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.507+0000 7f4e3cdaf640 1 --2- 172.21.15.39:0/1507208291 >> v2:172.21.15.62:3300/0 conn(0x7f4e381602f0 0x7f4e381642e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.507+0000 7f4e3cdaf640 1 -- 172.21.15.39:0/1507208291 >> v1:172.21.15.39:6789/0 conn(0x7f4e38164820 legacy=0x7f4e380d0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:23.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.507+0000 7f4e377fe640 1 -- 172.21.15.39:0/1507208291 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3028454879 0 0) 0x7f4e380b4fc0 con 0x7f4e38164820 2024-05-14T14:40:23.492 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.507+0000 7f4e3cdaf640 1 -- 172.21.15.39:0/1507208291 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e380d4fc0 con 0x7f4e380b4820 2024-05-14T14:40:23.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.507+0000 7f4e3cdaf640 1 --2- 172.21.15.39:0/1507208291 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e380b4820 0x7f4e38163da0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4e380d0260 tx=0x7f4e2c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a32189c5d134981c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:23.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.507+0000 7f4e377fe640 1 -- 172.21.15.39:0/1507208291 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c037070 con 0x7f4e380b4820 2024-05-14T14:40:23.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.508+0000 7f4e377fe640 1 -- 172.21.15.39:0/1507208291 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e2c032440 con 0x7f4e380b4820 2024-05-14T14:40:23.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.508+0000 7f4e377fe640 1 -- 172.21.15.39:0/1507208291 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e2c032810 con 0x7f4e380b4820 2024-05-14T14:40:23.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.508+0000 7f4e3f013640 1 -- 172.21.15.39:0/1507208291 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e380b4820 msgr2=0x7f4e38163da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:23.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.508+0000 7f4e3f013640 1 --2- 172.21.15.39:0/1507208291 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e380b4820 0x7f4e38163da0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4e380d0260 tx=0x7f4e2c02a1a0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.508+0000 7f4e3f013640 1 -- 172.21.15.39:0/1507208291 shutdown_connections 2024-05-14T14:40:23.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.508+0000 7f4e3f013640 1 --2- 172.21.15.39:0/1507208291 >> v2:172.21.15.62:3300/0 conn(0x7f4e381602f0 0x7f4e381642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.508+0000 7f4e3f013640 1 --2- 172.21.15.39:0/1507208291 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e380b4820 0x7f4e38163da0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.508+0000 7f4e3f013640 1 -- 172.21.15.39:0/1507208291 >> 172.21.15.39:0/1507208291 conn(0x7f4e380d6670 msgr2=0x7f4e380d2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:23.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.508+0000 7f4e3f013640 1 -- 172.21.15.39:0/1507208291 shutdown_connections 2024-05-14T14:40:23.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.508+0000 7f4e3f013640 1 -- 172.21.15.39:0/1507208291 wait complete. 2024-05-14T14:40:23.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.510+0000 7f4e3f013640 1 Processor -- start 2024-05-14T14:40:23.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.510+0000 7f4e3f013640 1 -- start start 2024-05-14T14:40:23.497 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.512+0000 7f4e3f013640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e380b4820 0x7f4e381596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:23.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.512+0000 7f4e3f013640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4e381602f0 0x7f4e380b68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:23.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.512+0000 7f4e3f013640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e38164820 0x7f4e380b6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:23.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.512+0000 7f4e3f013640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4e380d5580 con 0x7f4e38164820 2024-05-14T14:40:23.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.512+0000 7f4e3f013640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4e3806c7d0 con 0x7f4e380b4820 2024-05-14T14:40:23.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.512+0000 7f4e3f013640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f4e3806dc70 con 0x7f4e381602f0 2024-05-14T14:40:23.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.512+0000 7f4e3d5b0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e38164820 0x7f4e380b6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:23.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.512+0000 7f4e3d5b0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e38164820 0x7f4e380b6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47552/0 (socket says 172.21.15.39:47552) 2024-05-14T14:40:23.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.512+0000 7f4e3d5b0640 1 -- 172.21.15.39:0/1723244972 learned_addr learned my addr 172.21.15.39:0/1723244972 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:23.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.512+0000 7f4e37fff640 1 --2- 172.21.15.39:0/1723244972 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4e381602f0 0x7f4e380b68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:23.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.512+0000 7f4e3cdaf640 1 --2- 172.21.15.39:0/1723244972 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e380b4820 0x7f4e381596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:23.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.512+0000 7f4e3d5b0640 1 -- 172.21.15.39:0/1723244972 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4e381602f0 msgr2=0x7f4e380b68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:23.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.512+0000 7f4e3d5b0640 1 --2- 172.21.15.39:0/1723244972 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4e381602f0 0x7f4e380b68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.512+0000 7f4e3d5b0640 1 -- 172.21.15.39:0/1723244972 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e380b4820 msgr2=0x7f4e381596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:23.498 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.512+0000 7f4e3d5b0640 1 --2- 172.21.15.39:0/1723244972 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e380b4820 0x7f4e381596a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.512+0000 7f4e3d5b0640 1 -- 172.21.15.39:0/1723244972 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e381f6e90 con 0x7f4e38164820 2024-05-14T14:40:23.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.512+0000 7f4e3d5b0640 1 --2- 172.21.15.39:0/1723244972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e38164820 0x7f4e380b6e10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4e3000c6e0 tx=0x7f4e3000cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:23.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.512+0000 7f4e357fa640 1 -- 172.21.15.39:0/1723244972 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e30018070 con 0x7f4e38164820 2024-05-14T14:40:23.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.513+0000 7f4e357fa640 1 -- 172.21.15.39:0/1723244972 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e30004d60 con 0x7f4e38164820 2024-05-14T14:40:23.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.513+0000 7f4e3f013640 1 -- 172.21.15.39:0/1723244972 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e381f7170 con 0x7f4e38164820 2024-05-14T14:40:23.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.513+0000 7f4e357fa640 1 -- 172.21.15.39:0/1723244972 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e3000a880 con 0x7f4e38164820 2024-05-14T14:40:23.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.513+0000 7f4e3f013640 1 -- 172.21.15.39:0/1723244972 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e381f7c50 con 0x7f4e38164820 2024-05-14T14:40:23.499 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.514+0000 7f4e3f013640 1 -- 172.21.15.39:0/1723244972 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e381615d0 con 0x7f4e38164820 2024-05-14T14:40:23.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.514+0000 7f4e357fa640 1 -- 172.21.15.39:0/1723244972 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4e3001b070 con 0x7f4e38164820 2024-05-14T14:40:23.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.515+0000 7f4e357fa640 1 --2- 172.21.15.39:0/1723244972 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4e1c0762d0 0x7f4e1c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:23.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.515+0000 7f4e357fa640 1 -- 172.21.15.39:0/1723244972 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4e30096e60 con 0x7f4e38164820 2024-05-14T14:40:23.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.515+0000 7f4e3cdaf640 1 --2- 172.21.15.39:0/1723244972 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4e1c0762d0 0x7f4e1c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:23.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.515+0000 7f4e3cdaf640 1 --2- 172.21.15.39:0/1723244972 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4e1c0762d0 0x7f4e1c0787e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c034000 tx=0x7f4e2c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:23.503 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.520+0000 7f4e357fa640 1 -- 172.21.15.39:0/1723244972 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4e3005fda0 con 0x7f4e38164820 2024-05-14T14:40:23.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.750+0000 7f4e3f013640 1 -- 172.21.15.39:0/1723244972 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4e380d40d0 con 0x7f4e38164820 2024-05-14T14:40:23.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.751+0000 7f4e357fa640 1 -- 172.21.15.39:0/1723244972 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7f4e300640a0 con 0x7f4e38164820 2024-05-14T14:40:23.735 INFO:teuthology.orchestra.run.smithi039.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-14T14:40:23.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.753+0000 7f4e3f013640 1 -- 172.21.15.39:0/1723244972 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4e1c0762d0 msgr2=0x7f4e1c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:23.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.753+0000 7f4e3f013640 1 --2- 172.21.15.39:0/1723244972 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4e1c0762d0 0x7f4e1c0787e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c034000 tx=0x7f4e2c02e000 comp rx=0 tx=0).stop 2024-05-14T14:40:23.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.753+0000 7f4e3f013640 1 -- 172.21.15.39:0/1723244972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e38164820 msgr2=0x7f4e380b6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:23.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.753+0000 7f4e3f013640 1 --2- 172.21.15.39:0/1723244972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e38164820 0x7f4e380b6e10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4e3000c6e0 tx=0x7f4e3000cba0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.753+0000 7f4e3f013640 1 -- 172.21.15.39:0/1723244972 shutdown_connections 2024-05-14T14:40:23.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.753+0000 7f4e3f013640 1 --2- 172.21.15.39:0/1723244972 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4e1c0762d0 0x7f4e1c0787e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.753+0000 7f4e3f013640 1 --2- 172.21.15.39:0/1723244972 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4e38164820 0x7f4e380b6e10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.753+0000 7f4e3f013640 1 --2- 172.21.15.39:0/1723244972 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4e381602f0 0x7f4e380b68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.753+0000 7f4e3f013640 1 --2- 172.21.15.39:0/1723244972 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e380b4820 0x7f4e381596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:23.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.753+0000 7f4e3f013640 1 -- 172.21.15.39:0/1723244972 >> 172.21.15.39:0/1723244972 conn(0x7f4e380d6670 msgr2=0x7f4e380d45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:23.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.753+0000 7f4e3f013640 1 -- 172.21.15.39:0/1723244972 shutdown_connections 2024-05-14T14:40:23.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23.753+0000 7f4e3f013640 1 -- 172.21.15.39:0/1723244972 wait complete. 2024-05-14T14:40:23.748 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-14T14:40:23.749 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-14T14:40:23.749 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi039.front.sepia.ceph.com 2024-05-14T14:40:23.749 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-05-14T14:40:23.749 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-14T14:40:23.749 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-14T14:40:23.749 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-14T14:40:23.749 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-14T14:40:23.749 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-05-14T14:40:23.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:23.749 DEBUG:teuthology.orchestra.run.smithi039:> ip addr 2024-05-14T14:40:23.765 INFO:teuthology.orchestra.run.smithi039.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-14T14:40:23.766 INFO:teuthology.orchestra.run.smithi039.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-14T14:40:23.766 INFO:teuthology.orchestra.run.smithi039.stdout: inet 127.0.0.1/8 scope host lo 2024-05-14T14:40:23.766 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:40:23.766 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 ::1/128 scope host 2024-05-14T14:40:23.766 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:40:23.766 INFO:teuthology.orchestra.run.smithi039.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T14:40:23.766 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c6 brd ff:ff:ff:ff:ff:ff 2024-05-14T14:40:23.766 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f0 2024-05-14T14:40:23.766 INFO:teuthology.orchestra.run.smithi039.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T14:40:23.766 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c7 brd ff:ff:ff:ff:ff:ff 2024-05-14T14:40:23.766 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f1 2024-05-14T14:40:23.766 INFO:teuthology.orchestra.run.smithi039.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-14T14:40:23.766 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:70 brd ff:ff:ff:ff:ff:ff 2024-05-14T14:40:23.766 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f0 2024-05-14T14:40:23.767 INFO:teuthology.orchestra.run.smithi039.stdout: inet 172.21.15.39/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-14T14:40:23.767 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft 42712sec preferred_lft 42712sec 2024-05-14T14:40:23.767 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::ec4:7aff:febd:1370/64 scope link noprefixroute 2024-05-14T14:40:23.767 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:40:23.767 INFO:teuthology.orchestra.run.smithi039.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T14:40:23.767 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:71 brd ff:ff:ff:ff:ff:ff 2024-05-14T14:40:23.767 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f1 2024-05-14T14:40:23.767 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-14T14:40:23.768 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T14:40:23.768 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-05-14T14:40:23.768 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link add name ceph-brx type bridge 2024-05-14T14:40:23.768 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip addr flush dev ceph-brx 2024-05-14T14:40:23.768 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set ceph-brx up 2024-05-14T14:40:23.768 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-14T14:40:23.768 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-05-14T14:40:23.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T14:40:23.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:40:23.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:23.969 DEBUG:teuthology.orchestra.run.smithi039:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-14T14:40:23.995 INFO:teuthology.orchestra.run.smithi039.stdout:1 2024-05-14T14:40:23.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:23.997 DEBUG:teuthology.orchestra.run.smithi039:> route 2024-05-14T14:40:24.058 INFO:teuthology.orchestra.run.smithi039.stdout:Kernel IP routing table 2024-05-14T14:40:24.058 INFO:teuthology.orchestra.run.smithi039.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-14T14:40:24.058 INFO:teuthology.orchestra.run.smithi039.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-14T14:40:24.058 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-14T14:40:24.058 INFO:teuthology.orchestra.run.smithi039.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-14T14:40:24.059 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T14:40:24.059 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-05-14T14:40:24.059 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-14T14:40:24.059 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-14T14:40:24.059 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-14T14:40:24.059 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-05-14T14:40:24.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T14:40:24.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:40:24.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:24.349 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2024-05-14T14:40:24.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:24.366 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list-id 2024-05-14T14:40:24.422 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T14:40:24.422 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-05-14T14:40:24.422 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-14T14:40:24.422 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-05-14T14:40:24.422 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-05-14T14:40:24.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T14:40:24.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:40:24.542 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-05-14T14:40:24.543 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T14:40:24.543 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-05-14T14:40:24.543 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-05-14T14:40:24.543 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-14T14:40:24.543 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-05-14T14:40:24.543 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-05-14T14:40:24.543 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-05-14T14:40:24.543 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-05-14T14:40:24.593 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T14:40:24.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:40:24.672 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T14:40:24.672 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-05-14T14:40:24.672 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set brx.0 up 2024-05-14T14:40:24.672 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set dev brx.0 master ceph-brx 2024-05-14T14:40:24.672 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-05-14T14:40:24.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T14:40:24.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:40:24.752 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-05-14T14:40:24.753 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T14:40:24.753 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-05-14T14:40:24.769 INFO:teuthology.orchestra.run.smithi039.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-05-14T14:40:24.769 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T14:40:24.769 DEBUG:teuthology.orchestra.run.smithi039:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-05-14T14:40:24.825 DEBUG:teuthology.orchestra.run.smithi039:> sudo modprobe fuse 2024-05-14T14:40:24.891 DEBUG:teuthology.orchestra.run.smithi039:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T14:40:24.949 INFO:teuthology.orchestra.run.smithi039.stdout:/proc 2024-05-14T14:40:24.949 INFO:teuthology.orchestra.run.smithi039.stdout:/sys 2024-05-14T14:40:24.949 INFO:teuthology.orchestra.run.smithi039.stdout:/dev 2024-05-14T14:40:24.949 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/kernel/security 2024-05-14T14:40:24.949 INFO:teuthology.orchestra.run.smithi039.stdout:/dev/shm 2024-05-14T14:40:24.949 INFO:teuthology.orchestra.run.smithi039.stdout:/dev/pts 2024-05-14T14:40:24.949 INFO:teuthology.orchestra.run.smithi039.stdout:/run 2024-05-14T14:40:24.949 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/fs/cgroup 2024-05-14T14:40:24.949 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/fs/pstore 2024-05-14T14:40:24.949 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/fs/bpf 2024-05-14T14:40:24.949 INFO:teuthology.orchestra.run.smithi039.stdout:/ 2024-05-14T14:40:24.949 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/fs/selinux 2024-05-14T14:40:24.949 INFO:teuthology.orchestra.run.smithi039.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T14:40:24.950 INFO:teuthology.orchestra.run.smithi039.stdout:/dev/mqueue 2024-05-14T14:40:24.950 INFO:teuthology.orchestra.run.smithi039.stdout:/dev/hugepages 2024-05-14T14:40:24.950 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/kernel/debug 2024-05-14T14:40:24.950 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/kernel/tracing 2024-05-14T14:40:24.950 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/fs/fuse/connections 2024-05-14T14:40:24.950 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/kernel/config 2024-05-14T14:40:24.950 INFO:teuthology.orchestra.run.smithi039.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T14:40:24.950 INFO:teuthology.orchestra.run.smithi039.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T14:40:24.950 INFO:teuthology.orchestra.run.smithi039.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T14:40:24.950 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T14:40:24.950 INFO:teuthology.orchestra.run.smithi039.stdout:/run/user/1000 2024-05-14T14:40:24.950 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/ceph 2024-05-14T14:40:24.950 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/ceph/osd/ceph-0 2024-05-14T14:40:24.950 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/ceph/osd/ceph-1 2024-05-14T14:40:24.951 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/ceph/osd/ceph-2 2024-05-14T14:40:24.951 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/ceph/osd/ceph-3 2024-05-14T14:40:24.951 INFO:teuthology.orchestra.run.smithi039.stdout:/run/netns 2024-05-14T14:40:24.951 INFO:teuthology.orchestra.run.smithi039.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-14T14:40:24.951 INFO:teuthology.orchestra.run.smithi039.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-14T14:40:24.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:24.951 DEBUG:teuthology.orchestra.run.smithi039:> ls /sys/fs/fuse/connections 2024-05-14T14:40:25.004 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-14T14:40:25.005 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-05-14T14:40:25.047 DEBUG:teuthology.orchestra.run.smithi039:> sudo modprobe fuse 2024-05-14T14:40:25.074 DEBUG:teuthology.orchestra.run.smithi039:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T14:40:25.131 INFO:teuthology.orchestra.run.smithi039.stdout:/proc 2024-05-14T14:40:25.131 INFO:teuthology.orchestra.run.smithi039.stdout:/sys 2024-05-14T14:40:25.131 INFO:teuthology.orchestra.run.smithi039.stdout:/dev 2024-05-14T14:40:25.131 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/kernel/security 2024-05-14T14:40:25.131 INFO:teuthology.orchestra.run.smithi039.stdout:/dev/shm 2024-05-14T14:40:25.131 INFO:teuthology.orchestra.run.smithi039.stdout:/dev/pts 2024-05-14T14:40:25.131 INFO:teuthology.orchestra.run.smithi039.stdout:/run 2024-05-14T14:40:25.131 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/fs/cgroup 2024-05-14T14:40:25.131 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/fs/pstore 2024-05-14T14:40:25.131 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/fs/bpf 2024-05-14T14:40:25.131 INFO:teuthology.orchestra.run.smithi039.stdout:/ 2024-05-14T14:40:25.132 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/fs/selinux 2024-05-14T14:40:25.132 INFO:teuthology.orchestra.run.smithi039.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T14:40:25.132 INFO:teuthology.orchestra.run.smithi039.stdout:/dev/mqueue 2024-05-14T14:40:25.132 INFO:teuthology.orchestra.run.smithi039.stdout:/dev/hugepages 2024-05-14T14:40:25.132 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/kernel/debug 2024-05-14T14:40:25.132 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/kernel/tracing 2024-05-14T14:40:25.132 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/fs/fuse/connections 2024-05-14T14:40:25.132 INFO:teuthology.orchestra.run.smithi039.stdout:/sys/kernel/config 2024-05-14T14:40:25.132 INFO:teuthology.orchestra.run.smithi039.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T14:40:25.132 INFO:teuthology.orchestra.run.smithi039.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T14:40:25.132 INFO:teuthology.orchestra.run.smithi039.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T14:40:25.132 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T14:40:25.132 INFO:teuthology.orchestra.run.smithi039.stdout:/run/user/1000 2024-05-14T14:40:25.132 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/ceph 2024-05-14T14:40:25.132 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/ceph/osd/ceph-0 2024-05-14T14:40:25.133 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/ceph/osd/ceph-1 2024-05-14T14:40:25.133 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/ceph/osd/ceph-2 2024-05-14T14:40:25.133 INFO:teuthology.orchestra.run.smithi039.stdout:/var/lib/ceph/osd/ceph-3 2024-05-14T14:40:25.133 INFO:teuthology.orchestra.run.smithi039.stdout:/run/netns 2024-05-14T14:40:25.133 INFO:teuthology.orchestra.run.smithi039.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-14T14:40:25.133 INFO:teuthology.orchestra.run.smithi039.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-14T14:40:25.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:25.133 DEBUG:teuthology.orchestra.run.smithi039:> ls /sys/fs/fuse/connections 2024-05-14T14:40:25.156 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi039.stderr:2024-05-14T14:40:25.172+0000 7f795f598480 -1 init, newargv = 0x55c720a2e0c0 newargc=15 2024-05-14T14:40:25.156 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi039.stderr:ceph-fuse[44569]: starting ceph client 2024-05-14T14:40:25.164 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi039.stderr:ceph-fuse[44569]: starting fuse 2024-05-14T14:40:25.173 INFO:teuthology.orchestra.run.smithi039.stdout:42 2024-05-14T14:40:25.173 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-05-14T14:40:25.173 DEBUG:teuthology.orchestra.run.smithi039:> sudo stdin-killer -- python3 -c ' 2024-05-14T14:40:25.173 DEBUG:teuthology.orchestra.run.smithi039:> import glob 2024-05-14T14:40:25.173 DEBUG:teuthology.orchestra.run.smithi039:> import re 2024-05-14T14:40:25.173 DEBUG:teuthology.orchestra.run.smithi039:> import os 2024-05-14T14:40:25.173 DEBUG:teuthology.orchestra.run.smithi039:> import subprocess 2024-05-14T14:40:25.173 DEBUG:teuthology.orchestra.run.smithi039:> 2024-05-14T14:40:25.174 DEBUG:teuthology.orchestra.run.smithi039:> def _find_admin_socket(client_name): 2024-05-14T14:40:25.174 DEBUG:teuthology.orchestra.run.smithi039:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-05-14T14:40:25.174 DEBUG:teuthology.orchestra.run.smithi039:> files = glob.glob(asok_path) 2024-05-14T14:40:25.174 DEBUG:teuthology.orchestra.run.smithi039:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-05-14T14:40:25.174 DEBUG:teuthology.orchestra.run.smithi039:> 2024-05-14T14:40:25.174 DEBUG:teuthology.orchestra.run.smithi039:> # Given a non-glob path, it better be there 2024-05-14T14:40:25.174 DEBUG:teuthology.orchestra.run.smithi039:> if "*" not in asok_path: 2024-05-14T14:40:25.174 DEBUG:teuthology.orchestra.run.smithi039:> assert(len(files) == 1) 2024-05-14T14:40:25.174 DEBUG:teuthology.orchestra.run.smithi039:> return files[0] 2024-05-14T14:40:25.174 DEBUG:teuthology.orchestra.run.smithi039:> 2024-05-14T14:40:25.174 DEBUG:teuthology.orchestra.run.smithi039:> for f in files: 2024-05-14T14:40:25.174 DEBUG:teuthology.orchestra.run.smithi039:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-14T14:40:25.174 DEBUG:teuthology.orchestra.run.smithi039:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-14T14:40:25.174 DEBUG:teuthology.orchestra.run.smithi039:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-14T14:40:25.174 DEBUG:teuthology.orchestra.run.smithi039:> contents = proc_f.read() 2024-05-14T14:40:25.174 DEBUG:teuthology.orchestra.run.smithi039:> if mountpoint in contents: 2024-05-14T14:40:25.174 DEBUG:teuthology.orchestra.run.smithi039:> return f 2024-05-14T14:40:25.175 DEBUG:teuthology.orchestra.run.smithi039:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-14T14:40:25.175 DEBUG:teuthology.orchestra.run.smithi039:> 2024-05-14T14:40:25.175 DEBUG:teuthology.orchestra.run.smithi039:> print(_find_admin_socket("client.admin")) 2024-05-14T14:40:25.175 DEBUG:teuthology.orchestra.run.smithi039:> ' 2024-05-14T14:40:25.294 INFO:teuthology.orchestra.run.smithi039.stdout:/var/run/ceph/ceph-client.admin.44569.asok 2024-05-14T14:40:25.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:40:25.305 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.44569.asok 2024-05-14T14:40:25.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:25.305 DEBUG:teuthology.orchestra.run.smithi039:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.44569.asok status 2024-05-14T14:40:25.451 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-05-14T14:40:25.452 INFO:teuthology.orchestra.run.smithi039.stdout: "metadata": { 2024-05-14T14:40:25.452 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_sha1": "e2b755a64f0d72176b57299d02e880cf0620d780", 2024-05-14T14:40:25.452 INFO:teuthology.orchestra.run.smithi039.stdout: "ceph_version": "ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev)", 2024-05-14T14:40:25.452 INFO:teuthology.orchestra.run.smithi039.stdout: "entity_id": "admin", 2024-05-14T14:40:25.452 INFO:teuthology.orchestra.run.smithi039.stdout: "hostname": "smithi039", 2024-05-14T14:40:25.452 INFO:teuthology.orchestra.run.smithi039.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-05-14T14:40:25.452 INFO:teuthology.orchestra.run.smithi039.stdout: "pid": "44569", 2024-05-14T14:40:25.452 INFO:teuthology.orchestra.run.smithi039.stdout: "root": "/" 2024-05-14T14:40:25.452 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-14T14:40:25.452 INFO:teuthology.orchestra.run.smithi039.stdout: "dentry_count": 0, 2024-05-14T14:40:25.452 INFO:teuthology.orchestra.run.smithi039.stdout: "dentry_pinned_count": 0, 2024-05-14T14:40:25.452 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 4404, 2024-05-14T14:40:25.452 INFO:teuthology.orchestra.run.smithi039.stdout: "inst": { 2024-05-14T14:40:25.453 INFO:teuthology.orchestra.run.smithi039.stdout: "name": { 2024-05-14T14:40:25.453 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "client", 2024-05-14T14:40:25.453 INFO:teuthology.orchestra.run.smithi039.stdout: "num": 4404 2024-05-14T14:40:25.453 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-14T14:40:25.453 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": { 2024-05-14T14:40:25.453 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v1", 2024-05-14T14:40:25.453 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "192.168.0.1:0", 2024-05-14T14:40:25.453 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 1580621483 2024-05-14T14:40:25.453 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-14T14:40:25.453 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-14T14:40:25.453 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": { 2024-05-14T14:40:25.453 INFO:teuthology.orchestra.run.smithi039.stdout: "type": "v1", 2024-05-14T14:40:25.453 INFO:teuthology.orchestra.run.smithi039.stdout: "addr": "192.168.0.1:0", 2024-05-14T14:40:25.453 INFO:teuthology.orchestra.run.smithi039.stdout: "nonce": 1580621483 2024-05-14T14:40:25.453 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-14T14:40:25.454 INFO:teuthology.orchestra.run.smithi039.stdout: "inst_str": "client.4404 192.168.0.1:0/1580621483", 2024-05-14T14:40:25.454 INFO:teuthology.orchestra.run.smithi039.stdout: "addr_str": "192.168.0.1:0/1580621483", 2024-05-14T14:40:25.454 INFO:teuthology.orchestra.run.smithi039.stdout: "inode_count": 1, 2024-05-14T14:40:25.454 INFO:teuthology.orchestra.run.smithi039.stdout: "mds_epoch": 7, 2024-05-14T14:40:25.454 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_epoch": 24, 2024-05-14T14:40:25.454 INFO:teuthology.orchestra.run.smithi039.stdout: "osd_epoch_barrier": 0, 2024-05-14T14:40:25.454 INFO:teuthology.orchestra.run.smithi039.stdout: "blocklisted": false, 2024-05-14T14:40:25.454 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs" 2024-05-14T14:40:25.454 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-05-14T14:40:25.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:25.461 DEBUG:teuthology.orchestra.run.smithi039:> stat --file-system '--printf=%T 2024-05-14T14:40:25.461 DEBUG:teuthology.orchestra.run.smithi039:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-05-14T14:40:25.478 INFO:teuthology.orchestra.run.smithi039.stdout:fuseblk 2024-05-14T14:40:25.478 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-05-14T14:40:25.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:25.478 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-05-14T14:40:25.546 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-05-14T14:40:25.640 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-14T14:40:25.658 INFO:teuthology.orchestra.run.smithi039.stdout:# file: . 2024-05-14T14:40:25.658 INFO:teuthology.orchestra.run.smithi039.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-05-14T14:40:25.658 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:40:25.658 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:40:25.664 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T14:40:25.664 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T14:40:25.681 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-14T14:40:25.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.852+0000 7fbae8f5e640 1 Processor -- start 2024-05-14T14:40:25.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.852+0000 7fbae8f5e640 1 -- start start 2024-05-14T14:40:25.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.853+0000 7fbae8f5e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbae40cf060 0x7fbae415cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:25.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.853+0000 7fbae8f5e640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbae40cdad0 0x7fbae40b63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:25.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.853+0000 7fbae8f5e640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbae406c740 con 0x7fbae40b68f0 2024-05-14T14:40:25.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.853+0000 7fbae8f5e640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fbae40b5980 con 0x7fbae40cdad0 2024-05-14T14:40:25.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.853+0000 7fbae8f5e640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fbae406ccc0 con 0x7fbae40cf060 2024-05-14T14:40:25.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.853+0000 7fbad9d9b640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbae40cdad0 0x7fbae40b63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:25.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.853+0000 7fbae2d9d640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fbae40b68f0 0x7fbae40cf770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:37722/0 (socket says 172.21.15.39:37722) 2024-05-14T14:40:25.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.853+0000 7fbae2d9d640 1 -- 172.21.15.39:0/478927006 learned_addr learned my addr 172.21.15.39:0/478927006 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:25.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.853+0000 7fbad9d9b640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbae40cdad0 0x7fbae40b63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47554/0 (socket says 172.21.15.39:47554) 2024-05-14T14:40:25.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.854+0000 7fbae259c640 1 --2- 172.21.15.39:0/478927006 >> v2:172.21.15.62:3300/0 conn(0x7fbae40cf060 0x7fbae415cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:25.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.854+0000 7fbad9d9b640 1 -- 172.21.15.39:0/478927006 >> v2:172.21.15.62:3300/0 conn(0x7fbae40cf060 msgr2=0x7fbae415cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:25.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.854+0000 7fbad9d9b640 1 --2- 172.21.15.39:0/478927006 >> v2:172.21.15.62:3300/0 conn(0x7fbae40cf060 0x7fbae415cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:25.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.854+0000 7fbad9d9b640 1 -- 172.21.15.39:0/478927006 >> v1:172.21.15.39:6789/0 conn(0x7fbae40b68f0 legacy=0x7fbae40cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:25.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.854+0000 7fbad9d9b640 1 -- 172.21.15.39:0/478927006 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbae406c9e0 con 0x7fbae40cdad0 2024-05-14T14:40:25.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.854+0000 7fbae1d9b640 1 -- 172.21.15.39:0/478927006 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3090704551 0 0) 0x7fbae406c740 con 0x7fbae40b68f0 2024-05-14T14:40:25.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.854+0000 7fbad9d9b640 1 --2- 172.21.15.39:0/478927006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbae40cdad0 0x7fbae40b63b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbae40722a0 tx=0x7fbacc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dfa1fe2289e7f60 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:25.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.855+0000 7fbae1d9b640 1 -- 172.21.15.39:0/478927006 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbacc037070 con 0x7fbae40cdad0 2024-05-14T14:40:25.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.855+0000 7fbae1d9b640 1 -- 172.21.15.39:0/478927006 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbacc032440 con 0x7fbae40cdad0 2024-05-14T14:40:25.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.855+0000 7fbae1d9b640 1 -- 172.21.15.39:0/478927006 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbacc032810 con 0x7fbae40cdad0 2024-05-14T14:40:25.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.855+0000 7fbae8f5e640 1 -- 172.21.15.39:0/478927006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbae40cdad0 msgr2=0x7fbae40b63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:25.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.855+0000 7fbae8f5e640 1 --2- 172.21.15.39:0/478927006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbae40cdad0 0x7fbae40b63b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbae40722a0 tx=0x7fbacc02a1a0 comp rx=0 tx=0).stop 2024-05-14T14:40:25.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.855+0000 7fbae8f5e640 1 -- 172.21.15.39:0/478927006 shutdown_connections 2024-05-14T14:40:25.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.855+0000 7fbae8f5e640 1 --2- 172.21.15.39:0/478927006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbae40cdad0 0x7fbae40b63b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:25.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.855+0000 7fbae8f5e640 1 --2- 172.21.15.39:0/478927006 >> v2:172.21.15.62:3300/0 conn(0x7fbae40cf060 0x7fbae415cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:25.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.855+0000 7fbae8f5e640 1 -- 172.21.15.39:0/478927006 >> 172.21.15.39:0/478927006 conn(0x7fbae40ce330 msgr2=0x7fbae40ce740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:25.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.855+0000 7fbae8f5e640 1 -- 172.21.15.39:0/478927006 shutdown_connections 2024-05-14T14:40:25.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.855+0000 7fbae8f5e640 1 -- 172.21.15.39:0/478927006 wait complete. 2024-05-14T14:40:25.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.857+0000 7fbae8f5e640 1 Processor -- start 2024-05-14T14:40:25.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.858+0000 7fbae8f5e640 1 -- start start 2024-05-14T14:40:25.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.859+0000 7fbae8f5e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbae40b68f0 0x7fbae4142b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:25.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.859+0000 7fbae8f5e640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbae40cdad0 0x7fbae414a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:25.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.859+0000 7fbae8f5e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbae40cf060 0x7fbae4153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:25.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.859+0000 7fbae8f5e640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbae415d510 con 0x7fbae40cf060 2024-05-14T14:40:25.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.859+0000 7fbae8f5e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fbae40b5f20 con 0x7fbae40b68f0 2024-05-14T14:40:25.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.859+0000 7fbae8f5e640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fbae40cdee0 con 0x7fbae40cdad0 2024-05-14T14:40:25.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.859+0000 7fbae2d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbae40cf060 0x7fbae4153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:25.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.859+0000 7fbae2d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbae40cf060 0x7fbae4153300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47558/0 (socket says 172.21.15.39:47558) 2024-05-14T14:40:25.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.859+0000 7fbae2d9d640 1 -- 172.21.15.39:0/3980711896 learned_addr learned my addr 172.21.15.39:0/3980711896 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:25.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.859+0000 7fbae259c640 1 --2- 172.21.15.39:0/3980711896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbae40b68f0 0x7fbae4142b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:25.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.859+0000 7fbad9d9b640 1 --2- 172.21.15.39:0/3980711896 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbae40cdad0 0x7fbae414a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:25.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.859+0000 7fbae2d9d640 1 -- 172.21.15.39:0/3980711896 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbae40cdad0 msgr2=0x7fbae414a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:25.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.859+0000 7fbae2d9d640 1 --2- 172.21.15.39:0/3980711896 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbae40cdad0 0x7fbae414a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:25.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.859+0000 7fbae2d9d640 1 -- 172.21.15.39:0/3980711896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbae40b68f0 msgr2=0x7fbae4142b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:25.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.859+0000 7fbae2d9d640 1 --2- 172.21.15.39:0/3980711896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbae40b68f0 0x7fbae4142b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:25.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.859+0000 7fbae2d9d640 1 -- 172.21.15.39:0/3980711896 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbae4151ca0 con 0x7fbae40cf060 2024-05-14T14:40:25.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.860+0000 7fbae2d9d640 1 --2- 172.21.15.39:0/3980711896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbae40cf060 0x7fbae4153300 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbadc00c6b0 tx=0x7fbadc00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:25.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.860+0000 7fbadb7fe640 1 -- 172.21.15.39:0/3980711896 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbadc018070 con 0x7fbae40cf060 2024-05-14T14:40:25.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.860+0000 7fbadb7fe640 1 -- 172.21.15.39:0/3980711896 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbadc004da0 con 0x7fbae40cf060 2024-05-14T14:40:25.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.860+0000 7fbae8f5e640 1 -- 172.21.15.39:0/3980711896 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbae41521a0 con 0x7fbae40cf060 2024-05-14T14:40:25.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.860+0000 7fbadb7fe640 1 -- 172.21.15.39:0/3980711896 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbadc00a880 con 0x7fbae40cf060 2024-05-14T14:40:25.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.860+0000 7fbae8f5e640 1 -- 172.21.15.39:0/3980711896 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbae4152760 con 0x7fbae40cf060 2024-05-14T14:40:25.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.861+0000 7fbae8f5e640 1 -- 172.21.15.39:0/3980711896 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbae40755e0 con 0x7fbae40cf060 2024-05-14T14:40:25.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.862+0000 7fbadb7fe640 1 -- 172.21.15.39:0/3980711896 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbadc01b070 con 0x7fbae40cf060 2024-05-14T14:40:25.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.862+0000 7fbadb7fe640 1 --2- 172.21.15.39:0/3980711896 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fbac40762d0 0x7fbac40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:25.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.862+0000 7fbadb7fe640 1 -- 172.21.15.39:0/3980711896 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fbadc096ec0 con 0x7fbae40cf060 2024-05-14T14:40:25.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.862+0000 7fbae259c640 1 --2- 172.21.15.39:0/3980711896 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fbac40762d0 0x7fbac40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:25.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.863+0000 7fbae259c640 1 --2- 172.21.15.39:0/3980711896 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fbac40762d0 0x7fbac40787e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbae409fc80 tx=0x7fbad4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:25.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:25.867+0000 7fbadb7fe640 1 -- 172.21.15.39:0/3980711896 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbadc05fe90 con 0x7fbae40cf060 2024-05-14T14:40:26.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.069+0000 7fbae8f5e640 1 -- 172.21.15.39:0/3980711896 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbae4151f30 con 0x7fbae40cf060 2024-05-14T14:40:26.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.069+0000 7fbadb7fe640 1 -- 172.21.15.39:0/3980711896 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7fbadc064190 con 0x7fbae40cf060 2024-05-14T14:40:26.053 INFO:teuthology.orchestra.run.smithi039.stderr:listed 0 entries 2024-05-14T14:40:26.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.071+0000 7fbae8f5e640 1 -- 172.21.15.39:0/3980711896 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fbac40762d0 msgr2=0x7fbac40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:26.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.071+0000 7fbae8f5e640 1 --2- 172.21.15.39:0/3980711896 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fbac40762d0 0x7fbac40787e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbae409fc80 tx=0x7fbad4009190 comp rx=0 tx=0).stop 2024-05-14T14:40:26.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.071+0000 7fbae8f5e640 1 -- 172.21.15.39:0/3980711896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbae40cf060 msgr2=0x7fbae4153300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:26.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.071+0000 7fbae8f5e640 1 --2- 172.21.15.39:0/3980711896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbae40cf060 0x7fbae4153300 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbadc00c6b0 tx=0x7fbadc00cb70 comp rx=0 tx=0).stop 2024-05-14T14:40:26.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.071+0000 7fbae8f5e640 1 -- 172.21.15.39:0/3980711896 shutdown_connections 2024-05-14T14:40:26.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.071+0000 7fbae8f5e640 1 --2- 172.21.15.39:0/3980711896 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fbac40762d0 0x7fbac40787e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:26.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.071+0000 7fbae8f5e640 1 --2- 172.21.15.39:0/3980711896 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbae40cf060 0x7fbae4153300 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:26.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.071+0000 7fbae8f5e640 1 --2- 172.21.15.39:0/3980711896 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbae40cdad0 0x7fbae414a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:26.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.072+0000 7fbae8f5e640 1 --2- 172.21.15.39:0/3980711896 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbae40b68f0 0x7fbae4142b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:26.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.072+0000 7fbae8f5e640 1 -- 172.21.15.39:0/3980711896 >> 172.21.15.39:0/3980711896 conn(0x7fbae40ce330 msgr2=0x7fbae40cf770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:26.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.072+0000 7fbae8f5e640 1 -- 172.21.15.39:0/3980711896 shutdown_connections 2024-05-14T14:40:26.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.072+0000 7fbae8f5e640 1 -- 172.21.15.39:0/3980711896 wait complete. 2024-05-14T14:40:26.067 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T14:40:26.067 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T14:40:26.083 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-14T14:40:26.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.254+0000 7f3f3de3b640 1 Processor -- start 2024-05-14T14:40:26.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.254+0000 7f3f3de3b640 1 -- start start 2024-05-14T14:40:26.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.255+0000 7f3f3de3b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3f38163e50 0x7f3f38160320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:26.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.255+0000 7f3f3de3b640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3f38161320 0x7f3f380d0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:26.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.255+0000 7f3f3de3b640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f380d13e0 con 0x7f3f380d0fd0 2024-05-14T14:40:26.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.255+0000 7f3f3de3b640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f3f38164260 con 0x7f3f38161320 2024-05-14T14:40:26.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.255+0000 7f3f3de3b640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f3f381644a0 con 0x7f3f38163e50 2024-05-14T14:40:26.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.255+0000 7f3f2effd640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3f38161320 0x7f3f380d0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:26.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.255+0000 7f3f37fff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f3f380d0fd0 0x7f3f380d47e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:37734/0 (socket says 172.21.15.39:37734) 2024-05-14T14:40:26.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.255+0000 7f3f37fff640 1 -- 172.21.15.39:0/1590424026 learned_addr learned my addr 172.21.15.39:0/1590424026 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:26.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.255+0000 7f3f377fe640 1 --2- 172.21.15.39:0/1590424026 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3f38163e50 0x7f3f38160320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:26.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.256+0000 7f3f2effd640 1 -- 172.21.15.39:0/1590424026 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3f38163e50 msgr2=0x7f3f38160320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:26.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.256+0000 7f3f2effd640 1 --2- 172.21.15.39:0/1590424026 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3f38163e50 0x7f3f38160320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:26.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.256+0000 7f3f2effd640 1 -- 172.21.15.39:0/1590424026 >> v1:172.21.15.39:6789/0 conn(0x7f3f380d0fd0 legacy=0x7f3f380d47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:26.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.256+0000 7f3f2effd640 1 -- 172.21.15.39:0/1590424026 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f38164780 con 0x7f3f38161320 2024-05-14T14:40:26.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.256+0000 7f3f36ffd640 1 -- 172.21.15.39:0/1590424026 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2630049952 0 0) 0x7f3f30001490 con 0x7f3f380d0fd0 2024-05-14T14:40:26.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.256+0000 7f3f2effd640 1 --2- 172.21.15.39:0/1590424026 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f38161320 0x7f3f380d0a90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3f200097a0 tx=0x7f3f2002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d205d6d1b2b80b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:26.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.257+0000 7f3f36ffd640 1 -- 172.21.15.39:0/1590424026 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f20037070 con 0x7f3f38161320 2024-05-14T14:40:26.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.257+0000 7f3f36ffd640 1 -- 172.21.15.39:0/1590424026 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f2002ae50 con 0x7f3f38161320 2024-05-14T14:40:26.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.257+0000 7f3f36ffd640 1 -- 172.21.15.39:0/1590424026 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f20032660 con 0x7f3f38161320 2024-05-14T14:40:26.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.257+0000 7f3f3de3b640 1 -- 172.21.15.39:0/1590424026 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f38161320 msgr2=0x7f3f380d0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:26.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.257+0000 7f3f3de3b640 1 --2- 172.21.15.39:0/1590424026 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f38161320 0x7f3f380d0a90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3f200097a0 tx=0x7f3f2002a100 comp rx=0 tx=0).stop 2024-05-14T14:40:26.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.257+0000 7f3f3de3b640 1 -- 172.21.15.39:0/1590424026 shutdown_connections 2024-05-14T14:40:26.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.257+0000 7f3f3de3b640 1 --2- 172.21.15.39:0/1590424026 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f38161320 0x7f3f380d0a90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:26.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.257+0000 7f3f3de3b640 1 --2- 172.21.15.39:0/1590424026 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3f38163e50 0x7f3f38160320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:26.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.257+0000 7f3f3de3b640 1 -- 172.21.15.39:0/1590424026 >> 172.21.15.39:0/1590424026 conn(0x7f3f380b77d0 msgr2=0x7f3f380b7be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:26.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.257+0000 7f3f3de3b640 1 -- 172.21.15.39:0/1590424026 shutdown_connections 2024-05-14T14:40:26.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.258+0000 7f3f3de3b640 1 -- 172.21.15.39:0/1590424026 wait complete. 2024-05-14T14:40:26.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.259+0000 7f3f3de3b640 1 Processor -- start 2024-05-14T14:40:26.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.259+0000 7f3f3de3b640 1 -- start start 2024-05-14T14:40:26.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.261+0000 7f3f3de3b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3f380d0fd0 0x7f3f381ebf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:26.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.261+0000 7f3f3de3b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f38161320 0x7f3f381485d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:26.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.261+0000 7f3f3de3b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f38163e50 0x7f3f38148b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:26.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.261+0000 7f3f3de3b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3f38161730 con 0x7f3f38163e50 2024-05-14T14:40:26.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.261+0000 7f3f3de3b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3f38164d40 con 0x7f3f38161320 2024-05-14T14:40:26.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.261+0000 7f3f3de3b640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f3f3806dc30 con 0x7f3f380d0fd0 2024-05-14T14:40:26.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.261+0000 7f3f37fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f38163e50 0x7f3f38148b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:26.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.261+0000 7f3f37fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f38163e50 0x7f3f38148b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47584/0 (socket says 172.21.15.39:47584) 2024-05-14T14:40:26.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.261+0000 7f3f37fff640 1 -- 172.21.15.39:0/3393937967 learned_addr learned my addr 172.21.15.39:0/3393937967 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:26.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.261+0000 7f3f377fe640 1 --2- 172.21.15.39:0/3393937967 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3f380d0fd0 0x7f3f381ebf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:26.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.261+0000 7f3f2effd640 1 --2- 172.21.15.39:0/3393937967 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f38161320 0x7f3f381485d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:26.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.261+0000 7f3f37fff640 1 -- 172.21.15.39:0/3393937967 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3f380d0fd0 msgr2=0x7f3f381ebf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:26.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.261+0000 7f3f37fff640 1 --2- 172.21.15.39:0/3393937967 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3f380d0fd0 0x7f3f381ebf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:26.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.261+0000 7f3f37fff640 1 -- 172.21.15.39:0/3393937967 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f38161320 msgr2=0x7f3f381485d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:26.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.261+0000 7f3f37fff640 1 --2- 172.21.15.39:0/3393937967 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f38161320 0x7f3f381485d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:26.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.261+0000 7f3f37fff640 1 -- 172.21.15.39:0/3393937967 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f381493a0 con 0x7f3f38163e50 2024-05-14T14:40:26.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.261+0000 7f3f377fe640 1 --2- 172.21.15.39:0/3393937967 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3f380d0fd0 0x7f3f381ebf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:40:26.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.261+0000 7f3f2effd640 1 --2- 172.21.15.39:0/3393937967 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f38161320 0x7f3f381485d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:40:26.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.261+0000 7f3f37fff640 1 --2- 172.21.15.39:0/3393937967 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f38163e50 0x7f3f38148b10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3f3000c6b0 tx=0x7f3f3000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:26.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.262+0000 7f3f34ff9640 1 -- 172.21.15.39:0/3393937967 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f30018070 con 0x7f3f38163e50 2024-05-14T14:40:26.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.262+0000 7f3f34ff9640 1 -- 172.21.15.39:0/3393937967 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f30004d80 con 0x7f3f38163e50 2024-05-14T14:40:26.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.262+0000 7f3f3de3b640 1 -- 172.21.15.39:0/3393937967 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f38149680 con 0x7f3f38163e50 2024-05-14T14:40:26.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.262+0000 7f3f34ff9640 1 -- 172.21.15.39:0/3393937967 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f3000a880 con 0x7f3f38163e50 2024-05-14T14:40:26.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.262+0000 7f3f3de3b640 1 -- 172.21.15.39:0/3393937967 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f38149c40 con 0x7f3f38163e50 2024-05-14T14:40:26.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.263+0000 7f3f3de3b640 1 -- 172.21.15.39:0/3393937967 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f38076aa0 con 0x7f3f38163e50 2024-05-14T14:40:26.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.263+0000 7f3f34ff9640 1 -- 172.21.15.39:0/3393937967 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3f3001b070 con 0x7f3f38163e50 2024-05-14T14:40:26.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.264+0000 7f3f34ff9640 1 --2- 172.21.15.39:0/3393937967 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f3f180762d0 0x7f3f180787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:26.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.264+0000 7f3f34ff9640 1 -- 172.21.15.39:0/3393937967 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3f30096ee0 con 0x7f3f38163e50 2024-05-14T14:40:26.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.264+0000 7f3f377fe640 1 --2- 172.21.15.39:0/3393937967 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f3f180762d0 0x7f3f180787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:26.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.264+0000 7f3f377fe640 1 --2- 172.21.15.39:0/3393937967 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f3f180762d0 0x7f3f180787e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3f380b8fc0 tx=0x7f3f28008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:26.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.269+0000 7f3f34ff9640 1 -- 172.21.15.39:0/3393937967 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3f380d13e0 con 0x7f3f38163e50 2024-05-14T14:40:26.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.471+0000 7f3f3de3b640 1 -- 172.21.15.39:0/3393937967 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3f3815eef0 con 0x7f3f38163e50 2024-05-14T14:40:26.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.472+0000 7f3f34ff9640 1 -- 172.21.15.39:0/3393937967 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f3f30060470 con 0x7f3f38163e50 2024-05-14T14:40:26.456 INFO:teuthology.orchestra.run.smithi039.stderr:listed 0 entries 2024-05-14T14:40:26.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.474+0000 7f3f3de3b640 1 -- 172.21.15.39:0/3393937967 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f3f180762d0 msgr2=0x7f3f180787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:26.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.474+0000 7f3f3de3b640 1 --2- 172.21.15.39:0/3393937967 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f3f180762d0 0x7f3f180787e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3f380b8fc0 tx=0x7f3f28008040 comp rx=0 tx=0).stop 2024-05-14T14:40:26.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.474+0000 7f3f3de3b640 1 -- 172.21.15.39:0/3393937967 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f38163e50 msgr2=0x7f3f38148b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:26.458 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.474+0000 7f3f3de3b640 1 --2- 172.21.15.39:0/3393937967 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f38163e50 0x7f3f38148b10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3f3000c6b0 tx=0x7f3f3000cb70 comp rx=0 tx=0).stop 2024-05-14T14:40:26.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.474+0000 7f3f3de3b640 1 -- 172.21.15.39:0/3393937967 shutdown_connections 2024-05-14T14:40:26.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.474+0000 7f3f3de3b640 1 --2- 172.21.15.39:0/3393937967 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f3f180762d0 0x7f3f180787e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:26.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.474+0000 7f3f3de3b640 1 --2- 172.21.15.39:0/3393937967 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3f38163e50 0x7f3f38148b10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:26.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.474+0000 7f3f3de3b640 1 --2- 172.21.15.39:0/3393937967 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f38161320 0x7f3f381485d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:26.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.474+0000 7f3f3de3b640 1 --2- 172.21.15.39:0/3393937967 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3f380d0fd0 0x7f3f381ebf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:26.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.474+0000 7f3f3de3b640 1 -- 172.21.15.39:0/3393937967 >> 172.21.15.39:0/3393937967 conn(0x7f3f380b77d0 msgr2=0x7f3f381618b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:26.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.474+0000 7f3f3de3b640 1 -- 172.21.15.39:0/3393937967 shutdown_connections 2024-05-14T14:40:26.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.474+0000 7f3f3de3b640 1 -- 172.21.15.39:0/3393937967 wait complete. 2024-05-14T14:40:26.469 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi039.front.sepia.ceph.com... 2024-05-14T14:40:26.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:26.470 DEBUG:teuthology.orchestra.run.smithi039:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-05-14T14:40:26.495 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi039.stderr:ceph-fuse[44569]: fuse finished with error 0 and tester_r 0 2024-05-14T14:40:26.497 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T14:40:26.530 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi039.front.sepia.ceph.com 2024-05-14T14:40:26.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:26.531 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-05-14T14:40:26.594 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T14:40:26.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.765+0000 7f0cd04b6640 1 Processor -- start 2024-05-14T14:40:26.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.765+0000 7f0cd04b6640 1 -- start start 2024-05-14T14:40:26.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.766+0000 7f0cd04b6640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0cc815e030 0x7f0cc80b6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:26.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.766+0000 7f0cd04b6640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0cc80d0200 0x7f0cc80d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:26.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.766+0000 7f0cd04b6640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cc80b7420 con 0x7f0cc80ce590 2024-05-14T14:40:26.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.766+0000 7f0cd04b6640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f0cc80d2490 con 0x7f0cc80d0200 2024-05-14T14:40:26.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.766+0000 7f0cd04b6640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f0cc80d2770 con 0x7f0cc815e030 2024-05-14T14:40:26.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.766+0000 7f0ccea53640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0cc80d0200 0x7f0cc80d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:26.751 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.766+0000 7f0cce252640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f0cc80ce590 0x7f0cc8161c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:37740/0 (socket says 172.21.15.39:37740) 2024-05-14T14:40:26.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.766+0000 7f0cce252640 1 -- 172.21.15.39:0/4242961368 learned_addr learned my addr 172.21.15.39:0/4242961368 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:26.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.767+0000 7f0ccda51640 1 --2- 172.21.15.39:0/4242961368 >> v2:172.21.15.62:3300/0 conn(0x7f0cc815e030 0x7f0cc80b6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:26.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.767+0000 7f0ccea53640 1 -- 172.21.15.39:0/4242961368 >> v2:172.21.15.62:3300/0 conn(0x7f0cc815e030 msgr2=0x7f0cc80b6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:26.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.767+0000 7f0ccea53640 1 --2- 172.21.15.39:0/4242961368 >> v2:172.21.15.62:3300/0 conn(0x7f0cc815e030 0x7f0cc80b6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:26.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.767+0000 7f0ccea53640 1 -- 172.21.15.39:0/4242961368 >> v1:172.21.15.39:6789/0 conn(0x7f0cc80ce590 legacy=0x7f0cc8161c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:26.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.767+0000 7f0ccea53640 1 -- 172.21.15.39:0/4242961368 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc8162400 con 0x7f0cc80d0200 2024-05-14T14:40:26.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.767+0000 7f0ccd250640 1 -- 172.21.15.39:0/4242961368 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2257787847 0 0) 0x7f0cc80b7420 con 0x7f0cc80ce590 2024-05-14T14:40:26.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.768+0000 7f0ccea53640 1 --2- 172.21.15.39:0/4242961368 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0cc80d0200 0x7f0cc80d0610 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0cc80d0150 tx=0x7f0cc002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b1040242387a2a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:26.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.768+0000 7f0ccd250640 1 -- 172.21.15.39:0/4242961368 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc0037070 con 0x7f0cc80d0200 2024-05-14T14:40:26.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.768+0000 7f0ccd250640 1 -- 172.21.15.39:0/4242961368 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cc0032440 con 0x7f0cc80d0200 2024-05-14T14:40:26.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.768+0000 7f0ccd250640 1 -- 172.21.15.39:0/4242961368 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc002ae60 con 0x7f0cc80d0200 2024-05-14T14:40:26.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.768+0000 7f0cd04b6640 1 -- 172.21.15.39:0/4242961368 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0cc80d0200 msgr2=0x7f0cc80d0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:26.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.768+0000 7f0cd04b6640 1 --2- 172.21.15.39:0/4242961368 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0cc80d0200 0x7f0cc80d0610 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0cc80d0150 tx=0x7f0cc002a110 comp rx=0 tx=0).stop 2024-05-14T14:40:26.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.768+0000 7f0cd04b6640 1 -- 172.21.15.39:0/4242961368 shutdown_connections 2024-05-14T14:40:26.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.768+0000 7f0cd04b6640 1 --2- 172.21.15.39:0/4242961368 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0cc80d0200 0x7f0cc80d0610 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:26.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.768+0000 7f0cd04b6640 1 --2- 172.21.15.39:0/4242961368 >> v2:172.21.15.62:3300/0 conn(0x7f0cc815e030 0x7f0cc80b6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:26.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.768+0000 7f0cd04b6640 1 -- 172.21.15.39:0/4242961368 >> 172.21.15.39:0/4242961368 conn(0x7f0cc8071660 msgr2=0x7f0cc8071a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:26.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.769+0000 7f0cd04b6640 1 -- 172.21.15.39:0/4242961368 shutdown_connections 2024-05-14T14:40:26.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.769+0000 7f0cd04b6640 1 -- 172.21.15.39:0/4242961368 wait complete. 2024-05-14T14:40:26.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.770+0000 7f0cd04b6640 1 Processor -- start 2024-05-14T14:40:26.755 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.770+0000 7f0cd04b6640 1 -- start start 2024-05-14T14:40:26.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.772+0000 7f0cd04b6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0cc80ce590 0x7f0cc80cd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:26.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.772+0000 7f0cd04b6640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0cc80d0200 0x7f0cc81e99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:26.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.772+0000 7f0cd04b6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0cc815e030 0x7f0cc81e9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:26.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.772+0000 7f0cd04b6640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc80d0b50 con 0x7f0cc815e030 2024-05-14T14:40:26.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.772+0000 7f0cd04b6640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc81629c0 con 0x7f0cc80ce590 2024-05-14T14:40:26.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.772+0000 7f0cd04b6640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f0cc815e440 con 0x7f0cc80d0200 2024-05-14T14:40:26.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.772+0000 7f0ccea53640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0cc815e030 0x7f0cc81e9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:26.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.772+0000 7f0ccea53640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0cc815e030 0x7f0cc81e9f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47610/0 (socket says 172.21.15.39:47610) 2024-05-14T14:40:26.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.772+0000 7f0ccea53640 1 -- 172.21.15.39:0/942817886 learned_addr learned my addr 172.21.15.39:0/942817886 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:26.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.772+0000 7f0cce252640 1 --2- 172.21.15.39:0/942817886 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0cc80ce590 0x7f0cc80cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:26.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.772+0000 7f0ccda51640 1 --2- 172.21.15.39:0/942817886 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0cc80d0200 0x7f0cc81e99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:26.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.772+0000 7f0ccea53640 1 -- 172.21.15.39:0/942817886 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0cc80d0200 msgr2=0x7f0cc81e99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:26.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.772+0000 7f0ccea53640 1 --2- 172.21.15.39:0/942817886 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0cc80d0200 0x7f0cc81e99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:26.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.772+0000 7f0ccea53640 1 -- 172.21.15.39:0/942817886 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0cc80ce590 msgr2=0x7f0cc80cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:26.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.772+0000 7f0ccea53640 1 --2- 172.21.15.39:0/942817886 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0cc80ce590 0x7f0cc80cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:26.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.772+0000 7f0ccea53640 1 -- 172.21.15.39:0/942817886 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc80afbe0 con 0x7f0cc815e030 2024-05-14T14:40:26.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.772+0000 7f0ccea53640 1 --2- 172.21.15.39:0/942817886 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0cc815e030 0x7f0cc81e9f20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0035040 tx=0x7f0cc00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:26.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.773+0000 7f0cc6ffd640 1 -- 172.21.15.39:0/942817886 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc0037050 con 0x7f0cc815e030 2024-05-14T14:40:26.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.773+0000 7f0cc6ffd640 1 -- 172.21.15.39:0/942817886 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cc0038040 con 0x7f0cc815e030 2024-05-14T14:40:26.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.773+0000 7f0cd04b6640 1 -- 172.21.15.39:0/942817886 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cc80ab660 con 0x7f0cc815e030 2024-05-14T14:40:26.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.773+0000 7f0cc6ffd640 1 -- 172.21.15.39:0/942817886 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cc0004490 con 0x7f0cc815e030 2024-05-14T14:40:26.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.773+0000 7f0cd04b6640 1 -- 172.21.15.39:0/942817886 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cc80abc20 con 0x7f0cc815e030 2024-05-14T14:40:26.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.774+0000 7f0cd04b6640 1 -- 172.21.15.39:0/942817886 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cc80afdb0 con 0x7f0cc815e030 2024-05-14T14:40:26.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.775+0000 7f0cc6ffd640 1 -- 172.21.15.39:0/942817886 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0cc0030980 con 0x7f0cc815e030 2024-05-14T14:40:26.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.775+0000 7f0cc6ffd640 1 --2- 172.21.15.39:0/942817886 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0cb4076300 0x7f0cb4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:26.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.775+0000 7f0cc6ffd640 1 -- 172.21.15.39:0/942817886 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0cc00b83a0 con 0x7f0cc815e030 2024-05-14T14:40:26.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.775+0000 7f0cce252640 1 --2- 172.21.15.39:0/942817886 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0cb4076300 0x7f0cb4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:26.761 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.776+0000 7f0cce252640 1 --2- 172.21.15.39:0/942817886 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0cb4076300 0x7f0cb4078810 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0cb80012e0 tx=0x7f0cb8001630 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:26.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.780+0000 7f0cc6ffd640 1 -- 172.21.15.39:0/942817886 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0cc0032e20 con 0x7f0cc815e030 2024-05-14T14:40:26.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.976+0000 7f0cd04b6640 1 -- 172.21.15.39:0/942817886 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0cc8076aa0 con 0x7f0cc815e030 2024-05-14T14:40:26.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.977+0000 7f0cc6ffd640 1 -- 172.21.15.39:0/942817886 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18454 (secure 0 0 0) 0x7f0cc00812e0 con 0x7f0cc815e030 2024-05-14T14:40:26.961 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:40:26.961 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"fsid":"d7983fec-79c7-4991-b19c-1aecead64611","created":"2024-05-14T14:39:52.157167+0000","modified":"2024-05-14T14:40:20.397684+0000","last_up_change":"2024-05-14T14:40:03.848608+0000","last_in_change":"2024-05-14T14:39:54.591920+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T14:40:04.692846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T14:40:13.794415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T14:40:14.273154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T14:40:17.979457+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c4ec4534-6301-4dd7-b4d6-d560b096d442","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6801","nonce":4023478848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6803","nonce":4023478848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6807","nonce":4023478848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6805","nonce":4023478848}]},"public_addr":"172.21.15.39:6801/4023478848","cluster_addr":"172.21.15.39:6803/4023478848","heartbeat_back_addr":"172.21.15.39:6807/4023478848","heartbeat_front_addr":"172.21.15.39:6805/4023478848","state":["exists","up"]},{"osd":1,"uuid":"93f91b0e-096e-4bdf-aed0-d1136f73f136","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6817","nonce":926357398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6819","nonce":926357398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6823","nonce":926357398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6821","nonce":926357398}]},"public_addr":"172.21.15.39:6817/926357398","cluster_addr":"172.21.15.39:6819/926357398","heartbeat_back_addr":"172.21.15.39:6823/926357398","heartbeat_front_addr":"172.21.15.39:6821/926357398","state":["exists","up"]},{"osd":2,"uuid":"c590b1e0-67eb-452e-8e80-d2208da17d09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6809","nonce":610616754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6811","nonce":610616754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6815","nonce":610616754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6813","nonce":610616754}]},"public_addr":"172.21.15.39:6809/610616754","cluster_addr":"172.21.15.39:6811/610616754","heartbeat_back_addr":"172.21.15.39:6815/610616754","heartbeat_front_addr":"172.21.15.39:6813/610616754","state":["exists","up"]},{"osd":3,"uuid":"d57661b0-44f6-4355-9115-83eceb9b8f71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6825","nonce":1469314579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6827","nonce":1469314579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6831","nonce":1469314579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6829","nonce":1469314579}]},"public_addr":"172.21.15.39:6825/1469314579","cluster_addr":"172.21.15.39:6827/1469314579","heartbeat_back_addr":"172.21.15.39:6831/1469314579","heartbeat_front_addr":"172.21.15.39:6829/1469314579","state":["exists","up"]},{"osd":4,"uuid":"b131436f-f6e1-4d72-a86e-de200afdcebb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6825","nonce":3481507129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6827","nonce":3481507129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6831","nonce":3481507129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6829","nonce":3481507129}]},"public_addr":"172.21.15.62:6825/3481507129","cluster_addr":"172.21.15.62:6827/3481507129","heartbeat_back_addr":"172.21.15.62:6831/3481507129","heartbeat_front_addr":"172.21.15.62:6829/3481507129","state":["exists","up"]},{"osd":5,"uuid":"12e10b40-28b1-410f-9ce0-7b427daa111e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6801","nonce":3291934116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6803","nonce":3291934116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6807","nonce":3291934116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6805","nonce":3291934116}]},"public_addr":"172.21.15.62:6801/3291934116","cluster_addr":"172.21.15.62:6803/3291934116","heartbeat_back_addr":"172.21.15.62:6807/3291934116","heartbeat_front_addr":"172.21.15.62:6805/3291934116","state":["exists","up"]},{"osd":6,"uuid":"ad8950a5-70bd-488c-8f29-010515cc4a04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6817","nonce":3005996101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6819","nonce":3005996101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6823","nonce":3005996101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6821","nonce":3005996101}]},"public_addr":"172.21.15.62:6817/3005996101","cluster_addr":"172.21.15.62:6819/3005996101","heartbeat_back_addr":"172.21.15.62:6823/3005996101","heartbeat_front_addr":"172.21.15.62:6821/3005996101","state":["exists","up"]},{"osd":7,"uuid":"e0d4b8b7-3c80-4760-a342-1d508cdecc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6809","nonce":2800379225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6811","nonce":2800379225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6815","nonce":2800379225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6813","nonce":2800379225}]},"public_addr":"172.21.15.62:6809/2800379225","cluster_addr":"172.21.15.62:6811/2800379225","heartbeat_back_addr":"172.21.15.62:6815/2800379225","heartbeat_front_addr":"172.21.15.62:6813/2800379225","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.773714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.760037+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.811225+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.752810+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.745165+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.700634+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.768477+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.747301+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T14:40:26.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.979+0000 7f0cd04b6640 1 -- 172.21.15.39:0/942817886 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0cb4076300 msgr2=0x7f0cb4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:26.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.979+0000 7f0cd04b6640 1 --2- 172.21.15.39:0/942817886 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0cb4076300 0x7f0cb4078810 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0cb80012e0 tx=0x7f0cb8001630 comp rx=0 tx=0).stop 2024-05-14T14:40:26.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.979+0000 7f0cd04b6640 1 -- 172.21.15.39:0/942817886 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0cc815e030 msgr2=0x7f0cc81e9f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:26.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.979+0000 7f0cd04b6640 1 --2- 172.21.15.39:0/942817886 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0cc815e030 0x7f0cc81e9f20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0035040 tx=0x7f0cc00046c0 comp rx=0 tx=0).stop 2024-05-14T14:40:26.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.979+0000 7f0cd04b6640 1 -- 172.21.15.39:0/942817886 shutdown_connections 2024-05-14T14:40:26.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.979+0000 7f0cd04b6640 1 --2- 172.21.15.39:0/942817886 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0cb4076300 0x7f0cb4078810 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:26.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.979+0000 7f0cd04b6640 1 --2- 172.21.15.39:0/942817886 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0cc815e030 0x7f0cc81e9f20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:26.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.979+0000 7f0cd04b6640 1 --2- 172.21.15.39:0/942817886 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0cc80d0200 0x7f0cc81e99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:26.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.979+0000 7f0cd04b6640 1 --2- 172.21.15.39:0/942817886 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0cc80ce590 0x7f0cc80cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:26.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.979+0000 7f0cd04b6640 1 -- 172.21.15.39:0/942817886 >> 172.21.15.39:0/942817886 conn(0x7f0cc8071660 msgr2=0x7f0cc815c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:26.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.980+0000 7f0cd04b6640 1 -- 172.21.15.39:0/942817886 shutdown_connections 2024-05-14T14:40:26.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:26.980+0000 7f0cd04b6640 1 -- 172.21.15.39:0/942817886 wait complete. 2024-05-14T14:40:26.975 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T14:40:27.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.106+0000 7fbe6424c640 1 Processor -- start 2024-05-14T14:40:27.091 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.107+0000 7fbe6424c640 1 -- start start 2024-05-14T14:40:27.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.108+0000 7fbe6424c640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbe5c164c60 0x7fbe5c1638e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:27.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.108+0000 7fbe6424c640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe5c0b6db0 con 0x7fbe5c0736e0 2024-05-14T14:40:27.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.108+0000 7fbe6424c640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe5c0b6ad0 con 0x7fbe5c0b30b0 2024-05-14T14:40:27.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.108+0000 7fbe6424c640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fbe5c164180 con 0x7fbe5c164c60 2024-05-14T14:40:27.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.108+0000 7fbe61fe8640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fbe5c164c60 0x7fbe5c1638e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:27.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.108+0000 7fbe627e9640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fbe5c0736e0 0x7fbe5c0ce130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:37754/0 (socket says 172.21.15.39:37754) 2024-05-14T14:40:27.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.108+0000 7fbe627e9640 1 -- 172.21.15.39:0/2393388607 learned_addr learned my addr 172.21.15.39:0/2393388607 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:27.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.109+0000 7fbe61fe8640 1 -- 172.21.15.39:0/2393388607 >> v1:172.21.15.62:6789/0 conn(0x7fbe5c0b30b0 legacy=0x7fbe5c072fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:27.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.109+0000 7fbe61fe8640 1 -- 172.21.15.39:0/2393388607 >> v1:172.21.15.39:6789/0 conn(0x7fbe5c0736e0 legacy=0x7fbe5c0ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:27.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.109+0000 7fbe61fe8640 1 -- 172.21.15.39:0/2393388607 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe5c164460 con 0x7fbe5c164c60 2024-05-14T14:40:27.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.109+0000 7fbe60fe6640 1 -- 172.21.15.39:0/2393388607 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2590821867 0 0) 0x7fbe54001110 con 0x7fbe5c0736e0 2024-05-14T14:40:27.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.109+0000 7fbe61fe8640 1 --2- 172.21.15.39:0/2393388607 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe5c164c60 0x7fbe5c1638e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbe58009d90 tx=0x7fbe5802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c34fa6e03787572 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:27.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.110+0000 7fbe60fe6640 1 -- 172.21.15.39:0/2393388607 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe58007740 con 0x7fbe5c164c60 2024-05-14T14:40:27.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.110+0000 7fbe60fe6640 1 -- 172.21.15.39:0/2393388607 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe580078e0 con 0x7fbe5c164c60 2024-05-14T14:40:27.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.110+0000 7fbe60fe6640 1 -- 172.21.15.39:0/2393388607 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe58007cb0 con 0x7fbe5c164c60 2024-05-14T14:40:27.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.110+0000 7fbe6424c640 1 -- 172.21.15.39:0/2393388607 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe5c164c60 msgr2=0x7fbe5c1638e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:27.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.110+0000 7fbe6424c640 1 --2- 172.21.15.39:0/2393388607 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe5c164c60 0x7fbe5c1638e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbe58009d90 tx=0x7fbe5802a6f0 comp rx=0 tx=0).stop 2024-05-14T14:40:27.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.110+0000 7fbe6424c640 1 -- 172.21.15.39:0/2393388607 shutdown_connections 2024-05-14T14:40:27.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.110+0000 7fbe6424c640 1 --2- 172.21.15.39:0/2393388607 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe5c164c60 0x7fbe5c1638e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:27.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.110+0000 7fbe6424c640 1 -- 172.21.15.39:0/2393388607 >> 172.21.15.39:0/2393388607 conn(0x7fbe5c0d3ae0 msgr2=0x7fbe5c0d3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:27.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.110+0000 7fbe6424c640 1 -- 172.21.15.39:0/2393388607 shutdown_connections 2024-05-14T14:40:27.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.110+0000 7fbe6424c640 1 -- 172.21.15.39:0/2393388607 wait complete. 2024-05-14T14:40:27.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.112+0000 7fbe6424c640 1 Processor -- start 2024-05-14T14:40:27.096 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.112+0000 7fbe6424c640 1 -- start start 2024-05-14T14:40:27.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.114+0000 7fbe6424c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe5c0b30b0 0x7fbe5c153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:27.099 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.114+0000 7fbe6424c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe5c0b1c90 0x7fbe5c1f9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:27.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.114+0000 7fbe6424c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbe5c0b20a0 0x7fbe5c1fa200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:27.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.114+0000 7fbe6424c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fbe5c0cf600 con 0x7fbe5c0b1c90 2024-05-14T14:40:27.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.114+0000 7fbe6424c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fbe5c0cf480 con 0x7fbe5c0b30b0 2024-05-14T14:40:27.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.114+0000 7fbe6424c640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fbe5c0cf780 con 0x7fbe5c0b20a0 2024-05-14T14:40:27.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.114+0000 7fbe617e7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe5c0b1c90 0x7fbe5c1f9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:27.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.114+0000 7fbe617e7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe5c0b1c90 0x7fbe5c1f9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47628/0 (socket says 172.21.15.39:47628) 2024-05-14T14:40:27.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.114+0000 7fbe617e7640 1 -- 172.21.15.39:0/2887743533 learned_addr learned my addr 172.21.15.39:0/2887743533 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:27.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.114+0000 7fbe61fe8640 1 --2- 172.21.15.39:0/2887743533 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe5c0b30b0 0x7fbe5c153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:27.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.114+0000 7fbe627e9640 1 --2- 172.21.15.39:0/2887743533 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbe5c0b20a0 0x7fbe5c1fa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:27.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.114+0000 7fbe617e7640 1 -- 172.21.15.39:0/2887743533 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbe5c0b20a0 msgr2=0x7fbe5c1fa200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:27.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.114+0000 7fbe617e7640 1 --2- 172.21.15.39:0/2887743533 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbe5c0b20a0 0x7fbe5c1fa200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:27.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.114+0000 7fbe617e7640 1 -- 172.21.15.39:0/2887743533 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe5c0b30b0 msgr2=0x7fbe5c153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:27.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.114+0000 7fbe617e7640 1 --2- 172.21.15.39:0/2887743533 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe5c0b30b0 0x7fbe5c153070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:27.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.114+0000 7fbe617e7640 1 -- 172.21.15.39:0/2887743533 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe5c0b2960 con 0x7fbe5c0b1c90 2024-05-14T14:40:27.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.114+0000 7fbe617e7640 1 --2- 172.21.15.39:0/2887743533 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe5c0b1c90 0x7fbe5c1f9cc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c00c400 tx=0x7fbe4c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:27.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.115+0000 7fbe527fc640 1 -- 172.21.15.39:0/2887743533 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c017070 con 0x7fbe5c0b1c90 2024-05-14T14:40:27.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.115+0000 7fbe527fc640 1 -- 172.21.15.39:0/2887743533 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe4c0052d0 con 0x7fbe5c0b1c90 2024-05-14T14:40:27.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.115+0000 7fbe527fc640 1 -- 172.21.15.39:0/2887743533 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c0037f0 con 0x7fbe5c0b1c90 2024-05-14T14:40:27.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.115+0000 7fbe6424c640 1 -- 172.21.15.39:0/2887743533 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe5c0b0930 con 0x7fbe5c0b1c90 2024-05-14T14:40:27.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.115+0000 7fbe6424c640 1 -- 172.21.15.39:0/2887743533 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe5c0c97b0 con 0x7fbe5c0b1c90 2024-05-14T14:40:27.101 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.116+0000 7fbe6424c640 1 -- 172.21.15.39:0/2887743533 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe5c076aa0 con 0x7fbe5c0b1c90 2024-05-14T14:40:27.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.116+0000 7fbe527fc640 1 -- 172.21.15.39:0/2887743533 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fbe4c01a070 con 0x7fbe5c0b1c90 2024-05-14T14:40:27.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.117+0000 7fbe527fc640 1 --2- 172.21.15.39:0/2887743533 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fbe400762d0 0x7fbe400787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:27.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.117+0000 7fbe61fe8640 1 --2- 172.21.15.39:0/2887743533 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fbe400762d0 0x7fbe400787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:27.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.117+0000 7fbe527fc640 1 -- 172.21.15.39:0/2887743533 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fbe4c096c50 con 0x7fbe5c0b1c90 2024-05-14T14:40:27.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.117+0000 7fbe61fe8640 1 --2- 172.21.15.39:0/2887743533 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fbe400762d0 0x7fbe400787e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbe58034000 tx=0x7fbe5802f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:27.106 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.122+0000 7fbe527fc640 1 -- 172.21.15.39:0/2887743533 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fbe4c09c020 con 0x7fbe5c0b1c90 2024-05-14T14:40:27.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.315+0000 7fbe6424c640 1 -- 172.21.15.39:0/2887743533 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbe5c0c9980 con 0x7fbe5c0b1c90 2024-05-14T14:40:27.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.317+0000 7fbe527fc640 1 -- 172.21.15.39:0/2887743533 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18454 (secure 0 0 0) 0x7fbe4c068260 con 0x7fbe5c0b1c90 2024-05-14T14:40:27.301 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:40:27.301 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"fsid":"d7983fec-79c7-4991-b19c-1aecead64611","created":"2024-05-14T14:39:52.157167+0000","modified":"2024-05-14T14:40:20.397684+0000","last_up_change":"2024-05-14T14:40:03.848608+0000","last_in_change":"2024-05-14T14:39:54.591920+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T14:40:04.692846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T14:40:13.794415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T14:40:14.273154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T14:40:17.979457+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c4ec4534-6301-4dd7-b4d6-d560b096d442","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6801","nonce":4023478848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6803","nonce":4023478848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6807","nonce":4023478848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6805","nonce":4023478848}]},"public_addr":"172.21.15.39:6801/4023478848","cluster_addr":"172.21.15.39:6803/4023478848","heartbeat_back_addr":"172.21.15.39:6807/4023478848","heartbeat_front_addr":"172.21.15.39:6805/4023478848","state":["exists","up"]},{"osd":1,"uuid":"93f91b0e-096e-4bdf-aed0-d1136f73f136","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6817","nonce":926357398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6819","nonce":926357398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6823","nonce":926357398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6821","nonce":926357398}]},"public_addr":"172.21.15.39:6817/926357398","cluster_addr":"172.21.15.39:6819/926357398","heartbeat_back_addr":"172.21.15.39:6823/926357398","heartbeat_front_addr":"172.21.15.39:6821/926357398","state":["exists","up"]},{"osd":2,"uuid":"c590b1e0-67eb-452e-8e80-d2208da17d09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6809","nonce":610616754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6811","nonce":610616754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6815","nonce":610616754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6813","nonce":610616754}]},"public_addr":"172.21.15.39:6809/610616754","cluster_addr":"172.21.15.39:6811/610616754","heartbeat_back_addr":"172.21.15.39:6815/610616754","heartbeat_front_addr":"172.21.15.39:6813/610616754","state":["exists","up"]},{"osd":3,"uuid":"d57661b0-44f6-4355-9115-83eceb9b8f71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6825","nonce":1469314579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6827","nonce":1469314579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6831","nonce":1469314579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6829","nonce":1469314579}]},"public_addr":"172.21.15.39:6825/1469314579","cluster_addr":"172.21.15.39:6827/1469314579","heartbeat_back_addr":"172.21.15.39:6831/1469314579","heartbeat_front_addr":"172.21.15.39:6829/1469314579","state":["exists","up"]},{"osd":4,"uuid":"b131436f-f6e1-4d72-a86e-de200afdcebb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6825","nonce":3481507129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6827","nonce":3481507129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6831","nonce":3481507129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6829","nonce":3481507129}]},"public_addr":"172.21.15.62:6825/3481507129","cluster_addr":"172.21.15.62:6827/3481507129","heartbeat_back_addr":"172.21.15.62:6831/3481507129","heartbeat_front_addr":"172.21.15.62:6829/3481507129","state":["exists","up"]},{"osd":5,"uuid":"12e10b40-28b1-410f-9ce0-7b427daa111e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6801","nonce":3291934116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6803","nonce":3291934116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6807","nonce":3291934116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6805","nonce":3291934116}]},"public_addr":"172.21.15.62:6801/3291934116","cluster_addr":"172.21.15.62:6803/3291934116","heartbeat_back_addr":"172.21.15.62:6807/3291934116","heartbeat_front_addr":"172.21.15.62:6805/3291934116","state":["exists","up"]},{"osd":6,"uuid":"ad8950a5-70bd-488c-8f29-010515cc4a04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6817","nonce":3005996101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6819","nonce":3005996101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6823","nonce":3005996101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6821","nonce":3005996101}]},"public_addr":"172.21.15.62:6817/3005996101","cluster_addr":"172.21.15.62:6819/3005996101","heartbeat_back_addr":"172.21.15.62:6823/3005996101","heartbeat_front_addr":"172.21.15.62:6821/3005996101","state":["exists","up"]},{"osd":7,"uuid":"e0d4b8b7-3c80-4760-a342-1d508cdecc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6809","nonce":2800379225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6811","nonce":2800379225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6815","nonce":2800379225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6813","nonce":2800379225}]},"public_addr":"172.21.15.62:6809/2800379225","cluster_addr":"172.21.15.62:6811/2800379225","heartbeat_back_addr":"172.21.15.62:6815/2800379225","heartbeat_front_addr":"172.21.15.62:6813/2800379225","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.773714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.760037+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.811225+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.752810+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.745165+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.700634+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.768477+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.747301+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T14:40:27.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.319+0000 7fbe6424c640 1 -- 172.21.15.39:0/2887743533 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fbe400762d0 msgr2=0x7fbe400787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:27.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.319+0000 7fbe6424c640 1 --2- 172.21.15.39:0/2887743533 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fbe400762d0 0x7fbe400787e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbe58034000 tx=0x7fbe5802f000 comp rx=0 tx=0).stop 2024-05-14T14:40:27.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.319+0000 7fbe6424c640 1 -- 172.21.15.39:0/2887743533 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe5c0b1c90 msgr2=0x7fbe5c1f9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:27.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.319+0000 7fbe6424c640 1 --2- 172.21.15.39:0/2887743533 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe5c0b1c90 0x7fbe5c1f9cc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c00c400 tx=0x7fbe4c00c8c0 comp rx=0 tx=0).stop 2024-05-14T14:40:27.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.319+0000 7fbe6424c640 1 -- 172.21.15.39:0/2887743533 shutdown_connections 2024-05-14T14:40:27.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.319+0000 7fbe6424c640 1 --2- 172.21.15.39:0/2887743533 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fbe400762d0 0x7fbe400787e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:27.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.319+0000 7fbe6424c640 1 --2- 172.21.15.39:0/2887743533 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fbe5c0b20a0 0x7fbe5c1fa200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:27.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.319+0000 7fbe6424c640 1 --2- 172.21.15.39:0/2887743533 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fbe5c0b1c90 0x7fbe5c1f9cc0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:27.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.319+0000 7fbe6424c640 1 --2- 172.21.15.39:0/2887743533 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe5c0b30b0 0x7fbe5c153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:27.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.319+0000 7fbe6424c640 1 -- 172.21.15.39:0/2887743533 >> 172.21.15.39:0/2887743533 conn(0x7fbe5c0d3ae0 msgr2=0x7fbe5c070b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:27.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.319+0000 7fbe6424c640 1 -- 172.21.15.39:0/2887743533 shutdown_connections 2024-05-14T14:40:27.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.319+0000 7fbe6424c640 1 -- 172.21.15.39:0/2887743533 wait complete. 2024-05-14T14:40:27.314 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-14T14:40:27.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.448+0000 7f3d9c7b2640 1 Processor -- start 2024-05-14T14:40:27.433 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.448+0000 7f3d9c7b2640 1 -- start start 2024-05-14T14:40:27.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.450+0000 7f3d9c7b2640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3d940d4720 0x7f3d940b9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:27.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.450+0000 7f3d9c7b2640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f3d940b9760 0x7f3d940b9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:27.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.450+0000 7f3d9c7b2640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d9406c9b0 con 0x7f3d940bb9a0 2024-05-14T14:40:27.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.450+0000 7f3d9c7b2640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f3d9406cc90 con 0x7f3d940b9760 2024-05-14T14:40:27.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.450+0000 7f3d9c7b2640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f3d9406cf70 con 0x7f3d940d4720 2024-05-14T14:40:27.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.450+0000 7f3d9a54e640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f3d940bb9a0 0x7f3d9406da50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:37760/0 (socket says 172.21.15.39:37760) 2024-05-14T14:40:27.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.450+0000 7f3d9a54e640 1 -- 172.21.15.39:0/520737974 learned_addr learned my addr 172.21.15.39:0/520737974 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:27.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.450+0000 7f3d9ad4f640 1 --2- 172.21.15.39:0/520737974 >> v2:172.21.15.39:3300/0 conn(0x7f3d940b9760 0x7f3d940b9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:27.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.450+0000 7f3d99d4d640 1 --2- 172.21.15.39:0/520737974 >> v2:172.21.15.62:3300/0 conn(0x7f3d940d4720 0x7f3d940b9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:27.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.450+0000 7f3d9954c640 1 -- 172.21.15.39:0/520737974 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3658051546 0 0) 0x7f3d9406c9b0 con 0x7f3d940bb9a0 2024-05-14T14:40:27.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.450+0000 7f3d9954c640 1 -- 172.21.15.39:0/520737974 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d80003520 con 0x7f3d940bb9a0 2024-05-14T14:40:27.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.451+0000 7f3d9ad4f640 1 -- 172.21.15.39:0/520737974 >> v2:172.21.15.62:3300/0 conn(0x7f3d940d4720 msgr2=0x7f3d940b9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:27.435 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.451+0000 7f3d9ad4f640 1 --2- 172.21.15.39:0/520737974 >> v2:172.21.15.62:3300/0 conn(0x7f3d940d4720 0x7f3d940b9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:27.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.451+0000 7f3d9ad4f640 1 -- 172.21.15.39:0/520737974 >> v1:172.21.15.39:6789/0 conn(0x7f3d940bb9a0 legacy=0x7f3d9406da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:27.436 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.451+0000 7f3d9ad4f640 1 -- 172.21.15.39:0/520737974 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d9406d250 con 0x7f3d940b9760 2024-05-14T14:40:27.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.451+0000 7f3d9ad4f640 1 --2- 172.21.15.39:0/520737974 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d940b9760 0x7f3d940b9b70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3d9408ef70 tx=0x7f3d8c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aee9b4e8a7240550 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:27.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.451+0000 7f3d9954c640 1 -- 172.21.15.39:0/520737974 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c007740 con 0x7f3d940b9760 2024-05-14T14:40:27.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.451+0000 7f3d9954c640 1 -- 172.21.15.39:0/520737974 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d8c0078e0 con 0x7f3d940b9760 2024-05-14T14:40:27.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.452+0000 7f3d9954c640 1 -- 172.21.15.39:0/520737974 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c007cb0 con 0x7f3d940b9760 2024-05-14T14:40:27.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.452+0000 7f3d9c7b2640 1 -- 172.21.15.39:0/520737974 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d940b9760 msgr2=0x7f3d940b9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:27.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.452+0000 7f3d9c7b2640 1 --2- 172.21.15.39:0/520737974 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d940b9760 0x7f3d940b9b70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3d9408ef70 tx=0x7f3d8c02a680 comp rx=0 tx=0).stop 2024-05-14T14:40:27.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.452+0000 7f3d9c7b2640 1 -- 172.21.15.39:0/520737974 shutdown_connections 2024-05-14T14:40:27.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.452+0000 7f3d9c7b2640 1 --2- 172.21.15.39:0/520737974 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d940b9760 0x7f3d940b9b70 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:27.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.452+0000 7f3d9c7b2640 1 --2- 172.21.15.39:0/520737974 >> v2:172.21.15.62:3300/0 conn(0x7f3d940d4720 0x7f3d940b9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:27.437 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.452+0000 7f3d9c7b2640 1 -- 172.21.15.39:0/520737974 >> 172.21.15.39:0/520737974 conn(0x7f3d9406f210 msgr2=0x7f3d940d5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:27.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.452+0000 7f3d9c7b2640 1 -- 172.21.15.39:0/520737974 shutdown_connections 2024-05-14T14:40:27.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.452+0000 7f3d9c7b2640 1 -- 172.21.15.39:0/520737974 wait complete. 2024-05-14T14:40:27.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.454+0000 7f3d9c7b2640 1 Processor -- start 2024-05-14T14:40:27.438 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.454+0000 7f3d9c7b2640 1 -- start start 2024-05-14T14:40:27.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.455+0000 7f3d9c7b2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d940b9760 0x7f3d9415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:27.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.455+0000 7f3d9c7b2640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d940bb9a0 0x7f3d94159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:27.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.455+0000 7f3d9c7b2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d940d4720 0x7f3d94162b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:27.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.455+0000 7f3d9c7b2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9406c6a0 con 0x7f3d940b9760 2024-05-14T14:40:27.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.455+0000 7f3d9c7b2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3d940b5530 con 0x7f3d940d4720 2024-05-14T14:40:27.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.455+0000 7f3d9c7b2640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f3d940d0af0 con 0x7f3d940bb9a0 2024-05-14T14:40:27.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.456+0000 7f3d9a54e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d940b9760 0x7f3d9415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:27.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.456+0000 7f3d9a54e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d940b9760 0x7f3d9415b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47646/0 (socket says 172.21.15.39:47646) 2024-05-14T14:40:27.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.456+0000 7f3d9a54e640 1 -- 172.21.15.39:0/192901813 learned_addr learned my addr 172.21.15.39:0/192901813 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:27.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.456+0000 7f3d9a54e640 1 -- 172.21.15.39:0/192901813 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d940bb9a0 msgr2=0x7f3d94159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:27.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.456+0000 7f3d9a54e640 1 --2- 172.21.15.39:0/192901813 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d940bb9a0 0x7f3d94159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:27.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.456+0000 7f3d9a54e640 1 -- 172.21.15.39:0/192901813 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d940d4720 msgr2=0x7f3d94162b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:27.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.456+0000 7f3d9ad4f640 1 --2- 172.21.15.39:0/192901813 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d940d4720 0x7f3d94162b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:27.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.456+0000 7f3d9a54e640 1 --2- 172.21.15.39:0/192901813 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d940d4720 0x7f3d94162b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:27.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.456+0000 7f3d9a54e640 1 -- 172.21.15.39:0/192901813 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d9415b8f0 con 0x7f3d940b9760 2024-05-14T14:40:27.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.456+0000 7f3d9a54e640 1 --2- 172.21.15.39:0/192901813 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d940b9760 0x7f3d9415b0a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3d9000c440 tx=0x7f3d9000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:27.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.456+0000 7f3d8affd640 1 -- 172.21.15.39:0/192901813 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d90017070 con 0x7f3d940b9760 2024-05-14T14:40:27.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.456+0000 7f3d8affd640 1 -- 172.21.15.39:0/192901813 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d90005ce0 con 0x7f3d940b9760 2024-05-14T14:40:27.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.456+0000 7f3d9c7b2640 1 -- 172.21.15.39:0/192901813 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d9415bbd0 con 0x7f3d940b9760 2024-05-14T14:40:27.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.456+0000 7f3d8affd640 1 -- 172.21.15.39:0/192901813 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d90007270 con 0x7f3d940b9760 2024-05-14T14:40:27.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.456+0000 7f3d9c7b2640 1 -- 172.21.15.39:0/192901813 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d9415c190 con 0x7f3d940b9760 2024-05-14T14:40:27.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.457+0000 7f3d9c7b2640 1 -- 172.21.15.39:0/192901813 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d94076aa0 con 0x7f3d940b9760 2024-05-14T14:40:27.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.458+0000 7f3d8affd640 1 -- 172.21.15.39:0/192901813 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3d9001a070 con 0x7f3d940b9760 2024-05-14T14:40:27.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.458+0000 7f3d8affd640 1 --2- 172.21.15.39:0/192901813 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f3d780762d0 0x7f3d780787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:27.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.459+0000 7f3d8affd640 1 -- 172.21.15.39:0/192901813 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3d90096b20 con 0x7f3d940b9760 2024-05-14T14:40:27.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.459+0000 7f3d99d4d640 1 --2- 172.21.15.39:0/192901813 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f3d780762d0 0x7f3d780787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:27.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.459+0000 7f3d99d4d640 1 --2- 172.21.15.39:0/192901813 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f3d780762d0 0x7f3d780787e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3d94163740 tx=0x7f3d84009500 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:27.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.463+0000 7f3d8affd640 1 -- 172.21.15.39:0/192901813 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3d9005fae0 con 0x7f3d940b9760 2024-05-14T14:40:27.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:27.696+0000 7f3d9c7b2640 1 -- 172.21.15.39:0/192901813 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f3d94069d80 con 0x7f3d940b9760 2024-05-14T14:40:28.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.033+0000 7f3d8affd640 1 -- 172.21.15.39:0/192901813 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7f3d90063de0 con 0x7f3d940b9760 2024-05-14T14:40:28.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.035+0000 7f3d9c7b2640 1 -- 172.21.15.39:0/192901813 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f3d780762d0 msgr2=0x7f3d780787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:28.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.035+0000 7f3d9c7b2640 1 --2- 172.21.15.39:0/192901813 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f3d780762d0 0x7f3d780787e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3d94163740 tx=0x7f3d84009500 comp rx=0 tx=0).stop 2024-05-14T14:40:28.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.035+0000 7f3d9c7b2640 1 -- 172.21.15.39:0/192901813 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d940b9760 msgr2=0x7f3d9415b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:28.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.035+0000 7f3d9c7b2640 1 --2- 172.21.15.39:0/192901813 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d940b9760 0x7f3d9415b0a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3d9000c440 tx=0x7f3d9000c900 comp rx=0 tx=0).stop 2024-05-14T14:40:28.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.035+0000 7f3d9c7b2640 1 -- 172.21.15.39:0/192901813 shutdown_connections 2024-05-14T14:40:28.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.035+0000 7f3d9c7b2640 1 --2- 172.21.15.39:0/192901813 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f3d780762d0 0x7f3d780787e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:28.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.035+0000 7f3d9c7b2640 1 --2- 172.21.15.39:0/192901813 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3d940d4720 0x7f3d94162b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:28.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.035+0000 7f3d9c7b2640 1 --2- 172.21.15.39:0/192901813 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3d940bb9a0 0x7f3d94159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:28.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.035+0000 7f3d9c7b2640 1 --2- 172.21.15.39:0/192901813 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3d940b9760 0x7f3d9415b0a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:28.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.035+0000 7f3d9c7b2640 1 -- 172.21.15.39:0/192901813 >> 172.21.15.39:0/192901813 conn(0x7f3d9406f210 msgr2=0x7f3d940b6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:28.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.035+0000 7f3d9c7b2640 1 -- 172.21.15.39:0/192901813 shutdown_connections 2024-05-14T14:40:28.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.035+0000 7f3d9c7b2640 1 -- 172.21.15.39:0/192901813 wait complete. 2024-05-14T14:40:28.031 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-05-14T14:40:28.032 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-14T14:40:28.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.166+0000 7f9165cd8640 1 Processor -- start 2024-05-14T14:40:28.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.166+0000 7f9165cd8640 1 -- start start 2024-05-14T14:40:28.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.167+0000 7f9165cd8640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91601603a0 0x7f91600d0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:28.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.167+0000 7f9165cd8640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f916006d950 0x7f91600ba090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:28.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.167+0000 7f9165cd8640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91600d1660 con 0x7f91600d1250 2024-05-14T14:40:28.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.167+0000 7f9165cd8640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f916006e280 con 0x7f916006d950 2024-05-14T14:40:28.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.167+0000 7f9165cd8640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f916006dd60 con 0x7f91601603a0 2024-05-14T14:40:28.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.168+0000 7f915ffff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f916006d950 0x7f91600ba090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:28.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.168+0000 7f915f7fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91601603a0 0x7f91600d0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:28.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.168+0000 7f915ffff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f916006d950 0x7f91600ba090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.39:38374/0 (socket says 172.21.15.39:38374) 2024-05-14T14:40:28.152 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.168+0000 7f915ffff640 1 -- 172.21.15.39:0/3566467202 learned_addr learned my addr 172.21.15.39:0/3566467202 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:28.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.168+0000 7f915ffff640 1 -- 172.21.15.39:0/3566467202 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91601603a0 msgr2=0x7f91600d0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:28.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.168+0000 7f915ffff640 1 --2- 172.21.15.39:0/3566467202 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91601603a0 0x7f91600d0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:28.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.168+0000 7f915ffff640 1 -- 172.21.15.39:0/3566467202 >> v1:172.21.15.62:6789/0 conn(0x7f91600d1250 legacy=0x7f916006d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:28.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.168+0000 7f915ffff640 1 -- 172.21.15.39:0/3566467202 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91600b9350 con 0x7f916006d950 2024-05-14T14:40:28.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.168+0000 7f915f7fe640 1 --2- 172.21.15.39:0/3566467202 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91601603a0 0x7f91600d0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T14:40:28.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.169+0000 7f915ffff640 1 --2- 172.21.15.39:0/3566467202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f916006d950 0x7f91600ba090 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9158009e50 tx=0x7f915802a7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62d4b597ea6ab1e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:28.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.169+0000 7f915e7fc640 1 -- 172.21.15.39:0/3566467202 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9158036070 con 0x7f916006d950 2024-05-14T14:40:28.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.169+0000 7f915e7fc640 1 -- 172.21.15.39:0/3566467202 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9158031600 con 0x7f916006d950 2024-05-14T14:40:28.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.169+0000 7f915e7fc640 1 -- 172.21.15.39:0/3566467202 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91580319d0 con 0x7f916006d950 2024-05-14T14:40:28.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.170+0000 7f9165cd8640 1 -- 172.21.15.39:0/3566467202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f916006d950 msgr2=0x7f91600ba090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:28.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.170+0000 7f9165cd8640 1 --2- 172.21.15.39:0/3566467202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f916006d950 0x7f91600ba090 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9158009e50 tx=0x7f915802a7a0 comp rx=0 tx=0).stop 2024-05-14T14:40:28.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.170+0000 7f9165cd8640 1 -- 172.21.15.39:0/3566467202 shutdown_connections 2024-05-14T14:40:28.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.170+0000 7f9165cd8640 1 --2- 172.21.15.39:0/3566467202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f916006d950 0x7f91600ba090 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:28.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.170+0000 7f9165cd8640 1 --2- 172.21.15.39:0/3566467202 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f91601603a0 0x7f91600d0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:28.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.170+0000 7f9165cd8640 1 -- 172.21.15.39:0/3566467202 >> 172.21.15.39:0/3566467202 conn(0x7f91600d2b00 msgr2=0x7f91600d2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:28.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.170+0000 7f9165cd8640 1 -- 172.21.15.39:0/3566467202 shutdown_connections 2024-05-14T14:40:28.155 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.170+0000 7f9165cd8640 1 -- 172.21.15.39:0/3566467202 wait complete. 2024-05-14T14:40:28.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.172+0000 7f9165cd8640 1 Processor -- start 2024-05-14T14:40:28.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.172+0000 7f9165cd8640 1 -- start start 2024-05-14T14:40:28.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.173+0000 7f9165cd8640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f916006d950 0x7f91601f5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:28.158 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.173+0000 7f9165cd8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91600d1250 0x7f9160158ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:28.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.173+0000 7f9165cd8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91601603a0 0x7f916015ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:28.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.173+0000 7f9165cd8640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f91600b9b70 con 0x7f91601603a0 2024-05-14T14:40:28.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.173+0000 7f9165cd8640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f91600b9890 con 0x7f91600d1250 2024-05-14T14:40:28.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.173+0000 7f9165cd8640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f91601607b0 con 0x7f916006d950 2024-05-14T14:40:28.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.173+0000 7f915ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91601603a0 0x7f916015ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:28.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.173+0000 7f915ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91601603a0 0x7f916015ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47662/0 (socket says 172.21.15.39:47662) 2024-05-14T14:40:28.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.173+0000 7f915ffff640 1 -- 172.21.15.39:0/2095925567 learned_addr learned my addr 172.21.15.39:0/2095925567 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:28.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.173+0000 7f915f7fe640 1 --2- 172.21.15.39:0/2095925567 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f916006d950 0x7f91601f5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:28.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.173+0000 7f915effd640 1 --2- 172.21.15.39:0/2095925567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91600d1250 0x7f9160158ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:28.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.174+0000 7f915ffff640 1 -- 172.21.15.39:0/2095925567 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f916006d950 msgr2=0x7f91601f5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:28.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.174+0000 7f915ffff640 1 --2- 172.21.15.39:0/2095925567 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f916006d950 0x7f91601f5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:28.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.174+0000 7f915ffff640 1 -- 172.21.15.39:0/2095925567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91600d1250 msgr2=0x7f9160158ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:28.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.174+0000 7f915ffff640 1 --2- 172.21.15.39:0/2095925567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91600d1250 0x7f9160158ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:28.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.174+0000 7f915ffff640 1 -- 172.21.15.39:0/2095925567 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91601f6480 con 0x7f91601603a0 2024-05-14T14:40:28.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.174+0000 7f915ffff640 1 --2- 172.21.15.39:0/2095925567 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91601603a0 0x7f916015ed60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9158009e50 tx=0x7f9158004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:28.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.174+0000 7f9147fff640 1 -- 172.21.15.39:0/2095925567 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9158036050 con 0x7f91601603a0 2024-05-14T14:40:28.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.174+0000 7f9147fff640 1 -- 172.21.15.39:0/2095925567 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9158042070 con 0x7f91601603a0 2024-05-14T14:40:28.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.174+0000 7f9147fff640 1 -- 172.21.15.39:0/2095925567 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9158009510 con 0x7f91601603a0 2024-05-14T14:40:28.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.174+0000 7f9165cd8640 1 -- 172.21.15.39:0/2095925567 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9160159b70 con 0x7f91601603a0 2024-05-14T14:40:28.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.174+0000 7f9165cd8640 1 -- 172.21.15.39:0/2095925567 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9160143b50 con 0x7f91601603a0 2024-05-14T14:40:28.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.175+0000 7f9165cd8640 1 -- 172.21.15.39:0/2095925567 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9160076aa0 con 0x7f91601603a0 2024-05-14T14:40:28.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.176+0000 7f9147fff640 1 -- 172.21.15.39:0/2095925567 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9158007b70 con 0x7f91601603a0 2024-05-14T14:40:28.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.177+0000 7f9147fff640 1 --2- 172.21.15.39:0/2095925567 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f914c076300 0x7f914c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:28.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.177+0000 7f915f7fe640 1 --2- 172.21.15.39:0/2095925567 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f914c076300 0x7f914c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:28.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.177+0000 7f9147fff640 1 -- 172.21.15.39:0/2095925567 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f91580b85f0 con 0x7f91601603a0 2024-05-14T14:40:28.161 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.177+0000 7f915f7fe640 1 --2- 172.21.15.39:0/2095925567 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f914c076300 0x7f914c078810 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9150009560 tx=0x7f9150009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:28.165 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.182+0000 7f9147fff640 1 -- 172.21.15.39:0/2095925567 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f91580815c0 con 0x7f91601603a0 2024-05-14T14:40:28.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:28.416+0000 7f9165cd8640 1 -- 172.21.15.39:0/2095925567 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f916015e340 con 0x7f91601603a0 2024-05-14T14:40:29.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.048+0000 7f9147fff640 1 -- 172.21.15.39:0/2095925567 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7f91580858c0 con 0x7f91601603a0 2024-05-14T14:40:29.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.051+0000 7f9165cd8640 1 -- 172.21.15.39:0/2095925567 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f914c076300 msgr2=0x7f914c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:29.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.051+0000 7f9165cd8640 1 --2- 172.21.15.39:0/2095925567 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f914c076300 0x7f914c078810 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9150009560 tx=0x7f9150009190 comp rx=0 tx=0).stop 2024-05-14T14:40:29.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.051+0000 7f9165cd8640 1 -- 172.21.15.39:0/2095925567 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91601603a0 msgr2=0x7f916015ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:29.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.051+0000 7f9165cd8640 1 --2- 172.21.15.39:0/2095925567 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91601603a0 0x7f916015ed60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9158009e50 tx=0x7f9158004a40 comp rx=0 tx=0).stop 2024-05-14T14:40:29.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.051+0000 7f9165cd8640 1 -- 172.21.15.39:0/2095925567 shutdown_connections 2024-05-14T14:40:29.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.051+0000 7f9165cd8640 1 --2- 172.21.15.39:0/2095925567 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f914c076300 0x7f914c078810 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:29.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.051+0000 7f9165cd8640 1 --2- 172.21.15.39:0/2095925567 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f91601603a0 0x7f916015ed60 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:29.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.051+0000 7f9165cd8640 1 --2- 172.21.15.39:0/2095925567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f91600d1250 0x7f9160158ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:29.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.051+0000 7f9165cd8640 1 --2- 172.21.15.39:0/2095925567 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f916006d950 0x7f91601f5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:29.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.051+0000 7f9165cd8640 1 -- 172.21.15.39:0/2095925567 >> 172.21.15.39:0/2095925567 conn(0x7f91600d2b00 msgr2=0x7f916006cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:29.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.051+0000 7f9165cd8640 1 -- 172.21.15.39:0/2095925567 shutdown_connections 2024-05-14T14:40:29.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.051+0000 7f9165cd8640 1 -- 172.21.15.39:0/2095925567 wait complete. 2024-05-14T14:40:29.049 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-14T14:40:29.049 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T14:40:29.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.187+0000 7fc7dc7fa640 1 Processor -- start 2024-05-14T14:40:29.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.187+0000 7fc7dc7fa640 1 -- start start 2024-05-14T14:40:29.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.189+0000 7fc7dc7fa640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc7d41602d0 0x7fc7d40d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:29.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.189+0000 7fc7dc7fa640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc7d406ccd0 0x7fc7d406d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:29.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.189+0000 7fc7dc7fa640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7d40d5840 con 0x7fc7d40b4ec0 2024-05-14T14:40:29.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.189+0000 7fc7dc7fa640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fc7d40d4d50 con 0x7fc7d406ccd0 2024-05-14T14:40:29.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.189+0000 7fc7dc7fa640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fc7d406c840 con 0x7fc7d41602d0 2024-05-14T14:40:29.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.189+0000 7fc7dad97640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc7d406ccd0 0x7fc7d406d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:29.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.189+0000 7fc7dad97640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc7d406ccd0 0x7fc7d406d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:47988/0 (socket says 172.21.15.39:47988) 2024-05-14T14:40:29.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.189+0000 7fc7dad97640 1 -- 172.21.15.39:0/164444265 learned_addr learned my addr 172.21.15.39:0/164444265 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:29.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.189+0000 7fc7d9d95640 1 --2- 172.21.15.39:0/164444265 >> v2:172.21.15.62:3300/0 conn(0x7fc7d41602d0 0x7fc7d40d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:29.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.189+0000 7fc7dad97640 1 -- 172.21.15.39:0/164444265 >> v2:172.21.15.62:3300/0 conn(0x7fc7d41602d0 msgr2=0x7fc7d40d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:29.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.189+0000 7fc7dad97640 1 --2- 172.21.15.39:0/164444265 >> v2:172.21.15.62:3300/0 conn(0x7fc7d41602d0 0x7fc7d40d11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:29.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.189+0000 7fc7dad97640 1 -- 172.21.15.39:0/164444265 >> v1:172.21.15.62:6789/0 conn(0x7fc7d40b4ec0 legacy=0x7fc7d40d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:29.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.189+0000 7fc7dad97640 1 -- 172.21.15.39:0/164444265 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7d40d4fa0 con 0x7fc7d406ccd0 2024-05-14T14:40:29.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.190+0000 7fc7dad97640 1 --2- 172.21.15.39:0/164444265 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7d406ccd0 0x7fc7d406d0e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc7d408e230 tx=0x7fc7c402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f644b48fd845b05f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:29.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.190+0000 7fc7d9594640 1 -- 172.21.15.39:0/164444265 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c4036070 con 0x7fc7d406ccd0 2024-05-14T14:40:29.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.190+0000 7fc7d9594640 1 -- 172.21.15.39:0/164444265 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7c4031600 con 0x7fc7d406ccd0 2024-05-14T14:40:29.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.190+0000 7fc7d9594640 1 -- 172.21.15.39:0/164444265 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c40319d0 con 0x7fc7d406ccd0 2024-05-14T14:40:29.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.191+0000 7fc7dc7fa640 1 -- 172.21.15.39:0/164444265 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7d406ccd0 msgr2=0x7fc7d406d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:29.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.191+0000 7fc7dc7fa640 1 --2- 172.21.15.39:0/164444265 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7d406ccd0 0x7fc7d406d0e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc7d408e230 tx=0x7fc7c402a6a0 comp rx=0 tx=0).stop 2024-05-14T14:40:29.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.191+0000 7fc7dc7fa640 1 -- 172.21.15.39:0/164444265 shutdown_connections 2024-05-14T14:40:29.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.191+0000 7fc7dc7fa640 1 --2- 172.21.15.39:0/164444265 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7d406ccd0 0x7fc7d406d0e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:29.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.191+0000 7fc7dc7fa640 1 --2- 172.21.15.39:0/164444265 >> v2:172.21.15.62:3300/0 conn(0x7fc7d41602d0 0x7fc7d40d11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:29.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.191+0000 7fc7dc7fa640 1 -- 172.21.15.39:0/164444265 >> 172.21.15.39:0/164444265 conn(0x7fc7d406f270 msgr2=0x7fc7d40d5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:29.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.191+0000 7fc7dc7fa640 1 -- 172.21.15.39:0/164444265 shutdown_connections 2024-05-14T14:40:29.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.191+0000 7fc7dc7fa640 1 -- 172.21.15.39:0/164444265 wait complete. 2024-05-14T14:40:29.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.193+0000 7fc7dc7fa640 1 Processor -- start 2024-05-14T14:40:29.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.193+0000 7fc7dc7fa640 1 -- start start 2024-05-14T14:40:29.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.194+0000 7fc7dc7fa640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7d406ccd0 0x7fc7d41f7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:29.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.194+0000 7fc7dc7fa640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7d40b4ec0 0x7fc7d41f62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:29.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.194+0000 7fc7dc7fa640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7d41602d0 0x7fc7d4159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:29.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.194+0000 7fc7dc7fa640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d41606e0 con 0x7fc7d406ccd0 2024-05-14T14:40:29.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.194+0000 7fc7dc7fa640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d40d5560 con 0x7fc7d40b4ec0 2024-05-14T14:40:29.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.194+0000 7fc7dc7fa640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc7d40b5480 con 0x7fc7d41602d0 2024-05-14T14:40:29.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.194+0000 7fc7da596640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7d406ccd0 0x7fc7d41f7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:29.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.194+0000 7fc7da596640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7d406ccd0 0x7fc7d41f7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48000/0 (socket says 172.21.15.39:48000) 2024-05-14T14:40:29.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.194+0000 7fc7da596640 1 -- 172.21.15.39:0/2753927039 learned_addr learned my addr 172.21.15.39:0/2753927039 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:29.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.194+0000 7fc7dad97640 1 --2- 172.21.15.39:0/2753927039 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7d41602d0 0x7fc7d4159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:29.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.194+0000 7fc7d9d95640 1 --2- 172.21.15.39:0/2753927039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7d40b4ec0 0x7fc7d41f62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:29.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.195+0000 7fc7da596640 1 -- 172.21.15.39:0/2753927039 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7d41602d0 msgr2=0x7fc7d4159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:29.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.195+0000 7fc7da596640 1 --2- 172.21.15.39:0/2753927039 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7d41602d0 0x7fc7d4159280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:29.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.195+0000 7fc7da596640 1 -- 172.21.15.39:0/2753927039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7d40b4ec0 msgr2=0x7fc7d41f62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:29.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.195+0000 7fc7da596640 1 --2- 172.21.15.39:0/2753927039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7d40b4ec0 0x7fc7d41f62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:29.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.195+0000 7fc7da596640 1 -- 172.21.15.39:0/2753927039 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7d415b0a0 con 0x7fc7d406ccd0 2024-05-14T14:40:29.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.195+0000 7fc7da596640 1 --2- 172.21.15.39:0/2753927039 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7d406ccd0 0x7fc7d41f7450 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc00b420 tx=0x7fc7cc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:29.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.195+0000 7fc7d2ffd640 1 -- 172.21.15.39:0/2753927039 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc015020 con 0x7fc7d406ccd0 2024-05-14T14:40:29.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.195+0000 7fc7d2ffd640 1 -- 172.21.15.39:0/2753927039 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7cc011830 con 0x7fc7d406ccd0 2024-05-14T14:40:29.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.195+0000 7fc7d2ffd640 1 -- 172.21.15.39:0/2753927039 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc011c20 con 0x7fc7d406ccd0 2024-05-14T14:40:29.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.195+0000 7fc7dc7fa640 1 -- 172.21.15.39:0/2753927039 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7d415b380 con 0x7fc7d406ccd0 2024-05-14T14:40:29.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.195+0000 7fc7dc7fa640 1 -- 172.21.15.39:0/2753927039 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7d415b940 con 0x7fc7d406ccd0 2024-05-14T14:40:29.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.196+0000 7fc7dc7fa640 1 -- 172.21.15.39:0/2753927039 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7d4076aa0 con 0x7fc7d406ccd0 2024-05-14T14:40:29.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.197+0000 7fc7d2ffd640 1 -- 172.21.15.39:0/2753927039 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc7cc018020 con 0x7fc7d406ccd0 2024-05-14T14:40:29.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.198+0000 7fc7d2ffd640 1 --2- 172.21.15.39:0/2753927039 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fc7c0076300 0x7fc7c0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:29.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.198+0000 7fc7d9d95640 1 --2- 172.21.15.39:0/2753927039 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fc7c0076300 0x7fc7c0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:29.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.198+0000 7fc7d2ffd640 1 -- 172.21.15.39:0/2753927039 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc7cc0974a0 con 0x7fc7d406ccd0 2024-05-14T14:40:29.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.198+0000 7fc7d9d95640 1 --2- 172.21.15.39:0/2753927039 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fc7c0076300 0x7fc7c0078810 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc7d40d2800 tx=0x7fc7c8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:29.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.203+0000 7fc7d2ffd640 1 -- 172.21.15.39:0/2753927039 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc7cc01f030 con 0x7fc7d406ccd0 2024-05-14T14:40:29.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.431+0000 7fc7dc7fa640 1 -- 172.21.15.39:0/2753927039 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc7d40d4120 con 0x7fc7d406ccd0 2024-05-14T14:40:29.416 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.432+0000 7fc7d2ffd640 1 -- 172.21.15.39:0/2753927039 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5171 (secure 0 0 0) 0x7fc7cc060340 con 0x7fc7d406ccd0 2024-05-14T14:40:29.416 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:40:29.416 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/3753262818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3753262818},{"type":"v1","addr":"172.21.15.62:6834","nonce":3753262818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/97693396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6835","nonce":97693396},{"type":"v1","addr":"172.21.15.39:6837","nonce":97693396}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6836/1648047942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":1648047942},{"type":"v1","addr":"172.21.15.39:6836","nonce":1648047942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T14:40:15.320927+0000","modified":"2024-05-14T14:40:28.417797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/1519798364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":1519798364},{"type":"v1","addr":"172.21.15.62:6835","nonce":1519798364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-05-14T14:40:29.417 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 9 2024-05-14T14:40:29.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.434+0000 7fc7dc7fa640 1 -- 172.21.15.39:0/2753927039 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fc7c0076300 msgr2=0x7fc7c0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:29.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.434+0000 7fc7dc7fa640 1 --2- 172.21.15.39:0/2753927039 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fc7c0076300 0x7fc7c0078810 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc7d40d2800 tx=0x7fc7c8008040 comp rx=0 tx=0).stop 2024-05-14T14:40:29.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.434+0000 7fc7dc7fa640 1 -- 172.21.15.39:0/2753927039 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7d406ccd0 msgr2=0x7fc7d41f7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:29.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.434+0000 7fc7dc7fa640 1 --2- 172.21.15.39:0/2753927039 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7d406ccd0 0x7fc7d41f7450 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc00b420 tx=0x7fc7cc00b8e0 comp rx=0 tx=0).stop 2024-05-14T14:40:29.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.434+0000 7fc7dc7fa640 1 -- 172.21.15.39:0/2753927039 shutdown_connections 2024-05-14T14:40:29.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.434+0000 7fc7dc7fa640 1 --2- 172.21.15.39:0/2753927039 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fc7c0076300 0x7fc7c0078810 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:29.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.434+0000 7fc7dc7fa640 1 --2- 172.21.15.39:0/2753927039 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc7d41602d0 0x7fc7d4159280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:29.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.434+0000 7fc7dc7fa640 1 --2- 172.21.15.39:0/2753927039 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7d40b4ec0 0x7fc7d41f62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:29.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.434+0000 7fc7dc7fa640 1 --2- 172.21.15.39:0/2753927039 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc7d406ccd0 0x7fc7d41f7450 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:29.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.434+0000 7fc7dc7fa640 1 -- 172.21.15.39:0/2753927039 >> 172.21.15.39:0/2753927039 conn(0x7fc7d406f270 msgr2=0x7fc7d40b6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:29.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.434+0000 7fc7dc7fa640 1 -- 172.21.15.39:0/2753927039 shutdown_connections 2024-05-14T14:40:29.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.434+0000 7fc7dc7fa640 1 -- 172.21.15.39:0/2753927039 wait complete. 2024-05-14T14:40:29.430 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T14:40:29.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.561+0000 7fc30fa05640 1 Processor -- start 2024-05-14T14:40:29.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.562+0000 7fc30fa05640 1 -- start start 2024-05-14T14:40:29.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.563+0000 7fc30fa05640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc3080d11a0 0x7fc308160320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:29.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.563+0000 7fc30fa05640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc308161320 0x7fc30806cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:29.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.563+0000 7fc30fa05640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3081644a0 con 0x7fc308163e50 2024-05-14T14:40:29.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.563+0000 7fc30fa05640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fc308164260 con 0x7fc3080d11a0 2024-05-14T14:40:29.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.563+0000 7fc30fa05640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc308164780 con 0x7fc308161320 2024-05-14T14:40:29.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.563+0000 7fc30cfa0640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc3080d11a0 0x7fc308160320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:29.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.563+0000 7fc30cfa0640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc3080d11a0 0x7fc308160320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48014/0 (socket says 172.21.15.39:48014) 2024-05-14T14:40:29.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.563+0000 7fc30cfa0640 1 -- 172.21.15.39:0/4203314852 learned_addr learned my addr 172.21.15.39:0/4203314852 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:29.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.563+0000 7fc30dfa2640 1 --2- 172.21.15.39:0/4203314852 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc308161320 0x7fc30806cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:29.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.563+0000 7fc30cfa0640 1 -- 172.21.15.39:0/4203314852 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc308161320 msgr2=0x7fc30806cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:29.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.563+0000 7fc30cfa0640 1 --2- 172.21.15.39:0/4203314852 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc308161320 0x7fc30806cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:29.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.563+0000 7fc30cfa0640 1 -- 172.21.15.39:0/4203314852 >> v1:172.21.15.62:6789/0 conn(0x7fc308163e50 legacy=0x7fc3080d0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:29.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.563+0000 7fc30cfa0640 1 -- 172.21.15.39:0/4203314852 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc308164a60 con 0x7fc3080d11a0 2024-05-14T14:40:29.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.563+0000 7fc30dfa2640 1 --2- 172.21.15.39:0/4203314852 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc308161320 0x7fc30806cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:40:29.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.564+0000 7fc30cfa0640 1 --2- 172.21.15.39:0/4203314852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3080d11a0 0x7fc308160320 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8009870 tx=0x7fc2f802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec1060419e011bb6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:29.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.564+0000 7fc2fffff640 1 -- 172.21.15.39:0/4203314852 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8037070 con 0x7fc3080d11a0 2024-05-14T14:40:29.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.564+0000 7fc2fffff640 1 -- 172.21.15.39:0/4203314852 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2f8032440 con 0x7fc3080d11a0 2024-05-14T14:40:29.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.564+0000 7fc2fffff640 1 -- 172.21.15.39:0/4203314852 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8032810 con 0x7fc3080d11a0 2024-05-14T14:40:29.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.565+0000 7fc30fa05640 1 -- 172.21.15.39:0/4203314852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3080d11a0 msgr2=0x7fc308160320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:29.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.565+0000 7fc30fa05640 1 --2- 172.21.15.39:0/4203314852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3080d11a0 0x7fc308160320 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8009870 tx=0x7fc2f802a1c0 comp rx=0 tx=0).stop 2024-05-14T14:40:29.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.565+0000 7fc30fa05640 1 -- 172.21.15.39:0/4203314852 shutdown_connections 2024-05-14T14:40:29.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.565+0000 7fc30fa05640 1 --2- 172.21.15.39:0/4203314852 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc308161320 0x7fc30806cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:29.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.565+0000 7fc30fa05640 1 --2- 172.21.15.39:0/4203314852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3080d11a0 0x7fc308160320 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:29.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.565+0000 7fc30fa05640 1 -- 172.21.15.39:0/4203314852 >> 172.21.15.39:0/4203314852 conn(0x7fc3080b77d0 msgr2=0x7fc3080b7be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:29.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.565+0000 7fc30fa05640 1 -- 172.21.15.39:0/4203314852 shutdown_connections 2024-05-14T14:40:29.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.565+0000 7fc30fa05640 1 -- 172.21.15.39:0/4203314852 wait complete. 2024-05-14T14:40:29.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.567+0000 7fc30fa05640 1 Processor -- start 2024-05-14T14:40:29.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.567+0000 7fc30fa05640 1 -- start start 2024-05-14T14:40:29.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.568+0000 7fc30fa05640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc308161320 0x7fc30814f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:29.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.568+0000 7fc30fa05640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc308163e50 0x7fc30814fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:29.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.568+0000 7fc30fa05640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3080aeb20 0x7fc3080accd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:29.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.568+0000 7fc30fa05640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc30806d160 con 0x7fc3080aeb20 2024-05-14T14:40:29.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.568+0000 7fc30fa05640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc308161730 con 0x7fc308161320 2024-05-14T14:40:29.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.568+0000 7fc30fa05640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc30806d2e0 con 0x7fc308163e50 2024-05-14T14:40:29.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.568+0000 7fc30dfa2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3080aeb20 0x7fc3080accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:29.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.569+0000 7fc30dfa2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3080aeb20 0x7fc3080accd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48016/0 (socket says 172.21.15.39:48016) 2024-05-14T14:40:29.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.569+0000 7fc30dfa2640 1 -- 172.21.15.39:0/3695754644 learned_addr learned my addr 172.21.15.39:0/3695754644 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:29.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.569+0000 7fc30d7a1640 1 --2- 172.21.15.39:0/3695754644 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc308161320 0x7fc30814f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:29.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.569+0000 7fc30cfa0640 1 --2- 172.21.15.39:0/3695754644 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc308163e50 0x7fc30814fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:29.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.569+0000 7fc30dfa2640 1 -- 172.21.15.39:0/3695754644 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc308163e50 msgr2=0x7fc30814fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:29.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.569+0000 7fc30dfa2640 1 --2- 172.21.15.39:0/3695754644 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc308163e50 0x7fc30814fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:29.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.569+0000 7fc30dfa2640 1 -- 172.21.15.39:0/3695754644 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc308161320 msgr2=0x7fc30814f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:29.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.569+0000 7fc30dfa2640 1 --2- 172.21.15.39:0/3695754644 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc308161320 0x7fc30814f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:29.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.569+0000 7fc30dfa2640 1 -- 172.21.15.39:0/3695754644 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc30814f8e0 con 0x7fc3080aeb20 2024-05-14T14:40:29.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.569+0000 7fc30d7a1640 1 --2- 172.21.15.39:0/3695754644 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc308161320 0x7fc30814f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:40:29.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.569+0000 7fc30dfa2640 1 --2- 172.21.15.39:0/3695754644 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3080aeb20 0x7fc3080accd0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc300007e60 tx=0x7fc30000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:29.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.569+0000 7fc2fdffb640 1 -- 172.21.15.39:0/3695754644 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc30001a070 con 0x7fc3080aeb20 2024-05-14T14:40:29.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.569+0000 7fc2fdffb640 1 -- 172.21.15.39:0/3695754644 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc300015600 con 0x7fc3080aeb20 2024-05-14T14:40:29.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.569+0000 7fc30fa05640 1 -- 172.21.15.39:0/3695754644 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3080ada80 con 0x7fc3080aeb20 2024-05-14T14:40:29.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.569+0000 7fc2fdffb640 1 -- 172.21.15.39:0/3695754644 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3000159f0 con 0x7fc3080aeb20 2024-05-14T14:40:29.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.570+0000 7fc30fa05640 1 -- 172.21.15.39:0/3695754644 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3080ae040 con 0x7fc3080aeb20 2024-05-14T14:40:29.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.571+0000 7fc30fa05640 1 -- 172.21.15.39:0/3695754644 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc308076aa0 con 0x7fc3080aeb20 2024-05-14T14:40:29.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.571+0000 7fc2fdffb640 1 -- 172.21.15.39:0/3695754644 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc30001d070 con 0x7fc3080aeb20 2024-05-14T14:40:29.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.572+0000 7fc2fdffb640 1 --2- 172.21.15.39:0/3695754644 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fc2ec076300 0x7fc2ec078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:29.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.572+0000 7fc2fdffb640 1 -- 172.21.15.39:0/3695754644 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc300097be0 con 0x7fc3080aeb20 2024-05-14T14:40:29.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.572+0000 7fc30d7a1640 1 --2- 172.21.15.39:0/3695754644 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fc2ec076300 0x7fc2ec078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:29.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.572+0000 7fc30d7a1640 1 --2- 172.21.15.39:0/3695754644 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fc2ec076300 0x7fc2ec078810 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc3080b8fc0 tx=0x7fc304009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:29.560 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.576+0000 7fc2fdffb640 1 -- 172.21.15.39:0/3695754644 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc300010070 con 0x7fc3080aeb20 2024-05-14T14:40:29.752 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.768+0000 7fc30fa05640 1 -- 172.21.15.39:0/3695754644 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc308068e10 con 0x7fc3080aeb20 2024-05-14T14:40:29.754 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.770+0000 7fc2fdffb640 1 -- 172.21.15.39:0/3695754644 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18454 (secure 0 0 0) 0x7fc300061170 con 0x7fc3080aeb20 2024-05-14T14:40:29.754 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:40:29.754 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"fsid":"d7983fec-79c7-4991-b19c-1aecead64611","created":"2024-05-14T14:39:52.157167+0000","modified":"2024-05-14T14:40:20.397684+0000","last_up_change":"2024-05-14T14:40:03.848608+0000","last_in_change":"2024-05-14T14:39:54.591920+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T14:40:04.692846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T14:40:13.794415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T14:40:14.273154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T14:40:17.979457+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c4ec4534-6301-4dd7-b4d6-d560b096d442","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6801","nonce":4023478848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6803","nonce":4023478848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6807","nonce":4023478848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6805","nonce":4023478848}]},"public_addr":"172.21.15.39:6801/4023478848","cluster_addr":"172.21.15.39:6803/4023478848","heartbeat_back_addr":"172.21.15.39:6807/4023478848","heartbeat_front_addr":"172.21.15.39:6805/4023478848","state":["exists","up"]},{"osd":1,"uuid":"93f91b0e-096e-4bdf-aed0-d1136f73f136","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6817","nonce":926357398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6819","nonce":926357398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6823","nonce":926357398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6821","nonce":926357398}]},"public_addr":"172.21.15.39:6817/926357398","cluster_addr":"172.21.15.39:6819/926357398","heartbeat_back_addr":"172.21.15.39:6823/926357398","heartbeat_front_addr":"172.21.15.39:6821/926357398","state":["exists","up"]},{"osd":2,"uuid":"c590b1e0-67eb-452e-8e80-d2208da17d09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6809","nonce":610616754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6811","nonce":610616754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6815","nonce":610616754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6813","nonce":610616754}]},"public_addr":"172.21.15.39:6809/610616754","cluster_addr":"172.21.15.39:6811/610616754","heartbeat_back_addr":"172.21.15.39:6815/610616754","heartbeat_front_addr":"172.21.15.39:6813/610616754","state":["exists","up"]},{"osd":3,"uuid":"d57661b0-44f6-4355-9115-83eceb9b8f71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6825","nonce":1469314579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6827","nonce":1469314579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6831","nonce":1469314579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6829","nonce":1469314579}]},"public_addr":"172.21.15.39:6825/1469314579","cluster_addr":"172.21.15.39:6827/1469314579","heartbeat_back_addr":"172.21.15.39:6831/1469314579","heartbeat_front_addr":"172.21.15.39:6829/1469314579","state":["exists","up"]},{"osd":4,"uuid":"b131436f-f6e1-4d72-a86e-de200afdcebb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6825","nonce":3481507129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6827","nonce":3481507129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6831","nonce":3481507129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6829","nonce":3481507129}]},"public_addr":"172.21.15.62:6825/3481507129","cluster_addr":"172.21.15.62:6827/3481507129","heartbeat_back_addr":"172.21.15.62:6831/3481507129","heartbeat_front_addr":"172.21.15.62:6829/3481507129","state":["exists","up"]},{"osd":5,"uuid":"12e10b40-28b1-410f-9ce0-7b427daa111e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6801","nonce":3291934116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6803","nonce":3291934116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6807","nonce":3291934116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6805","nonce":3291934116}]},"public_addr":"172.21.15.62:6801/3291934116","cluster_addr":"172.21.15.62:6803/3291934116","heartbeat_back_addr":"172.21.15.62:6807/3291934116","heartbeat_front_addr":"172.21.15.62:6805/3291934116","state":["exists","up"]},{"osd":6,"uuid":"ad8950a5-70bd-488c-8f29-010515cc4a04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6817","nonce":3005996101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6819","nonce":3005996101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6823","nonce":3005996101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6821","nonce":3005996101}]},"public_addr":"172.21.15.62:6817/3005996101","cluster_addr":"172.21.15.62:6819/3005996101","heartbeat_back_addr":"172.21.15.62:6823/3005996101","heartbeat_front_addr":"172.21.15.62:6821/3005996101","state":["exists","up"]},{"osd":7,"uuid":"e0d4b8b7-3c80-4760-a342-1d508cdecc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6809","nonce":2800379225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6811","nonce":2800379225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6815","nonce":2800379225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6813","nonce":2800379225}]},"public_addr":"172.21.15.62:6809/2800379225","cluster_addr":"172.21.15.62:6811/2800379225","heartbeat_back_addr":"172.21.15.62:6815/2800379225","heartbeat_front_addr":"172.21.15.62:6813/2800379225","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.773714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.760037+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.811225+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.752810+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.745165+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.700634+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.768477+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.747301+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T14:40:29.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.772+0000 7fc30fa05640 1 -- 172.21.15.39:0/3695754644 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fc2ec076300 msgr2=0x7fc2ec078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:29.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.772+0000 7fc30fa05640 1 --2- 172.21.15.39:0/3695754644 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fc2ec076300 0x7fc2ec078810 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc3080b8fc0 tx=0x7fc304009040 comp rx=0 tx=0).stop 2024-05-14T14:40:29.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.772+0000 7fc30fa05640 1 -- 172.21.15.39:0/3695754644 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3080aeb20 msgr2=0x7fc3080accd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:29.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.772+0000 7fc30fa05640 1 --2- 172.21.15.39:0/3695754644 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3080aeb20 0x7fc3080accd0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc300007e60 tx=0x7fc30000d4a0 comp rx=0 tx=0).stop 2024-05-14T14:40:29.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.772+0000 7fc30fa05640 1 -- 172.21.15.39:0/3695754644 shutdown_connections 2024-05-14T14:40:29.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.772+0000 7fc30fa05640 1 --2- 172.21.15.39:0/3695754644 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fc2ec076300 0x7fc2ec078810 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:29.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.772+0000 7fc30fa05640 1 --2- 172.21.15.39:0/3695754644 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3080aeb20 0x7fc3080accd0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:29.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.772+0000 7fc30fa05640 1 --2- 172.21.15.39:0/3695754644 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc308163e50 0x7fc30814fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:29.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.772+0000 7fc30fa05640 1 --2- 172.21.15.39:0/3695754644 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc308161320 0x7fc30814f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:29.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.772+0000 7fc30fa05640 1 -- 172.21.15.39:0/3695754644 >> 172.21.15.39:0/3695754644 conn(0x7fc3080b77d0 msgr2=0x7fc308162b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:29.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.772+0000 7fc30fa05640 1 -- 172.21.15.39:0/3695754644 shutdown_connections 2024-05-14T14:40:29.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.772+0000 7fc30fa05640 1 -- 172.21.15.39:0/3695754644 wait complete. 2024-05-14T14:40:29.767 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-14T14:40:29.768 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T14:40:29.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.898+0000 7f88a3c51640 1 Processor -- start 2024-05-14T14:40:29.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.898+0000 7f88a3c51640 1 -- start start 2024-05-14T14:40:29.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.900+0000 7f88a3c51640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f889c0d26f0 0x7f889c15bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:29.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.900+0000 7f88a3c51640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f889c15f0f0 0x7f889c0ce700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:29.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.900+0000 7f88a3c51640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f889c0cf070 con 0x7f889c072fd0 2024-05-14T14:40:29.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.900+0000 7f88a3c51640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f889c15c180 con 0x7f889c0d26f0 2024-05-14T14:40:29.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.900+0000 7f88a3c51640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f889c15ec60 con 0x7f889c15f0f0 2024-05-14T14:40:29.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.900+0000 7f88a19ed640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f889c0d26f0 0x7f889c15bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:29.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.900+0000 7f88a19ed640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f889c0d26f0 0x7f889c15bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48018/0 (socket says 172.21.15.39:48018) 2024-05-14T14:40:29.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.900+0000 7f88a19ed640 1 -- 172.21.15.39:0/2201561683 learned_addr learned my addr 172.21.15.39:0/2201561683 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:29.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.900+0000 7f88a11ec640 1 --2- 172.21.15.39:0/2201561683 >> v2:172.21.15.62:3300/0 conn(0x7f889c15f0f0 0x7f889c0ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:29.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.900+0000 7f88a19ed640 1 -- 172.21.15.39:0/2201561683 >> v2:172.21.15.62:3300/0 conn(0x7f889c15f0f0 msgr2=0x7f889c0ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:29.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.900+0000 7f88a19ed640 1 --2- 172.21.15.39:0/2201561683 >> v2:172.21.15.62:3300/0 conn(0x7f889c15f0f0 0x7f889c0ce700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:29.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.900+0000 7f88a19ed640 1 -- 172.21.15.39:0/2201561683 >> v1:172.21.15.62:6789/0 conn(0x7f889c072fd0 legacy=0x7f889c0733e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:29.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.900+0000 7f88a19ed640 1 -- 172.21.15.39:0/2201561683 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f889c0cf350 con 0x7f889c0d26f0 2024-05-14T14:40:29.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.900+0000 7f88a11ec640 1 --2- 172.21.15.39:0/2201561683 >> v2:172.21.15.62:3300/0 conn(0x7f889c15f0f0 0x7f889c0ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:40:29.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.901+0000 7f88a19ed640 1 --2- 172.21.15.39:0/2201561683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f889c0d26f0 0x7f889c15bc40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f889c0c7160 tx=0x7f888c02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb44b16c48ad7b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:29.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.901+0000 7f88a09eb640 1 -- 172.21.15.39:0/2201561683 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c036070 con 0x7f889c0d26f0 2024-05-14T14:40:29.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.901+0000 7f88a09eb640 1 -- 172.21.15.39:0/2201561683 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f888c031600 con 0x7f889c0d26f0 2024-05-14T14:40:29.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.901+0000 7f88a09eb640 1 -- 172.21.15.39:0/2201561683 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f888c0319d0 con 0x7f889c0d26f0 2024-05-14T14:40:29.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.902+0000 7f88a3c51640 1 -- 172.21.15.39:0/2201561683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f889c0d26f0 msgr2=0x7f889c15bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:29.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.902+0000 7f88a3c51640 1 --2- 172.21.15.39:0/2201561683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f889c0d26f0 0x7f889c15bc40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f889c0c7160 tx=0x7f888c02a610 comp rx=0 tx=0).stop 2024-05-14T14:40:29.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.902+0000 7f88a3c51640 1 -- 172.21.15.39:0/2201561683 shutdown_connections 2024-05-14T14:40:29.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.902+0000 7f88a3c51640 1 --2- 172.21.15.39:0/2201561683 >> v2:172.21.15.62:3300/0 conn(0x7f889c15f0f0 0x7f889c0ce700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:29.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.902+0000 7f88a3c51640 1 --2- 172.21.15.39:0/2201561683 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f889c0d26f0 0x7f889c15bc40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:29.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.902+0000 7f88a3c51640 1 -- 172.21.15.39:0/2201561683 >> 172.21.15.39:0/2201561683 conn(0x7f889c0d3ae0 msgr2=0x7f889c0d3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:29.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.902+0000 7f88a3c51640 1 -- 172.21.15.39:0/2201561683 shutdown_connections 2024-05-14T14:40:29.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.902+0000 7f88a3c51640 1 -- 172.21.15.39:0/2201561683 wait complete. 2024-05-14T14:40:29.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.904+0000 7f88a3c51640 1 Processor -- start 2024-05-14T14:40:29.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.904+0000 7f88a3c51640 1 -- start start 2024-05-14T14:40:29.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.905+0000 7f88a3c51640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f889c072fd0 0x7f889c14f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:29.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.905+0000 7f88a3c51640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f889c0d26f0 0x7f889c1fa650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:29.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.905+0000 7f88a3c51640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f889c15f0f0 0x7f889c0cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:29.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.905+0000 7f88a3c51640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f889c15f680 con 0x7f889c0d26f0 2024-05-14T14:40:29.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.905+0000 7f88a3c51640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f889c15f500 con 0x7f889c15f0f0 2024-05-14T14:40:29.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.905+0000 7f88a3c51640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f889c0cec40 con 0x7f889c072fd0 2024-05-14T14:40:29.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.905+0000 7f88a11ec640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f889c0d26f0 0x7f889c1fa650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:29.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.905+0000 7f88a11ec640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f889c0d26f0 0x7f889c1fa650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48028/0 (socket says 172.21.15.39:48028) 2024-05-14T14:40:29.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.905+0000 7f88a11ec640 1 -- 172.21.15.39:0/2675966763 learned_addr learned my addr 172.21.15.39:0/2675966763 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:29.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.906+0000 7f88a21ee640 1 --2- 172.21.15.39:0/2675966763 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f889c15f0f0 0x7f889c0cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:29.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.906+0000 7f88a19ed640 1 --2- 172.21.15.39:0/2675966763 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f889c072fd0 0x7f889c14f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:29.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.906+0000 7f88a11ec640 1 -- 172.21.15.39:0/2675966763 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f889c072fd0 msgr2=0x7f889c14f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:29.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.906+0000 7f88a11ec640 1 --2- 172.21.15.39:0/2675966763 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f889c072fd0 0x7f889c14f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:29.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.906+0000 7f88a11ec640 1 -- 172.21.15.39:0/2675966763 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f889c15f0f0 msgr2=0x7f889c0cba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:29.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.906+0000 7f88a11ec640 1 --2- 172.21.15.39:0/2675966763 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f889c15f0f0 0x7f889c0cba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:29.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.906+0000 7f88a11ec640 1 -- 172.21.15.39:0/2675966763 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f889c1fb380 con 0x7f889c0d26f0 2024-05-14T14:40:29.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.906+0000 7f88a11ec640 1 --2- 172.21.15.39:0/2675966763 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f889c0d26f0 0x7f889c1fa650 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f889000c820 tx=0x7f889000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:29.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.906+0000 7f889a7fc640 1 -- 172.21.15.39:0/2675966763 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8890015070 con 0x7f889c0d26f0 2024-05-14T14:40:29.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.906+0000 7f889a7fc640 1 -- 172.21.15.39:0/2675966763 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8890007a30 con 0x7f889c0d26f0 2024-05-14T14:40:29.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.906+0000 7f889a7fc640 1 -- 172.21.15.39:0/2675966763 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8890007e00 con 0x7f889c0d26f0 2024-05-14T14:40:29.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.906+0000 7f88a3c51640 1 -- 172.21.15.39:0/2675966763 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f889c14f570 con 0x7f889c0d26f0 2024-05-14T14:40:29.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.906+0000 7f88a3c51640 1 -- 172.21.15.39:0/2675966763 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f889c06e640 con 0x7f889c0d26f0 2024-05-14T14:40:29.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.907+0000 7f88a3c51640 1 -- 172.21.15.39:0/2675966763 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f889c076aa0 con 0x7f889c0d26f0 2024-05-14T14:40:29.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.908+0000 7f889a7fc640 1 -- 172.21.15.39:0/2675966763 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8890018070 con 0x7f889c0d26f0 2024-05-14T14:40:29.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.909+0000 7f889a7fc640 1 --2- 172.21.15.39:0/2675966763 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f88880762d0 0x7f88880787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:29.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.909+0000 7f889a7fc640 1 -- 172.21.15.39:0/2675966763 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8890097760 con 0x7f889c0d26f0 2024-05-14T14:40:29.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.909+0000 7f88a19ed640 1 --2- 172.21.15.39:0/2675966763 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f88880762d0 0x7f88880787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:29.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.909+0000 7f88a19ed640 1 --2- 172.21.15.39:0/2675966763 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f88880762d0 0x7f88880787e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f888c033000 tx=0x7f888c009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:29.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:29.913+0000 7f889a7fc640 1 -- 172.21.15.39:0/2675966763 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8890060730 con 0x7f889c0d26f0 2024-05-14T14:40:30.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.101+0000 7f88a3c51640 1 -- 172.21.15.39:0/2675966763 --> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f889c0d1f30 con 0x7f88880762d0 2024-05-14T14:40:30.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.110+0000 7f889a7fc640 1 -- 172.21.15.39:0/2675966763 <== mgr.4105 v2:172.21.15.39:6832/498853008 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332631 (secure 0 0 0) 0x7f889c0d1f30 con 0x7f88880762d0 2024-05-14T14:40:30.098 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:40:30.100 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-05-14T14:40:30.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.113+0000 7f88a3c51640 1 -- 172.21.15.39:0/2675966763 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f88880762d0 msgr2=0x7f88880787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:30.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.113+0000 7f88a3c51640 1 --2- 172.21.15.39:0/2675966763 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f88880762d0 0x7f88880787e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f888c033000 tx=0x7f888c009000 comp rx=0 tx=0).stop 2024-05-14T14:40:30.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.113+0000 7f88a3c51640 1 -- 172.21.15.39:0/2675966763 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f889c0d26f0 msgr2=0x7f889c1fa650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:30.102 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.113+0000 7f88a3c51640 1 --2- 172.21.15.39:0/2675966763 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f889c0d26f0 0x7f889c1fa650 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f889000c820 tx=0x7f889000cce0 comp rx=0 tx=0).stop 2024-05-14T14:40:30.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.113+0000 7f88a3c51640 1 -- 172.21.15.39:0/2675966763 shutdown_connections 2024-05-14T14:40:30.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.113+0000 7f88a3c51640 1 --2- 172.21.15.39:0/2675966763 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f88880762d0 0x7f88880787e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:30.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.113+0000 7f88a3c51640 1 --2- 172.21.15.39:0/2675966763 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f889c15f0f0 0x7f889c0cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:30.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.113+0000 7f88a3c51640 1 --2- 172.21.15.39:0/2675966763 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f889c0d26f0 0x7f889c1fa650 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:30.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.113+0000 7f88a3c51640 1 --2- 172.21.15.39:0/2675966763 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f889c072fd0 0x7f889c14f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:30.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.113+0000 7f88a3c51640 1 -- 172.21.15.39:0/2675966763 >> 172.21.15.39:0/2675966763 conn(0x7f889c0d3ae0 msgr2=0x7f889c0ccdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:30.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.113+0000 7f88a3c51640 1 -- 172.21.15.39:0/2675966763 shutdown_connections 2024-05-14T14:40:30.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.113+0000 7f88a3c51640 1 -- 172.21.15.39:0/2675966763 wait complete. 2024-05-14T14:40:30.109 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-05-14T14:40:28.679154+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":308,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231880,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742840,"statfs":{"total":773094113280,"available":772856668160,"internally_reserved":0,"allocated":3284992,"data_stored":1987604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":234016308},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.688118"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353941+0000","last_change":"2024-05-14T14:40:14.954342+0000","last_active":"2024-05-14T14:40:21.353941+0000","last_peered":"2024-05-14T14:40:21.353941+0000","last_clean":"2024-05-14T14:40:21.353941+0000","last_became_active":"2024-05-14T14:40:14.954008+0000","last_became_peered":"2024-05-14T14:40:14.954008+0000","last_unstale":"2024-05-14T14:40:21.353941+0000","last_undegraded":"2024-05-14T14:40:21.353941+0000","last_fullsized":"2024-05-14T14:40:21.353941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:48:44.948315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351459+0000","last_change":"2024-05-14T14:40:15.977901+0000","last_active":"2024-05-14T14:40:21.351459+0000","last_peered":"2024-05-14T14:40:21.351459+0000","last_clean":"2024-05-14T14:40:21.351459+0000","last_became_active":"2024-05-14T14:40:15.977572+0000","last_became_peered":"2024-05-14T14:40:15.977572+0000","last_unstale":"2024-05-14T14:40:21.351459+0000","last_undegraded":"2024-05-14T14:40:21.351459+0000","last_fullsized":"2024-05-14T14:40:21.351459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:53.130907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351078+0000","last_change":"2024-05-14T14:40:20.380801+0000","last_active":"2024-05-14T14:40:21.351078+0000","last_peered":"2024-05-14T14:40:21.351078+0000","last_clean":"2024-05-14T14:40:21.351078+0000","last_became_active":"2024-05-14T14:40:20.379931+0000","last_became_peered":"2024-05-14T14:40:20.379931+0000","last_unstale":"2024-05-14T14:40:21.351078+0000","last_undegraded":"2024-05-14T14:40:21.351078+0000","last_fullsized":"2024-05-14T14:40:21.351078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:06:08.604105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351767+0000","last_change":"2024-05-14T14:40:14.951857+0000","last_active":"2024-05-14T14:40:21.351767+0000","last_peered":"2024-05-14T14:40:21.351767+0000","last_clean":"2024-05-14T14:40:21.351767+0000","last_became_active":"2024-05-14T14:40:14.951514+0000","last_became_peered":"2024-05-14T14:40:14.951514+0000","last_unstale":"2024-05-14T14:40:21.351767+0000","last_undegraded":"2024-05-14T14:40:21.351767+0000","last_fullsized":"2024-05-14T14:40:21.351767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:04:43.508873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353664+0000","last_change":"2024-05-14T14:40:15.954769+0000","last_active":"2024-05-14T14:40:21.353664+0000","last_peered":"2024-05-14T14:40:21.353664+0000","last_clean":"2024-05-14T14:40:21.353664+0000","last_became_active":"2024-05-14T14:40:15.954410+0000","last_became_peered":"2024-05-14T14:40:15.954410+0000","last_unstale":"2024-05-14T14:40:21.353664+0000","last_undegraded":"2024-05-14T14:40:21.353664+0000","last_fullsized":"2024-05-14T14:40:21.353664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:06:01.598712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351319+0000","last_change":"2024-05-14T14:40:20.012885+0000","last_active":"2024-05-14T14:40:21.351319+0000","last_peered":"2024-05-14T14:40:21.351319+0000","last_clean":"2024-05-14T14:40:21.351319+0000","last_became_active":"2024-05-14T14:40:20.012401+0000","last_became_peered":"2024-05-14T14:40:20.012401+0000","last_unstale":"2024-05-14T14:40:21.351319+0000","last_undegraded":"2024-05-14T14:40:21.351319+0000","last_fullsized":"2024-05-14T14:40:21.351319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:24:22.540721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353214+0000","last_change":"2024-05-14T14:40:14.952296+0000","last_active":"2024-05-14T14:40:21.353214+0000","last_peered":"2024-05-14T14:40:21.353214+0000","last_clean":"2024-05-14T14:40:21.353214+0000","last_became_active":"2024-05-14T14:40:14.951962+0000","last_became_peered":"2024-05-14T14:40:14.951962+0000","last_unstale":"2024-05-14T14:40:21.353214+0000","last_undegraded":"2024-05-14T14:40:21.353214+0000","last_fullsized":"2024-05-14T14:40:21.353214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:36:37.730760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006947+0000","last_change":"2024-05-14T14:40:15.952430+0000","last_active":"2024-05-14T14:40:21.006947+0000","last_peered":"2024-05-14T14:40:21.006947+0000","last_clean":"2024-05-14T14:40:21.006947+0000","last_became_active":"2024-05-14T14:40:15.952073+0000","last_became_peered":"2024-05-14T14:40:15.952073+0000","last_unstale":"2024-05-14T14:40:21.006947+0000","last_undegraded":"2024-05-14T14:40:21.006947+0000","last_fullsized":"2024-05-14T14:40:21.006947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:41:42.097310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351837+0000","last_change":"2024-05-14T14:40:20.020148+0000","last_active":"2024-05-14T14:40:21.351837+0000","last_peered":"2024-05-14T14:40:21.351837+0000","last_clean":"2024-05-14T14:40:21.351837+0000","last_became_active":"2024-05-14T14:40:20.019445+0000","last_became_peered":"2024-05-14T14:40:20.019445+0000","last_unstale":"2024-05-14T14:40:21.351837+0000","last_undegraded":"2024-05-14T14:40:21.351837+0000","last_fullsized":"2024-05-14T14:40:21.351837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:41:46.149184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352471+0000","last_change":"2024-05-14T14:40:14.952153+0000","last_active":"2024-05-14T14:40:21.352471+0000","last_peered":"2024-05-14T14:40:21.352471+0000","last_clean":"2024-05-14T14:40:21.352471+0000","last_became_active":"2024-05-14T14:40:14.951611+0000","last_became_peered":"2024-05-14T14:40:14.951611+0000","last_unstale":"2024-05-14T14:40:21.352471+0000","last_undegraded":"2024-05-14T14:40:21.352471+0000","last_fullsized":"2024-05-14T14:40:21.352471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:17:11.948081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.007527+0000","last_change":"2024-05-14T14:40:15.952403+0000","last_active":"2024-05-14T14:40:21.007527+0000","last_peered":"2024-05-14T14:40:21.007527+0000","last_clean":"2024-05-14T14:40:21.007527+0000","last_became_active":"2024-05-14T14:40:15.951977+0000","last_became_peered":"2024-05-14T14:40:15.951977+0000","last_unstale":"2024-05-14T14:40:21.007527+0000","last_undegraded":"2024-05-14T14:40:21.007527+0000","last_fullsized":"2024-05-14T14:40:21.007527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:28:34.783112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351495+0000","last_change":"2024-05-14T14:40:20.014394+0000","last_active":"2024-05-14T14:40:21.351495+0000","last_peered":"2024-05-14T14:40:21.351495+0000","last_clean":"2024-05-14T14:40:21.351495+0000","last_became_active":"2024-05-14T14:40:20.013530+0000","last_became_peered":"2024-05-14T14:40:20.013530+0000","last_unstale":"2024-05-14T14:40:21.351495+0000","last_undegraded":"2024-05-14T14:40:21.351495+0000","last_fullsized":"2024-05-14T14:40:21.351495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:43:19.242522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006074+0000","last_change":"2024-05-14T14:40:15.961488+0000","last_active":"2024-05-14T14:40:21.006074+0000","last_peered":"2024-05-14T14:40:21.006074+0000","last_clean":"2024-05-14T14:40:21.006074+0000","last_became_active":"2024-05-14T14:40:15.960660+0000","last_became_peered":"2024-05-14T14:40:15.960660+0000","last_unstale":"2024-05-14T14:40:21.006074+0000","last_undegraded":"2024-05-14T14:40:21.006074+0000","last_fullsized":"2024-05-14T14:40:21.006074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:54:04.167075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352322+0000","last_change":"2024-05-14T14:40:14.951723+0000","last_active":"2024-05-14T14:40:21.352322+0000","last_peered":"2024-05-14T14:40:21.352322+0000","last_clean":"2024-05-14T14:40:21.352322+0000","last_became_active":"2024-05-14T14:40:14.951352+0000","last_became_peered":"2024-05-14T14:40:14.951352+0000","last_unstale":"2024-05-14T14:40:21.352322+0000","last_undegraded":"2024-05-14T14:40:21.352322+0000","last_fullsized":"2024-05-14T14:40:21.352322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:07:48.920558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352736+0000","last_change":"2024-05-14T14:40:20.014226+0000","last_active":"2024-05-14T14:40:21.352736+0000","last_peered":"2024-05-14T14:40:21.352736+0000","last_clean":"2024-05-14T14:40:21.352736+0000","last_became_active":"2024-05-14T14:40:20.013489+0000","last_became_peered":"2024-05-14T14:40:20.013489+0000","last_unstale":"2024-05-14T14:40:21.352736+0000","last_undegraded":"2024-05-14T14:40:21.352736+0000","last_fullsized":"2024-05-14T14:40:21.352736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:28:38.834985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352716+0000","last_change":"2024-05-14T14:40:15.971905+0000","last_active":"2024-05-14T14:40:21.352716+0000","last_peered":"2024-05-14T14:40:21.352716+0000","last_clean":"2024-05-14T14:40:21.352716+0000","last_became_active":"2024-05-14T14:40:15.971131+0000","last_became_peered":"2024-05-14T14:40:15.971131+0000","last_unstale":"2024-05-14T14:40:21.352716+0000","last_undegraded":"2024-05-14T14:40:21.352716+0000","last_fullsized":"2024-05-14T14:40:21.352716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:43:15.190648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353431+0000","last_change":"2024-05-14T14:40:14.948435+0000","last_active":"2024-05-14T14:40:21.353431+0000","last_peered":"2024-05-14T14:40:21.353431+0000","last_clean":"2024-05-14T14:40:21.353431+0000","last_became_active":"2024-05-14T14:40:14.948096+0000","last_became_peered":"2024-05-14T14:40:14.948096+0000","last_unstale":"2024-05-14T14:40:21.353431+0000","last_undegraded":"2024-05-14T14:40:21.353431+0000","last_fullsized":"2024-05-14T14:40:21.353431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:30:28.647287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351533+0000","last_change":"2024-05-14T14:40:20.019546+0000","last_active":"2024-05-14T14:40:21.351533+0000","last_peered":"2024-05-14T14:40:21.351533+0000","last_clean":"2024-05-14T14:40:21.351533+0000","last_became_active":"2024-05-14T14:40:20.019087+0000","last_became_peered":"2024-05-14T14:40:20.019087+0000","last_unstale":"2024-05-14T14:40:21.351533+0000","last_undegraded":"2024-05-14T14:40:21.351533+0000","last_fullsized":"2024-05-14T14:40:21.351533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:32:25.672575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351856+0000","last_change":"2024-05-14T14:40:15.966369+0000","last_active":"2024-05-14T14:40:21.351856+0000","last_peered":"2024-05-14T14:40:21.351856+0000","last_clean":"2024-05-14T14:40:21.351856+0000","last_became_active":"2024-05-14T14:40:15.965662+0000","last_became_peered":"2024-05-14T14:40:15.965662+0000","last_unstale":"2024-05-14T14:40:21.351856+0000","last_undegraded":"2024-05-14T14:40:21.351856+0000","last_fullsized":"2024-05-14T14:40:21.351856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:23:34.578655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351349+0000","last_change":"2024-05-14T14:40:14.954350+0000","last_active":"2024-05-14T14:40:21.351349+0000","last_peered":"2024-05-14T14:40:21.351349+0000","last_clean":"2024-05-14T14:40:21.351349+0000","last_became_active":"2024-05-14T14:40:14.954046+0000","last_became_peered":"2024-05-14T14:40:14.954046+0000","last_unstale":"2024-05-14T14:40:21.351349+0000","last_undegraded":"2024-05-14T14:40:21.351349+0000","last_fullsized":"2024-05-14T14:40:21.351349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:17:11.948081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353677+0000","last_change":"2024-05-14T14:40:20.379814+0000","last_active":"2024-05-14T14:40:21.353677+0000","last_peered":"2024-05-14T14:40:21.353677+0000","last_clean":"2024-05-14T14:40:21.353677+0000","last_became_active":"2024-05-14T14:40:20.378729+0000","last_became_peered":"2024-05-14T14:40:20.378729+0000","last_unstale":"2024-05-14T14:40:21.353677+0000","last_undegraded":"2024-05-14T14:40:21.353677+0000","last_fullsized":"2024-05-14T14:40:21.353677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:36:41.517853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352411+0000","last_change":"2024-05-14T14:40:15.961572+0000","last_active":"2024-05-14T14:40:21.352411+0000","last_peered":"2024-05-14T14:40:21.352411+0000","last_clean":"2024-05-14T14:40:21.352411+0000","last_became_active":"2024-05-14T14:40:15.961236+0000","last_became_peered":"2024-05-14T14:40:15.961236+0000","last_unstale":"2024-05-14T14:40:21.352411+0000","last_undegraded":"2024-05-14T14:40:21.352411+0000","last_fullsized":"2024-05-14T14:40:21.352411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:30:29.652957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351393+0000","last_change":"2024-05-14T14:40:14.952977+0000","last_active":"2024-05-14T14:40:21.351393+0000","last_peered":"2024-05-14T14:40:21.351393+0000","last_clean":"2024-05-14T14:40:21.351393+0000","last_became_active":"2024-05-14T14:40:14.952638+0000","last_became_peered":"2024-05-14T14:40:14.952638+0000","last_unstale":"2024-05-14T14:40:21.351393+0000","last_undegraded":"2024-05-14T14:40:21.351393+0000","last_fullsized":"2024-05-14T14:40:21.351393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:30:28.647287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353054+0000","last_change":"2024-05-14T14:40:20.019116+0000","last_active":"2024-05-14T14:40:21.353054+0000","last_peered":"2024-05-14T14:40:21.353054+0000","last_clean":"2024-05-14T14:40:21.353054+0000","last_became_active":"2024-05-14T14:40:20.018572+0000","last_became_peered":"2024-05-14T14:40:20.018572+0000","last_unstale":"2024-05-14T14:40:21.353054+0000","last_undegraded":"2024-05-14T14:40:21.353054+0000","last_fullsized":"2024-05-14T14:40:21.353054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:01:01.849694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353666+0000","last_change":"2024-05-14T14:40:15.968343+0000","last_active":"2024-05-14T14:40:21.353666+0000","last_peered":"2024-05-14T14:40:21.353666+0000","last_clean":"2024-05-14T14:40:21.353666+0000","last_became_active":"2024-05-14T14:40:15.967789+0000","last_became_peered":"2024-05-14T14:40:15.967789+0000","last_unstale":"2024-05-14T14:40:21.353666+0000","last_undegraded":"2024-05-14T14:40:21.353666+0000","last_fullsized":"2024-05-14T14:40:21.353666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:53.130907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.007066+0000","last_change":"2024-05-14T14:40:14.949732+0000","last_active":"2024-05-14T14:40:21.007066+0000","last_peered":"2024-05-14T14:40:21.007066+0000","last_clean":"2024-05-14T14:40:21.007066+0000","last_became_active":"2024-05-14T14:40:14.949224+0000","last_became_peered":"2024-05-14T14:40:14.949224+0000","last_unstale":"2024-05-14T14:40:21.007066+0000","last_undegraded":"2024-05-14T14:40:21.007066+0000","last_fullsized":"2024-05-14T14:40:21.007066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:30:28.647287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351359+0000","last_change":"2024-05-14T14:40:20.374754+0000","last_active":"2024-05-14T14:40:21.351359+0000","last_peered":"2024-05-14T14:40:21.351359+0000","last_clean":"2024-05-14T14:40:21.351359+0000","last_became_active":"2024-05-14T14:40:20.373425+0000","last_became_peered":"2024-05-14T14:40:20.373425+0000","last_unstale":"2024-05-14T14:40:21.351359+0000","last_undegraded":"2024-05-14T14:40:21.351359+0000","last_fullsized":"2024-05-14T14:40:21.351359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:59:59.076038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352304+0000","last_change":"2024-05-14T14:40:15.971052+0000","last_active":"2024-05-14T14:40:21.352304+0000","last_peered":"2024-05-14T14:40:21.352304+0000","last_clean":"2024-05-14T14:40:21.352304+0000","last_became_active":"2024-05-14T14:40:15.970626+0000","last_became_peered":"2024-05-14T14:40:15.970626+0000","last_unstale":"2024-05-14T14:40:21.352304+0000","last_undegraded":"2024-05-14T14:40:21.352304+0000","last_fullsized":"2024-05-14T14:40:21.352304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:24:18.488847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353001+0000","last_change":"2024-05-14T14:40:14.945387+0000","last_active":"2024-05-14T14:40:21.353001+0000","last_peered":"2024-05-14T14:40:21.353001+0000","last_clean":"2024-05-14T14:40:21.353001+0000","last_became_active":"2024-05-14T14:40:14.945047+0000","last_became_peered":"2024-05-14T14:40:14.945047+0000","last_unstale":"2024-05-14T14:40:21.353001+0000","last_undegraded":"2024-05-14T14:40:21.353001+0000","last_fullsized":"2024-05-14T14:40:21.353001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:03:50.412968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351995+0000","last_change":"2024-05-14T14:40:20.378427+0000","last_active":"2024-05-14T14:40:21.351995+0000","last_peered":"2024-05-14T14:40:21.351995+0000","last_clean":"2024-05-14T14:40:21.351995+0000","last_became_active":"2024-05-14T14:40:20.377986+0000","last_became_peered":"2024-05-14T14:40:20.377986+0000","last_unstale":"2024-05-14T14:40:21.351995+0000","last_undegraded":"2024-05-14T14:40:21.351995+0000","last_fullsized":"2024-05-14T14:40:21.351995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:43:06.799558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353676+0000","last_change":"2024-05-14T14:40:15.961279+0000","last_active":"2024-05-14T14:40:21.353676+0000","last_peered":"2024-05-14T14:40:21.353676+0000","last_clean":"2024-05-14T14:40:21.353676+0000","last_became_active":"2024-05-14T14:40:15.960895+0000","last_became_peered":"2024-05-14T14:40:15.960895+0000","last_unstale":"2024-05-14T14:40:21.353676+0000","last_undegraded":"2024-05-14T14:40:21.353676+0000","last_fullsized":"2024-05-14T14:40:21.353676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:59:55.024165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353350+0000","last_change":"2024-05-14T14:40:14.952912+0000","last_active":"2024-05-14T14:40:21.353350+0000","last_peered":"2024-05-14T14:40:21.353350+0000","last_clean":"2024-05-14T14:40:21.353350+0000","last_became_active":"2024-05-14T14:40:14.952548+0000","last_became_peered":"2024-05-14T14:40:14.952548+0000","last_unstale":"2024-05-14T14:40:21.353350+0000","last_undegraded":"2024-05-14T14:40:21.353350+0000","last_fullsized":"2024-05-14T14:40:21.353350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:50:00.234669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352297+0000","last_change":"2024-05-14T14:40:20.372845+0000","last_active":"2024-05-14T14:40:21.352297+0000","last_peered":"2024-05-14T14:40:21.352297+0000","last_clean":"2024-05-14T14:40:21.352297+0000","last_became_active":"2024-05-14T14:40:20.372340+0000","last_became_peered":"2024-05-14T14:40:20.372340+0000","last_unstale":"2024-05-14T14:40:21.352297+0000","last_undegraded":"2024-05-14T14:40:21.352297+0000","last_fullsized":"2024-05-14T14:40:21.352297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:28:38.834985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.007718+0000","last_change":"2024-05-14T14:40:15.976323+0000","last_active":"2024-05-14T14:40:21.007718+0000","last_peered":"2024-05-14T14:40:21.007718+0000","last_clean":"2024-05-14T14:40:21.007718+0000","last_became_active":"2024-05-14T14:40:15.975931+0000","last_became_peered":"2024-05-14T14:40:15.975931+0000","last_unstale":"2024-05-14T14:40:21.007718+0000","last_undegraded":"2024-05-14T14:40:21.007718+0000","last_fullsized":"2024-05-14T14:40:21.007718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:00:58.953906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353806+0000","last_change":"2024-05-14T14:40:14.954043+0000","last_active":"2024-05-14T14:40:21.353806+0000","last_peered":"2024-05-14T14:40:21.353806+0000","last_clean":"2024-05-14T14:40:21.353806+0000","last_became_active":"2024-05-14T14:40:14.953734+0000","last_became_peered":"2024-05-14T14:40:14.953734+0000","last_unstale":"2024-05-14T14:40:21.353806+0000","last_undegraded":"2024-05-14T14:40:21.353806+0000","last_fullsized":"2024-05-14T14:40:21.353806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:42:43.352565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351130+0000","last_change":"2024-05-14T14:40:20.015959+0000","last_active":"2024-05-14T14:40:21.351130+0000","last_peered":"2024-05-14T14:40:21.351130+0000","last_clean":"2024-05-14T14:40:21.351130+0000","last_became_active":"2024-05-14T14:40:20.015515+0000","last_became_peered":"2024-05-14T14:40:20.015515+0000","last_unstale":"2024-05-14T14:40:21.351130+0000","last_undegraded":"2024-05-14T14:40:21.351130+0000","last_fullsized":"2024-05-14T14:40:21.351130+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:01:01.849694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352393+0000","last_change":"2024-05-14T14:40:15.950703+0000","last_active":"2024-05-14T14:40:21.352393+0000","last_peered":"2024-05-14T14:40:21.352393+0000","last_clean":"2024-05-14T14:40:21.352393+0000","last_became_active":"2024-05-14T14:40:15.950367+0000","last_became_peered":"2024-05-14T14:40:15.950367+0000","last_unstale":"2024-05-14T14:40:21.352393+0000","last_undegraded":"2024-05-14T14:40:21.352393+0000","last_fullsized":"2024-05-14T14:40:21.352393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:22:55.057837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006627+0000","last_change":"2024-05-14T14:40:14.942269+0000","last_active":"2024-05-14T14:40:21.006627+0000","last_peered":"2024-05-14T14:40:21.006627+0000","last_clean":"2024-05-14T14:40:21.006627+0000","last_became_active":"2024-05-14T14:40:14.941907+0000","last_became_peered":"2024-05-14T14:40:14.941907+0000","last_unstale":"2024-05-14T14:40:21.006627+0000","last_undegraded":"2024-05-14T14:40:21.006627+0000","last_fullsized":"2024-05-14T14:40:21.006627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:22:54.052167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353476+0000","last_change":"2024-05-14T14:40:20.021170+0000","last_active":"2024-05-14T14:40:21.353476+0000","last_peered":"2024-05-14T14:40:21.353476+0000","last_clean":"2024-05-14T14:40:21.353476+0000","last_became_active":"2024-05-14T14:40:20.019417+0000","last_became_peered":"2024-05-14T14:40:20.019417+0000","last_unstale":"2024-05-14T14:40:21.353476+0000","last_undegraded":"2024-05-14T14:40:21.353476+0000","last_fullsized":"2024-05-14T14:40:21.353476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:55:00.709986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351519+0000","last_change":"2024-05-14T14:40:15.962249+0000","last_active":"2024-05-14T14:40:21.351519+0000","last_peered":"2024-05-14T14:40:21.351519+0000","last_clean":"2024-05-14T14:40:21.351519+0000","last_became_active":"2024-05-14T14:40:15.961914+0000","last_became_peered":"2024-05-14T14:40:15.961914+0000","last_unstale":"2024-05-14T14:40:21.351519+0000","last_undegraded":"2024-05-14T14:40:21.351519+0000","last_fullsized":"2024-05-14T14:40:21.351519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:16:59.783346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.004576+0000","last_change":"2024-05-14T14:40:14.945511+0000","last_active":"2024-05-14T14:40:21.004576+0000","last_peered":"2024-05-14T14:40:21.004576+0000","last_clean":"2024-05-14T14:40:21.004576+0000","last_became_active":"2024-05-14T14:40:14.945162+0000","last_became_peered":"2024-05-14T14:40:14.945162+0000","last_unstale":"2024-05-14T14:40:21.004576+0000","last_undegraded":"2024-05-14T14:40:21.004576+0000","last_fullsized":"2024-05-14T14:40:21.004576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:03:50.412968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353899+0000","last_change":"2024-05-14T14:40:20.021422+0000","last_active":"2024-05-14T14:40:21.353899+0000","last_peered":"2024-05-14T14:40:21.353899+0000","last_clean":"2024-05-14T14:40:21.353899+0000","last_became_active":"2024-05-14T14:40:20.020363+0000","last_became_peered":"2024-05-14T14:40:20.020363+0000","last_unstale":"2024-05-14T14:40:21.353899+0000","last_undegraded":"2024-05-14T14:40:21.353899+0000","last_fullsized":"2024-05-14T14:40:21.353899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:09:34.037991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351255+0000","last_change":"2024-05-14T14:40:15.956227+0000","last_active":"2024-05-14T14:40:21.351255+0000","last_peered":"2024-05-14T14:40:21.351255+0000","last_clean":"2024-05-14T14:40:21.351255+0000","last_became_active":"2024-05-14T14:40:15.955850+0000","last_became_peered":"2024-05-14T14:40:15.955850+0000","last_unstale":"2024-05-14T14:40:21.351255+0000","last_undegraded":"2024-05-14T14:40:21.351255+0000","last_fullsized":"2024-05-14T14:40:21.351255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:19:45.703395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351460+0000","last_change":"2024-05-14T14:40:14.953611+0000","last_active":"2024-05-14T14:40:21.351460+0000","last_peered":"2024-05-14T14:40:21.351460+0000","last_clean":"2024-05-14T14:40:21.351460+0000","last_became_active":"2024-05-14T14:40:14.953288+0000","last_became_peered":"2024-05-14T14:40:14.953288+0000","last_unstale":"2024-05-14T14:40:21.351460+0000","last_undegraded":"2024-05-14T14:40:21.351460+0000","last_fullsized":"2024-05-14T14:40:21.351460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:22:54.052167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353571+0000","last_change":"2024-05-14T14:40:20.372908+0000","last_active":"2024-05-14T14:40:21.353571+0000","last_peered":"2024-05-14T14:40:21.353571+0000","last_clean":"2024-05-14T14:40:21.353571+0000","last_became_active":"2024-05-14T14:40:20.372440+0000","last_became_peered":"2024-05-14T14:40:20.372440+0000","last_unstale":"2024-05-14T14:40:21.353571+0000","last_undegraded":"2024-05-14T14:40:21.353571+0000","last_fullsized":"2024-05-14T14:40:21.353571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:36:41.517853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352312+0000","last_change":"2024-05-14T14:40:15.978286+0000","last_active":"2024-05-14T14:40:21.352312+0000","last_peered":"2024-05-14T14:40:21.352312+0000","last_clean":"2024-05-14T14:40:21.352312+0000","last_became_active":"2024-05-14T14:40:15.977864+0000","last_became_peered":"2024-05-14T14:40:15.977864+0000","last_unstale":"2024-05-14T14:40:21.352312+0000","last_undegraded":"2024-05-14T14:40:21.352312+0000","last_fullsized":"2024-05-14T14:40:21.352312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:16:59.783346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.005670+0000","last_change":"2024-05-14T14:40:14.939289+0000","last_active":"2024-05-14T14:40:21.005670+0000","last_peered":"2024-05-14T14:40:21.005670+0000","last_clean":"2024-05-14T14:40:21.005670+0000","last_became_active":"2024-05-14T14:40:14.938761+0000","last_became_peered":"2024-05-14T14:40:14.938761+0000","last_unstale":"2024-05-14T14:40:21.005670+0000","last_undegraded":"2024-05-14T14:40:21.005670+0000","last_fullsized":"2024-05-14T14:40:21.005670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:09:41.002376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":118,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351602+0000","last_change":"2024-05-14T14:40:06.302050+0000","last_active":"2024-05-14T14:40:21.351602+0000","last_peered":"2024-05-14T14:40:21.351602+0000","last_clean":"2024-05-14T14:40:21.351602+0000","last_became_active":"2024-05-14T14:40:06.300956+0000","last_became_peered":"2024-05-14T14:40:06.300956+0000","last_unstale":"2024-05-14T14:40:21.351602+0000","last_undegraded":"2024-05-14T14:40:21.351602+0000","last_fullsized":"2024-05-14T14:40:21.351602+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:04.850996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:04.850996+0000","last_clean_scrub_stamp":"2024-05-14T14:40:04.850996+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:08:41.028114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006296+0000","last_change":"2024-05-14T14:40:20.378549+0000","last_active":"2024-05-14T14:40:21.006296+0000","last_peered":"2024-05-14T14:40:21.006296+0000","last_clean":"2024-05-14T14:40:21.006296+0000","last_became_active":"2024-05-14T14:40:20.377998+0000","last_became_peered":"2024-05-14T14:40:20.377998+0000","last_unstale":"2024-05-14T14:40:21.006296+0000","last_undegraded":"2024-05-14T14:40:21.006296+0000","last_fullsized":"2024-05-14T14:40:21.006296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:01:01.849694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353100+0000","last_change":"2024-05-14T14:40:15.976278+0000","last_active":"2024-05-14T14:40:21.353100+0000","last_peered":"2024-05-14T14:40:21.353100+0000","last_clean":"2024-05-14T14:40:21.353100+0000","last_became_active":"2024-05-14T14:40:15.975906+0000","last_became_peered":"2024-05-14T14:40:15.975906+0000","last_unstale":"2024-05-14T14:40:21.353100+0000","last_undegraded":"2024-05-14T14:40:21.353100+0000","last_fullsized":"2024-05-14T14:40:21.353100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:41:42.097310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.004906+0000","last_change":"2024-05-14T14:40:14.949811+0000","last_active":"2024-05-14T14:40:21.004906+0000","last_peered":"2024-05-14T14:40:21.004906+0000","last_clean":"2024-05-14T14:40:21.004906+0000","last_became_active":"2024-05-14T14:40:14.949472+0000","last_became_peered":"2024-05-14T14:40:14.949472+0000","last_unstale":"2024-05-14T14:40:21.004906+0000","last_undegraded":"2024-05-14T14:40:21.004906+0000","last_fullsized":"2024-05-14T14:40:21.004906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:09:41.002376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.005991+0000","last_change":"2024-05-14T14:40:20.372940+0000","last_active":"2024-05-14T14:40:21.005991+0000","last_peered":"2024-05-14T14:40:21.005991+0000","last_clean":"2024-05-14T14:40:21.005991+0000","last_became_active":"2024-05-14T14:40:20.372407+0000","last_became_peered":"2024-05-14T14:40:20.372407+0000","last_unstale":"2024-05-14T14:40:21.005991+0000","last_undegraded":"2024-05-14T14:40:21.005991+0000","last_fullsized":"2024-05-14T14:40:21.005991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:28:38.834985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.007082+0000","last_change":"2024-05-14T14:40:15.972277+0000","last_active":"2024-05-14T14:40:21.007082+0000","last_peered":"2024-05-14T14:40:21.007082+0000","last_clean":"2024-05-14T14:40:21.007082+0000","last_became_active":"2024-05-14T14:40:15.971952+0000","last_became_peered":"2024-05-14T14:40:15.971952+0000","last_unstale":"2024-05-14T14:40:21.007082+0000","last_undegraded":"2024-05-14T14:40:21.007082+0000","last_fullsized":"2024-05-14T14:40:21.007082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:00:57.797820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352274+0000","last_change":"2024-05-14T14:40:14.940215+0000","last_active":"2024-05-14T14:40:21.352274+0000","last_peered":"2024-05-14T14:40:21.352274+0000","last_clean":"2024-05-14T14:40:21.352274+0000","last_became_active":"2024-05-14T14:40:14.939878+0000","last_became_peered":"2024-05-14T14:40:14.939878+0000","last_unstale":"2024-05-14T14:40:21.352274+0000","last_undegraded":"2024-05-14T14:40:21.352274+0000","last_fullsized":"2024-05-14T14:40:21.352274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:36:37.730760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352612+0000","last_change":"2024-05-14T14:40:20.022658+0000","last_active":"2024-05-14T14:40:21.352612+0000","last_peered":"2024-05-14T14:40:21.352612+0000","last_clean":"2024-05-14T14:40:21.352612+0000","last_became_active":"2024-05-14T14:40:20.022176+0000","last_became_peered":"2024-05-14T14:40:20.022176+0000","last_unstale":"2024-05-14T14:40:21.352612+0000","last_undegraded":"2024-05-14T14:40:21.352612+0000","last_fullsized":"2024-05-14T14:40:21.352612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:01:01.849694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352973+0000","last_change":"2024-05-14T14:40:15.973870+0000","last_active":"2024-05-14T14:40:21.352973+0000","last_peered":"2024-05-14T14:40:21.352973+0000","last_clean":"2024-05-14T14:40:21.352973+0000","last_became_active":"2024-05-14T14:40:15.973324+0000","last_became_peered":"2024-05-14T14:40:15.973324+0000","last_unstale":"2024-05-14T14:40:21.352973+0000","last_undegraded":"2024-05-14T14:40:21.352973+0000","last_fullsized":"2024-05-14T14:40:21.352973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:19:26.250841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.004828+0000","last_change":"2024-05-14T14:40:14.942944+0000","last_active":"2024-05-14T14:40:21.004828+0000","last_peered":"2024-05-14T14:40:21.004828+0000","last_clean":"2024-05-14T14:40:21.004828+0000","last_became_active":"2024-05-14T14:40:14.942604+0000","last_became_peered":"2024-05-14T14:40:14.942604+0000","last_unstale":"2024-05-14T14:40:21.004828+0000","last_undegraded":"2024-05-14T14:40:21.004828+0000","last_fullsized":"2024-05-14T14:40:21.004828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:42:43.352565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.005290+0000","last_change":"2024-05-14T14:40:20.373005+0000","last_active":"2024-05-14T14:40:21.005290+0000","last_peered":"2024-05-14T14:40:21.005290+0000","last_clean":"2024-05-14T14:40:21.005290+0000","last_became_active":"2024-05-14T14:40:20.372502+0000","last_became_peered":"2024-05-14T14:40:20.372502+0000","last_unstale":"2024-05-14T14:40:21.005290+0000","last_undegraded":"2024-05-14T14:40:21.005290+0000","last_fullsized":"2024-05-14T14:40:21.005290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:43:06.799558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352729+0000","last_change":"2024-05-14T14:40:15.978754+0000","last_active":"2024-05-14T14:40:21.352729+0000","last_peered":"2024-05-14T14:40:21.352729+0000","last_clean":"2024-05-14T14:40:21.352729+0000","last_became_active":"2024-05-14T14:40:15.978406+0000","last_became_peered":"2024-05-14T14:40:15.978406+0000","last_unstale":"2024-05-14T14:40:21.352729+0000","last_undegraded":"2024-05-14T14:40:21.352729+0000","last_fullsized":"2024-05-14T14:40:21.352729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:00:58.953906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352912+0000","last_change":"2024-05-14T14:40:14.950699+0000","last_active":"2024-05-14T14:40:21.352912+0000","last_peered":"2024-05-14T14:40:21.352912+0000","last_clean":"2024-05-14T14:40:21.352912+0000","last_became_active":"2024-05-14T14:40:14.950333+0000","last_became_peered":"2024-05-14T14:40:14.950333+0000","last_unstale":"2024-05-14T14:40:21.352912+0000","last_undegraded":"2024-05-14T14:40:21.352912+0000","last_fullsized":"2024-05-14T14:40:21.352912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:59:30.772720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351835+0000","last_change":"2024-05-14T14:40:20.019464+0000","last_active":"2024-05-14T14:40:21.351835+0000","last_peered":"2024-05-14T14:40:21.351835+0000","last_clean":"2024-05-14T14:40:21.351835+0000","last_became_active":"2024-05-14T14:40:20.018546+0000","last_became_peered":"2024-05-14T14:40:20.018546+0000","last_unstale":"2024-05-14T14:40:21.351835+0000","last_undegraded":"2024-05-14T14:40:21.351835+0000","last_fullsized":"2024-05-14T14:40:21.351835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:58:53.100702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352000+0000","last_change":"2024-05-14T14:40:15.979685+0000","last_active":"2024-05-14T14:40:21.352000+0000","last_peered":"2024-05-14T14:40:21.352000+0000","last_clean":"2024-05-14T14:40:21.352000+0000","last_became_active":"2024-05-14T14:40:15.979324+0000","last_became_peered":"2024-05-14T14:40:15.979324+0000","last_unstale":"2024-05-14T14:40:21.352000+0000","last_undegraded":"2024-05-14T14:40:21.352000+0000","last_fullsized":"2024-05-14T14:40:21.352000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:43:15.190648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.004331+0000","last_change":"2024-05-14T14:40:14.940764+0000","last_active":"2024-05-14T14:40:21.004331+0000","last_peered":"2024-05-14T14:40:21.004331+0000","last_clean":"2024-05-14T14:40:21.004331+0000","last_became_active":"2024-05-14T14:40:14.940412+0000","last_became_peered":"2024-05-14T14:40:14.940412+0000","last_unstale":"2024-05-14T14:40:21.004331+0000","last_undegraded":"2024-05-14T14:40:21.004331+0000","last_fullsized":"2024-05-14T14:40:21.004331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:04:43.508873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353379+0000","last_change":"2024-05-14T14:40:20.019451+0000","last_active":"2024-05-14T14:40:21.353379+0000","last_peered":"2024-05-14T14:40:21.353379+0000","last_clean":"2024-05-14T14:40:21.353379+0000","last_became_active":"2024-05-14T14:40:20.018790+0000","last_became_peered":"2024-05-14T14:40:20.018790+0000","last_unstale":"2024-05-14T14:40:21.353379+0000","last_undegraded":"2024-05-14T14:40:21.353379+0000","last_fullsized":"2024-05-14T14:40:21.353379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:55:00.709986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.005590+0000","last_change":"2024-05-14T14:40:15.967830+0000","last_active":"2024-05-14T14:40:21.005590+0000","last_peered":"2024-05-14T14:40:21.005590+0000","last_clean":"2024-05-14T14:40:21.005590+0000","last_became_active":"2024-05-14T14:40:15.967508+0000","last_became_peered":"2024-05-14T14:40:15.967508+0000","last_unstale":"2024-05-14T14:40:21.005590+0000","last_undegraded":"2024-05-14T14:40:21.005590+0000","last_fullsized":"2024-05-14T14:40:21.005590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:06:01.598712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006580+0000","last_change":"2024-05-14T14:40:14.940313+0000","last_active":"2024-05-14T14:40:21.006580+0000","last_peered":"2024-05-14T14:40:21.006580+0000","last_clean":"2024-05-14T14:40:21.006580+0000","last_became_active":"2024-05-14T14:40:14.939989+0000","last_became_peered":"2024-05-14T14:40:14.939989+0000","last_unstale":"2024-05-14T14:40:21.006580+0000","last_undegraded":"2024-05-14T14:40:21.006580+0000","last_fullsized":"2024-05-14T14:40:21.006580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:09:41.002376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352073+0000","last_change":"2024-05-14T14:40:20.379270+0000","last_active":"2024-05-14T14:40:21.352073+0000","last_peered":"2024-05-14T14:40:21.352073+0000","last_clean":"2024-05-14T14:40:21.352073+0000","last_became_active":"2024-05-14T14:40:20.378163+0000","last_became_peered":"2024-05-14T14:40:20.378163+0000","last_unstale":"2024-05-14T14:40:21.352073+0000","last_undegraded":"2024-05-14T14:40:21.352073+0000","last_fullsized":"2024-05-14T14:40:21.352073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:56:23.335268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352261+0000","last_change":"2024-05-14T14:40:15.979702+0000","last_active":"2024-05-14T14:40:21.352261+0000","last_peered":"2024-05-14T14:40:21.352261+0000","last_clean":"2024-05-14T14:40:21.352261+0000","last_became_active":"2024-05-14T14:40:15.978801+0000","last_became_peered":"2024-05-14T14:40:15.978801+0000","last_unstale":"2024-05-14T14:40:21.352261+0000","last_undegraded":"2024-05-14T14:40:21.352261+0000","last_fullsized":"2024-05-14T14:40:21.352261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:28:34.783112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006507+0000","last_change":"2024-05-14T14:40:14.946153+0000","last_active":"2024-05-14T14:40:21.006507+0000","last_peered":"2024-05-14T14:40:21.006507+0000","last_clean":"2024-05-14T14:40:21.006507+0000","last_became_active":"2024-05-14T14:40:14.945598+0000","last_became_peered":"2024-05-14T14:40:14.945598+0000","last_unstale":"2024-05-14T14:40:21.006507+0000","last_undegraded":"2024-05-14T14:40:21.006507+0000","last_fullsized":"2024-05-14T14:40:21.006507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:30:28.647287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352265+0000","last_change":"2024-05-14T14:40:20.373021+0000","last_active":"2024-05-14T14:40:21.352265+0000","last_peered":"2024-05-14T14:40:21.352265+0000","last_clean":"2024-05-14T14:40:21.352265+0000","last_became_active":"2024-05-14T14:40:20.372611+0000","last_became_peered":"2024-05-14T14:40:20.372611+0000","last_unstale":"2024-05-14T14:40:21.352265+0000","last_undegraded":"2024-05-14T14:40:21.352265+0000","last_fullsized":"2024-05-14T14:40:21.352265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:20:04.831495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352027+0000","last_change":"2024-05-14T14:40:15.963419+0000","last_active":"2024-05-14T14:40:21.352027+0000","last_peered":"2024-05-14T14:40:21.352027+0000","last_clean":"2024-05-14T14:40:21.352027+0000","last_became_active":"2024-05-14T14:40:15.963015+0000","last_became_peered":"2024-05-14T14:40:15.963015+0000","last_unstale":"2024-05-14T14:40:21.352027+0000","last_undegraded":"2024-05-14T14:40:21.352027+0000","last_fullsized":"2024-05-14T14:40:21.352027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:02:28.598796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353002+0000","last_change":"2024-05-14T14:40:14.950887+0000","last_active":"2024-05-14T14:40:21.353002+0000","last_peered":"2024-05-14T14:40:21.353002+0000","last_clean":"2024-05-14T14:40:21.353002+0000","last_became_active":"2024-05-14T14:40:14.950546+0000","last_became_peered":"2024-05-14T14:40:14.950546+0000","last_unstale":"2024-05-14T14:40:21.353002+0000","last_undegraded":"2024-05-14T14:40:21.353002+0000","last_fullsized":"2024-05-14T14:40:21.353002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:15:53.584304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.007527+0000","last_change":"2024-05-14T14:40:20.378686+0000","last_active":"2024-05-14T14:40:21.007527+0000","last_peered":"2024-05-14T14:40:21.007527+0000","last_clean":"2024-05-14T14:40:21.007527+0000","last_became_active":"2024-05-14T14:40:20.378123+0000","last_became_peered":"2024-05-14T14:40:20.378123+0000","last_unstale":"2024-05-14T14:40:21.007527+0000","last_undegraded":"2024-05-14T14:40:21.007527+0000","last_fullsized":"2024-05-14T14:40:21.007527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:56:23.335268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352960+0000","last_change":"2024-05-14T14:40:15.973748+0000","last_active":"2024-05-14T14:40:21.352960+0000","last_peered":"2024-05-14T14:40:21.352960+0000","last_clean":"2024-05-14T14:40:21.352960+0000","last_became_active":"2024-05-14T14:40:15.972604+0000","last_became_peered":"2024-05-14T14:40:15.972604+0000","last_unstale":"2024-05-14T14:40:21.352960+0000","last_undegraded":"2024-05-14T14:40:21.352960+0000","last_fullsized":"2024-05-14T14:40:21.352960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:00:57.797820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006767+0000","last_change":"2024-05-14T14:40:14.953883+0000","last_active":"2024-05-14T14:40:21.006767+0000","last_peered":"2024-05-14T14:40:21.006767+0000","last_clean":"2024-05-14T14:40:21.006767+0000","last_became_active":"2024-05-14T14:40:14.953540+0000","last_became_peered":"2024-05-14T14:40:14.953540+0000","last_unstale":"2024-05-14T14:40:21.006767+0000","last_undegraded":"2024-05-14T14:40:21.006767+0000","last_fullsized":"2024-05-14T14:40:21.006767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:22:54.052167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353319+0000","last_change":"2024-05-14T14:40:20.017238+0000","last_active":"2024-05-14T14:40:21.353319+0000","last_peered":"2024-05-14T14:40:21.353319+0000","last_clean":"2024-05-14T14:40:21.353319+0000","last_became_active":"2024-05-14T14:40:20.016725+0000","last_became_peered":"2024-05-14T14:40:20.016725+0000","last_unstale":"2024-05-14T14:40:21.353319+0000","last_undegraded":"2024-05-14T14:40:21.353319+0000","last_fullsized":"2024-05-14T14:40:21.353319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:01:03.005779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352553+0000","last_change":"2024-05-14T14:40:15.965371+0000","last_active":"2024-05-14T14:40:21.352553+0000","last_peered":"2024-05-14T14:40:21.352553+0000","last_clean":"2024-05-14T14:40:21.352553+0000","last_became_active":"2024-05-14T14:40:15.964988+0000","last_became_peered":"2024-05-14T14:40:15.964988+0000","last_unstale":"2024-05-14T14:40:21.352553+0000","last_undegraded":"2024-05-14T14:40:21.352553+0000","last_fullsized":"2024-05-14T14:40:21.352553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:17:12.953751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352156+0000","last_change":"2024-05-14T14:40:14.950270+0000","last_active":"2024-05-14T14:40:21.352156+0000","last_peered":"2024-05-14T14:40:21.352156+0000","last_clean":"2024-05-14T14:40:21.352156+0000","last_became_active":"2024-05-14T14:40:14.949473+0000","last_became_peered":"2024-05-14T14:40:14.949473+0000","last_unstale":"2024-05-14T14:40:21.352156+0000","last_undegraded":"2024-05-14T14:40:21.352156+0000","last_fullsized":"2024-05-14T14:40:21.352156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:22:54.052167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351973+0000","last_change":"2024-05-14T14:40:20.008055+0000","last_active":"2024-05-14T14:40:21.351973+0000","last_peered":"2024-05-14T14:40:21.351973+0000","last_clean":"2024-05-14T14:40:21.351973+0000","last_became_active":"2024-05-14T14:40:20.007482+0000","last_became_peered":"2024-05-14T14:40:20.007482+0000","last_unstale":"2024-05-14T14:40:21.351973+0000","last_undegraded":"2024-05-14T14:40:21.351973+0000","last_fullsized":"2024-05-14T14:40:21.351973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:20:24.893525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353866+0000","last_change":"2024-05-14T14:40:15.954872+0000","last_active":"2024-05-14T14:40:21.353866+0000","last_peered":"2024-05-14T14:40:21.353866+0000","last_clean":"2024-05-14T14:40:21.353866+0000","last_became_active":"2024-05-14T14:40:15.954475+0000","last_became_peered":"2024-05-14T14:40:15.954475+0000","last_unstale":"2024-05-14T14:40:21.353866+0000","last_undegraded":"2024-05-14T14:40:21.353866+0000","last_fullsized":"2024-05-14T14:40:21.353866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:16:59.783346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.007184+0000","last_change":"2024-05-14T14:40:14.946318+0000","last_active":"2024-05-14T14:40:21.007184+0000","last_peered":"2024-05-14T14:40:21.007184+0000","last_clean":"2024-05-14T14:40:21.007184+0000","last_became_active":"2024-05-14T14:40:14.945963+0000","last_became_peered":"2024-05-14T14:40:14.945963+0000","last_unstale":"2024-05-14T14:40:21.007184+0000","last_undegraded":"2024-05-14T14:40:21.007184+0000","last_fullsized":"2024-05-14T14:40:21.007184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:03:50.412968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351737+0000","last_change":"2024-05-14T14:40:20.012702+0000","last_active":"2024-05-14T14:40:21.351737+0000","last_peered":"2024-05-14T14:40:21.351737+0000","last_clean":"2024-05-14T14:40:21.351737+0000","last_became_active":"2024-05-14T14:40:20.012262+0000","last_became_peered":"2024-05-14T14:40:20.012262+0000","last_unstale":"2024-05-14T14:40:21.351737+0000","last_undegraded":"2024-05-14T14:40:21.351737+0000","last_fullsized":"2024-05-14T14:40:21.351737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:12:03.474411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.007052+0000","last_change":"2024-05-14T14:40:15.967089+0000","last_active":"2024-05-14T14:40:21.007052+0000","last_peered":"2024-05-14T14:40:21.007052+0000","last_clean":"2024-05-14T14:40:21.007052+0000","last_became_active":"2024-05-14T14:40:15.963492+0000","last_became_peered":"2024-05-14T14:40:15.963492+0000","last_unstale":"2024-05-14T14:40:21.007052+0000","last_undegraded":"2024-05-14T14:40:21.007052+0000","last_fullsized":"2024-05-14T14:40:21.007052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:54:56.658112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006874+0000","last_change":"2024-05-14T14:40:14.949559+0000","last_active":"2024-05-14T14:40:21.006874+0000","last_peered":"2024-05-14T14:40:21.006874+0000","last_clean":"2024-05-14T14:40:21.006874+0000","last_became_active":"2024-05-14T14:40:14.949108+0000","last_became_peered":"2024-05-14T14:40:14.949108+0000","last_unstale":"2024-05-14T14:40:21.006874+0000","last_undegraded":"2024-05-14T14:40:21.006874+0000","last_fullsized":"2024-05-14T14:40:21.006874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:03:50.412968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352199+0000","last_change":"2024-05-14T14:40:20.380409+0000","last_active":"2024-05-14T14:40:21.352199+0000","last_peered":"2024-05-14T14:40:21.352199+0000","last_clean":"2024-05-14T14:40:21.352199+0000","last_became_active":"2024-05-14T14:40:20.377982+0000","last_became_peered":"2024-05-14T14:40:20.377982+0000","last_unstale":"2024-05-14T14:40:21.352199+0000","last_undegraded":"2024-05-14T14:40:21.352199+0000","last_fullsized":"2024-05-14T14:40:21.352199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:54:43.610454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353208+0000","last_change":"2024-05-14T14:40:20.378415+0000","last_active":"2024-05-14T14:40:21.353208+0000","last_peered":"2024-05-14T14:40:21.353208+0000","last_clean":"2024-05-14T14:40:21.353208+0000","last_became_active":"2024-05-14T14:40:20.378008+0000","last_became_peered":"2024-05-14T14:40:20.378008+0000","last_unstale":"2024-05-14T14:40:21.353208+0000","last_undegraded":"2024-05-14T14:40:21.353208+0000","last_fullsized":"2024-05-14T14:40:21.353208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:01:03.005779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351155+0000","last_change":"2024-05-14T14:40:15.973814+0000","last_active":"2024-05-14T14:40:21.351155+0000","last_peered":"2024-05-14T14:40:21.351155+0000","last_clean":"2024-05-14T14:40:21.351155+0000","last_became_active":"2024-05-14T14:40:15.972930+0000","last_became_peered":"2024-05-14T14:40:15.972930+0000","last_unstale":"2024-05-14T14:40:21.351155+0000","last_undegraded":"2024-05-14T14:40:21.351155+0000","last_fullsized":"2024-05-14T14:40:21.351155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:54:04.167075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.005569+0000","last_change":"2024-05-14T14:40:14.940248+0000","last_active":"2024-05-14T14:40:21.005569+0000","last_peered":"2024-05-14T14:40:21.005569+0000","last_clean":"2024-05-14T14:40:21.005569+0000","last_became_active":"2024-05-14T14:40:14.938524+0000","last_became_peered":"2024-05-14T14:40:14.938524+0000","last_unstale":"2024-05-14T14:40:21.005569+0000","last_undegraded":"2024-05-14T14:40:21.005569+0000","last_fullsized":"2024-05-14T14:40:21.005569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:42:43.352565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006899+0000","last_change":"2024-05-14T14:40:20.017769+0000","last_active":"2024-05-14T14:40:21.006899+0000","last_peered":"2024-05-14T14:40:21.006899+0000","last_clean":"2024-05-14T14:40:21.006899+0000","last_became_active":"2024-05-14T14:40:20.017248+0000","last_became_peered":"2024-05-14T14:40:20.017248+0000","last_unstale":"2024-05-14T14:40:21.006899+0000","last_undegraded":"2024-05-14T14:40:21.006899+0000","last_fullsized":"2024-05-14T14:40:21.006899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:01:03.005779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351813+0000","last_change":"2024-05-14T14:40:15.970841+0000","last_active":"2024-05-14T14:40:21.351813+0000","last_peered":"2024-05-14T14:40:21.351813+0000","last_clean":"2024-05-14T14:40:21.351813+0000","last_became_active":"2024-05-14T14:40:15.970405+0000","last_became_peered":"2024-05-14T14:40:15.970405+0000","last_unstale":"2024-05-14T14:40:21.351813+0000","last_undegraded":"2024-05-14T14:40:21.351813+0000","last_fullsized":"2024-05-14T14:40:21.351813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:06:01.598712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351688+0000","last_change":"2024-05-14T14:40:14.952894+0000","last_active":"2024-05-14T14:40:21.351688+0000","last_peered":"2024-05-14T14:40:21.351688+0000","last_clean":"2024-05-14T14:40:21.351688+0000","last_became_active":"2024-05-14T14:40:14.952591+0000","last_became_peered":"2024-05-14T14:40:14.952591+0000","last_unstale":"2024-05-14T14:40:21.351688+0000","last_undegraded":"2024-05-14T14:40:21.351688+0000","last_fullsized":"2024-05-14T14:40:21.351688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:09:41.002376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006239+0000","last_change":"2024-05-14T14:40:14.942311+0000","last_active":"2024-05-14T14:40:21.006239+0000","last_peered":"2024-05-14T14:40:21.006239+0000","last_clean":"2024-05-14T14:40:21.006239+0000","last_became_active":"2024-05-14T14:40:14.941964+0000","last_became_peered":"2024-05-14T14:40:14.941964+0000","last_unstale":"2024-05-14T14:40:21.006239+0000","last_undegraded":"2024-05-14T14:40:21.006239+0000","last_fullsized":"2024-05-14T14:40:21.006239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:42:43.352565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352830+0000","last_change":"2024-05-14T14:40:15.955268+0000","last_active":"2024-05-14T14:40:21.352830+0000","last_peered":"2024-05-14T14:40:21.352830+0000","last_clean":"2024-05-14T14:40:21.352830+0000","last_became_active":"2024-05-14T14:40:15.954880+0000","last_became_peered":"2024-05-14T14:40:15.954880+0000","last_unstale":"2024-05-14T14:40:21.352830+0000","last_undegraded":"2024-05-14T14:40:21.352830+0000","last_fullsized":"2024-05-14T14:40:21.352830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:24:18.488847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.004720+0000","last_change":"2024-05-14T14:40:20.009663+0000","last_active":"2024-05-14T14:40:21.004720+0000","last_peered":"2024-05-14T14:40:21.004720+0000","last_clean":"2024-05-14T14:40:21.004720+0000","last_became_active":"2024-05-14T14:40:20.009220+0000","last_became_peered":"2024-05-14T14:40:20.009220+0000","last_unstale":"2024-05-14T14:40:21.004720+0000","last_undegraded":"2024-05-14T14:40:21.004720+0000","last_fullsized":"2024-05-14T14:40:21.004720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:19:49.755269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352741+0000","last_change":"2024-05-14T14:40:14.947750+0000","last_active":"2024-05-14T14:40:21.352741+0000","last_peered":"2024-05-14T14:40:21.352741+0000","last_clean":"2024-05-14T14:40:21.352741+0000","last_became_active":"2024-05-14T14:40:14.947440+0000","last_became_peered":"2024-05-14T14:40:14.947440+0000","last_unstale":"2024-05-14T14:40:21.352741+0000","last_undegraded":"2024-05-14T14:40:21.352741+0000","last_fullsized":"2024-05-14T14:40:21.352741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:48:44.948315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352347+0000","last_change":"2024-05-14T14:40:15.970419+0000","last_active":"2024-05-14T14:40:21.352347+0000","last_peered":"2024-05-14T14:40:21.352347+0000","last_clean":"2024-05-14T14:40:21.352347+0000","last_became_active":"2024-05-14T14:40:15.969621+0000","last_became_peered":"2024-05-14T14:40:15.969621+0000","last_unstale":"2024-05-14T14:40:21.352347+0000","last_undegraded":"2024-05-14T14:40:21.352347+0000","last_fullsized":"2024-05-14T14:40:21.352347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:03:51.418638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353215+0000","last_change":"2024-05-14T14:40:20.023154+0000","last_active":"2024-05-14T14:40:21.353215+0000","last_peered":"2024-05-14T14:40:21.353215+0000","last_clean":"2024-05-14T14:40:21.353215+0000","last_became_active":"2024-05-14T14:40:20.022012+0000","last_became_peered":"2024-05-14T14:40:20.022012+0000","last_unstale":"2024-05-14T14:40:21.353215+0000","last_undegraded":"2024-05-14T14:40:21.353215+0000","last_fullsized":"2024-05-14T14:40:21.353215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:52:47.149904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.005435+0000","last_change":"2024-05-14T14:40:15.968635+0000","last_active":"2024-05-14T14:40:21.005435+0000","last_peered":"2024-05-14T14:40:21.005435+0000","last_clean":"2024-05-14T14:40:21.005435+0000","last_became_active":"2024-05-14T14:40:15.968332+0000","last_became_peered":"2024-05-14T14:40:15.968332+0000","last_unstale":"2024-05-14T14:40:21.005435+0000","last_undegraded":"2024-05-14T14:40:21.005435+0000","last_fullsized":"2024-05-14T14:40:21.005435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:23:34.578655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.004351+0000","last_change":"2024-05-14T14:40:15.976612+0000","last_active":"2024-05-14T14:40:21.004351+0000","last_peered":"2024-05-14T14:40:21.004351+0000","last_clean":"2024-05-14T14:40:21.004351+0000","last_became_active":"2024-05-14T14:40:15.975536+0000","last_became_peered":"2024-05-14T14:40:15.975536+0000","last_unstale":"2024-05-14T14:40:21.004351+0000","last_undegraded":"2024-05-14T14:40:21.004351+0000","last_fullsized":"2024-05-14T14:40:21.004351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:17:12.953751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006389+0000","last_change":"2024-05-14T14:40:15.977511+0000","last_active":"2024-05-14T14:40:21.006389+0000","last_peered":"2024-05-14T14:40:21.006389+0000","last_clean":"2024-05-14T14:40:21.006389+0000","last_became_active":"2024-05-14T14:40:15.977176+0000","last_became_peered":"2024-05-14T14:40:15.977176+0000","last_unstale":"2024-05-14T14:40:21.006389+0000","last_undegraded":"2024-05-14T14:40:21.006389+0000","last_fullsized":"2024-05-14T14:40:21.006389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:32:21.620701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352721+0000","last_change":"2024-05-14T14:40:15.969442+0000","last_active":"2024-05-14T14:40:21.352721+0000","last_peered":"2024-05-14T14:40:21.352721+0000","last_clean":"2024-05-14T14:40:21.352721+0000","last_became_active":"2024-05-14T14:40:15.968989+0000","last_became_peered":"2024-05-14T14:40:15.968989+0000","last_unstale":"2024-05-14T14:40:21.352721+0000","last_undegraded":"2024-05-14T14:40:21.352721+0000","last_fullsized":"2024-05-14T14:40:21.352721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:59:55.024165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352423+0000","last_change":"2024-05-14T14:40:15.981801+0000","last_active":"2024-05-14T14:40:21.352423+0000","last_peered":"2024-05-14T14:40:21.352423+0000","last_clean":"2024-05-14T14:40:21.352423+0000","last_became_active":"2024-05-14T14:40:15.981444+0000","last_became_peered":"2024-05-14T14:40:15.981444+0000","last_unstale":"2024-05-14T14:40:21.352423+0000","last_undegraded":"2024-05-14T14:40:21.352423+0000","last_fullsized":"2024-05-14T14:40:21.352423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:59:55.024165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351958+0000","last_change":"2024-05-14T14:40:15.973771+0000","last_active":"2024-05-14T14:40:21.351958+0000","last_peered":"2024-05-14T14:40:21.351958+0000","last_clean":"2024-05-14T14:40:21.351958+0000","last_became_active":"2024-05-14T14:40:15.973388+0000","last_became_peered":"2024-05-14T14:40:15.973388+0000","last_unstale":"2024-05-14T14:40:21.351958+0000","last_undegraded":"2024-05-14T14:40:21.351958+0000","last_fullsized":"2024-05-14T14:40:21.351958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:53.130907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006356+0000","last_change":"2024-05-14T14:40:15.969745+0000","last_active":"2024-05-14T14:40:21.006356+0000","last_peered":"2024-05-14T14:40:21.006356+0000","last_clean":"2024-05-14T14:40:21.006356+0000","last_became_active":"2024-05-14T14:40:15.969412+0000","last_became_peered":"2024-05-14T14:40:15.969412+0000","last_unstale":"2024-05-14T14:40:21.006356+0000","last_undegraded":"2024-05-14T14:40:21.006356+0000","last_fullsized":"2024-05-14T14:40:21.006356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:24:18.488847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352189+0000","last_change":"2024-05-14T14:40:15.982718+0000","last_active":"2024-05-14T14:40:21.352189+0000","last_peered":"2024-05-14T14:40:21.352189+0000","last_clean":"2024-05-14T14:40:21.352189+0000","last_became_active":"2024-05-14T14:40:15.982354+0000","last_became_peered":"2024-05-14T14:40:15.982354+0000","last_unstale":"2024-05-14T14:40:21.352189+0000","last_undegraded":"2024-05-14T14:40:21.352189+0000","last_fullsized":"2024-05-14T14:40:21.352189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:32:21.620701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.005438+0000","last_change":"2024-05-14T14:40:15.966798+0000","last_active":"2024-05-14T14:40:21.005438+0000","last_peered":"2024-05-14T14:40:21.005438+0000","last_clean":"2024-05-14T14:40:21.005438+0000","last_became_active":"2024-05-14T14:40:15.966408+0000","last_became_peered":"2024-05-14T14:40:15.966408+0000","last_unstale":"2024-05-14T14:40:21.005438+0000","last_undegraded":"2024-05-14T14:40:21.005438+0000","last_fullsized":"2024-05-14T14:40:21.005438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:24:18.488847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351504+0000","last_change":"2024-05-14T14:40:15.970022+0000","last_active":"2024-05-14T14:40:21.351504+0000","last_peered":"2024-05-14T14:40:21.351504+0000","last_clean":"2024-05-14T14:40:21.351504+0000","last_became_active":"2024-05-14T14:40:15.969695+0000","last_became_peered":"2024-05-14T14:40:15.969695+0000","last_unstale":"2024-05-14T14:40:21.351504+0000","last_undegraded":"2024-05-14T14:40:21.351504+0000","last_fullsized":"2024-05-14T14:40:21.351504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:58:49.048828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006273+0000","last_change":"2024-05-14T14:40:15.963064+0000","last_active":"2024-05-14T14:40:21.006273+0000","last_peered":"2024-05-14T14:40:21.006273+0000","last_clean":"2024-05-14T14:40:21.006273+0000","last_became_active":"2024-05-14T14:40:15.962710+0000","last_became_peered":"2024-05-14T14:40:15.962710+0000","last_unstale":"2024-05-14T14:40:21.006273+0000","last_undegraded":"2024-05-14T14:40:21.006273+0000","last_fullsized":"2024-05-14T14:40:21.006273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:20:20.841651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352408+0000","last_change":"2024-05-14T14:40:15.967114+0000","last_active":"2024-05-14T14:40:21.352408+0000","last_peered":"2024-05-14T14:40:21.352408+0000","last_clean":"2024-05-14T14:40:21.352408+0000","last_became_active":"2024-05-14T14:40:15.966769+0000","last_became_peered":"2024-05-14T14:40:15.966769+0000","last_unstale":"2024-05-14T14:40:21.352408+0000","last_undegraded":"2024-05-14T14:40:21.352408+0000","last_fullsized":"2024-05-14T14:40:21.352408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:54:04.167075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006690+0000","last_change":"2024-05-14T14:40:15.959522+0000","last_active":"2024-05-14T14:40:21.006690+0000","last_peered":"2024-05-14T14:40:21.006690+0000","last_clean":"2024-05-14T14:40:21.006690+0000","last_became_active":"2024-05-14T14:40:15.959175+0000","last_became_peered":"2024-05-14T14:40:15.959175+0000","last_unstale":"2024-05-14T14:40:21.006690+0000","last_undegraded":"2024-05-14T14:40:21.006690+0000","last_fullsized":"2024-05-14T14:40:21.006690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:16:59.783346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353319+0000","last_change":"2024-05-14T14:40:15.965742+0000","last_active":"2024-05-14T14:40:21.353319+0000","last_peered":"2024-05-14T14:40:21.353319+0000","last_clean":"2024-05-14T14:40:21.353319+0000","last_became_active":"2024-05-14T14:40:15.965402+0000","last_became_peered":"2024-05-14T14:40:15.965402+0000","last_unstale":"2024-05-14T14:40:21.353319+0000","last_undegraded":"2024-05-14T14:40:21.353319+0000","last_fullsized":"2024-05-14T14:40:21.353319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:54:56.658112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.004698+0000","last_change":"2024-05-14T14:40:15.958876+0000","last_active":"2024-05-14T14:40:21.004698+0000","last_peered":"2024-05-14T14:40:21.004698+0000","last_clean":"2024-05-14T14:40:21.004698+0000","last_became_active":"2024-05-14T14:40:15.958527+0000","last_became_peered":"2024-05-14T14:40:15.958527+0000","last_unstale":"2024-05-14T14:40:21.004698+0000","last_undegraded":"2024-05-14T14:40:21.004698+0000","last_fullsized":"2024-05-14T14:40:21.004698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:36:38.736430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.007564+0000","last_change":"2024-05-14T14:40:15.962954+0000","last_active":"2024-05-14T14:40:21.007564+0000","last_peered":"2024-05-14T14:40:21.007564+0000","last_clean":"2024-05-14T14:40:21.007564+0000","last_became_active":"2024-05-14T14:40:15.962607+0000","last_became_peered":"2024-05-14T14:40:15.962607+0000","last_unstale":"2024-05-14T14:40:21.007564+0000","last_undegraded":"2024-05-14T14:40:21.007564+0000","last_fullsized":"2024-05-14T14:40:21.007564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:36:37.465980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.005302+0000","last_change":"2024-05-14T14:40:15.959274+0000","last_active":"2024-05-14T14:40:21.005302+0000","last_peered":"2024-05-14T14:40:21.005302+0000","last_clean":"2024-05-14T14:40:21.005302+0000","last_became_active":"2024-05-14T14:40:15.958645+0000","last_became_peered":"2024-05-14T14:40:15.958645+0000","last_unstale":"2024-05-14T14:40:21.005302+0000","last_undegraded":"2024-05-14T14:40:21.005302+0000","last_fullsized":"2024-05-14T14:40:21.005302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:59:55.024165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351254+0000","last_change":"2024-05-14T14:40:15.969772+0000","last_active":"2024-05-14T14:40:21.351254+0000","last_peered":"2024-05-14T14:40:21.351254+0000","last_clean":"2024-05-14T14:40:21.351254+0000","last_became_active":"2024-05-14T14:40:15.969426+0000","last_became_peered":"2024-05-14T14:40:15.969426+0000","last_unstale":"2024-05-14T14:40:21.351254+0000","last_undegraded":"2024-05-14T14:40:21.351254+0000","last_fullsized":"2024-05-14T14:40:21.351254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:23:34.578655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351920+0000","last_change":"2024-05-14T14:40:15.968134+0000","last_active":"2024-05-14T14:40:21.351920+0000","last_peered":"2024-05-14T14:40:21.351920+0000","last_clean":"2024-05-14T14:40:21.351920+0000","last_became_active":"2024-05-14T14:40:15.967777+0000","last_became_peered":"2024-05-14T14:40:15.967777+0000","last_unstale":"2024-05-14T14:40:21.351920+0000","last_undegraded":"2024-05-14T14:40:21.351920+0000","last_fullsized":"2024-05-14T14:40:21.351920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:55:12.523931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352640+0000","last_change":"2024-05-14T14:40:15.968186+0000","last_active":"2024-05-14T14:40:21.352640+0000","last_peered":"2024-05-14T14:40:21.352640+0000","last_clean":"2024-05-14T14:40:21.352640+0000","last_became_active":"2024-05-14T14:40:15.967015+0000","last_became_peered":"2024-05-14T14:40:15.967015+0000","last_unstale":"2024-05-14T14:40:21.352640+0000","last_undegraded":"2024-05-14T14:40:21.352640+0000","last_fullsized":"2024-05-14T14:40:21.352640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:20:20.841651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352491+0000","last_change":"2024-05-14T14:40:15.957490+0000","last_active":"2024-05-14T14:40:21.352491+0000","last_peered":"2024-05-14T14:40:21.352491+0000","last_clean":"2024-05-14T14:40:21.352491+0000","last_became_active":"2024-05-14T14:40:15.957138+0000","last_became_peered":"2024-05-14T14:40:15.957138+0000","last_unstale":"2024-05-14T14:40:21.352491+0000","last_undegraded":"2024-05-14T14:40:21.352491+0000","last_fullsized":"2024-05-14T14:40:21.352491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:36:38.736430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.007117+0000","last_change":"2024-05-14T14:40:15.980390+0000","last_active":"2024-05-14T14:40:21.007117+0000","last_peered":"2024-05-14T14:40:21.007117+0000","last_clean":"2024-05-14T14:40:21.007117+0000","last_became_active":"2024-05-14T14:40:15.975197+0000","last_became_peered":"2024-05-14T14:40:15.975197+0000","last_unstale":"2024-05-14T14:40:21.007117+0000","last_undegraded":"2024-05-14T14:40:21.007117+0000","last_fullsized":"2024-05-14T14:40:21.007117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:53.130907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006219+0000","last_change":"2024-05-14T14:40:15.980514+0000","last_active":"2024-05-14T14:40:21.006219+0000","last_peered":"2024-05-14T14:40:21.006219+0000","last_clean":"2024-05-14T14:40:21.006219+0000","last_became_active":"2024-05-14T14:40:15.980024+0000","last_became_peered":"2024-05-14T14:40:15.980024+0000","last_unstale":"2024-05-14T14:40:21.006219+0000","last_undegraded":"2024-05-14T14:40:21.006219+0000","last_fullsized":"2024-05-14T14:40:21.006219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:59:55.024165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352960+0000","last_change":"2024-05-14T14:40:15.977265+0000","last_active":"2024-05-14T14:40:21.352960+0000","last_peered":"2024-05-14T14:40:21.352960+0000","last_clean":"2024-05-14T14:40:21.352960+0000","last_became_active":"2024-05-14T14:40:15.976826+0000","last_became_peered":"2024-05-14T14:40:15.976826+0000","last_unstale":"2024-05-14T14:40:21.352960+0000","last_undegraded":"2024-05-14T14:40:21.352960+0000","last_fullsized":"2024-05-14T14:40:21.352960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:36:37.465980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351694+0000","last_change":"2024-05-14T14:40:15.979087+0000","last_active":"2024-05-14T14:40:21.351694+0000","last_peered":"2024-05-14T14:40:21.351694+0000","last_clean":"2024-05-14T14:40:21.351694+0000","last_became_active":"2024-05-14T14:40:15.978749+0000","last_became_peered":"2024-05-14T14:40:15.978749+0000","last_unstale":"2024-05-14T14:40:21.351694+0000","last_undegraded":"2024-05-14T14:40:21.351694+0000","last_fullsized":"2024-05-14T14:40:21.351694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:54:04.167075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351866+0000","last_change":"2024-05-14T14:40:15.972565+0000","last_active":"2024-05-14T14:40:21.351866+0000","last_peered":"2024-05-14T14:40:21.351866+0000","last_clean":"2024-05-14T14:40:21.351866+0000","last_became_active":"2024-05-14T14:40:15.972197+0000","last_became_peered":"2024-05-14T14:40:15.972197+0000","last_unstale":"2024-05-14T14:40:21.351866+0000","last_undegraded":"2024-05-14T14:40:21.351866+0000","last_fullsized":"2024-05-14T14:40:21.351866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:20:20.841651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006142+0000","last_change":"2024-05-14T14:40:15.962025+0000","last_active":"2024-05-14T14:40:21.006142+0000","last_peered":"2024-05-14T14:40:21.006142+0000","last_clean":"2024-05-14T14:40:21.006142+0000","last_became_active":"2024-05-14T14:40:15.961314+0000","last_became_peered":"2024-05-14T14:40:15.961314+0000","last_unstale":"2024-05-14T14:40:21.006142+0000","last_undegraded":"2024-05-14T14:40:21.006142+0000","last_fullsized":"2024-05-14T14:40:21.006142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:58:49.048828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352128+0000","last_change":"2024-05-14T14:40:15.964970+0000","last_active":"2024-05-14T14:40:21.352128+0000","last_peered":"2024-05-14T14:40:21.352128+0000","last_clean":"2024-05-14T14:40:21.352128+0000","last_became_active":"2024-05-14T14:40:15.964611+0000","last_became_peered":"2024-05-14T14:40:15.964611+0000","last_unstale":"2024-05-14T14:40:21.352128+0000","last_undegraded":"2024-05-14T14:40:21.352128+0000","last_fullsized":"2024-05-14T14:40:21.352128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:32:21.620701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006800+0000","last_change":"2024-05-14T14:40:15.974010+0000","last_active":"2024-05-14T14:40:21.006800+0000","last_peered":"2024-05-14T14:40:21.006800+0000","last_clean":"2024-05-14T14:40:21.006800+0000","last_became_active":"2024-05-14T14:40:15.973683+0000","last_became_peered":"2024-05-14T14:40:15.973683+0000","last_unstale":"2024-05-14T14:40:21.006800+0000","last_undegraded":"2024-05-14T14:40:21.006800+0000","last_fullsized":"2024-05-14T14:40:21.006800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:43:15.190648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352691+0000","last_change":"2024-05-14T14:40:15.958806+0000","last_active":"2024-05-14T14:40:21.352691+0000","last_peered":"2024-05-14T14:40:21.352691+0000","last_clean":"2024-05-14T14:40:21.352691+0000","last_became_active":"2024-05-14T14:40:15.958397+0000","last_became_peered":"2024-05-14T14:40:15.958397+0000","last_unstale":"2024-05-14T14:40:21.352691+0000","last_undegraded":"2024-05-14T14:40:21.352691+0000","last_fullsized":"2024-05-14T14:40:21.352691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:23:34.578655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352925+0000","last_change":"2024-05-14T14:40:15.968981+0000","last_active":"2024-05-14T14:40:21.352925+0000","last_peered":"2024-05-14T14:40:21.352925+0000","last_clean":"2024-05-14T14:40:21.352925+0000","last_became_active":"2024-05-14T14:40:15.968588+0000","last_became_peered":"2024-05-14T14:40:15.968588+0000","last_unstale":"2024-05-14T14:40:21.352925+0000","last_undegraded":"2024-05-14T14:40:21.352925+0000","last_fullsized":"2024-05-14T14:40:21.352925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:24:18.488847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352818+0000","last_change":"2024-05-14T14:40:15.967640+0000","last_active":"2024-05-14T14:40:21.352818+0000","last_peered":"2024-05-14T14:40:21.352818+0000","last_clean":"2024-05-14T14:40:21.352818+0000","last_became_active":"2024-05-14T14:40:15.967316+0000","last_became_peered":"2024-05-14T14:40:15.967316+0000","last_unstale":"2024-05-14T14:40:21.352818+0000","last_undegraded":"2024-05-14T14:40:21.352818+0000","last_fullsized":"2024-05-14T14:40:21.352818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:09:29.986117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":101868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":266240,"data_stored":101868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T14:40:30.114 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T14:40:30.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.280+0000 7f8e1c422640 1 Processor -- start 2024-05-14T14:40:30.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.280+0000 7f8e1c422640 1 -- start start 2024-05-14T14:40:30.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.281+0000 7f8e1c422640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8e140b4ec0 0x7f8e141602d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:30.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.281+0000 7f8e1c422640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f8e140d0ad0 0x7f8e140d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:30.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.281+0000 7f8e1c422640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e140d5840 con 0x7f8e140d1420 2024-05-14T14:40:30.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.281+0000 7f8e1c422640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f8e140d4d50 con 0x7f8e140d0ad0 2024-05-14T14:40:30.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.281+0000 7f8e1c422640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f8e1406c840 con 0x7f8e140b4ec0 2024-05-14T14:40:30.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.281+0000 7f8e199bd640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f8e140d0ad0 0x7f8e140d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:30.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.281+0000 7f8e1a9bf640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f8e140d1420 0x7f8e14163e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:56296/0 (socket says 172.21.15.39:56296) 2024-05-14T14:40:30.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.281+0000 7f8e1a9bf640 1 -- 172.21.15.39:0/1426708554 learned_addr learned my addr 172.21.15.39:0/1426708554 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:30.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.281+0000 7f8e1a1be640 1 --2- 172.21.15.39:0/1426708554 >> v2:172.21.15.62:3300/0 conn(0x7f8e140b4ec0 0x7f8e141602d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:30.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.282+0000 7f8e199bd640 1 -- 172.21.15.39:0/1426708554 >> v2:172.21.15.62:3300/0 conn(0x7f8e140b4ec0 msgr2=0x7f8e141602d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:30.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.282+0000 7f8e199bd640 1 --2- 172.21.15.39:0/1426708554 >> v2:172.21.15.62:3300/0 conn(0x7f8e140b4ec0 0x7f8e141602d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:30.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.282+0000 7f8e199bd640 1 -- 172.21.15.39:0/1426708554 >> v1:172.21.15.39:6789/0 conn(0x7f8e140d1420 legacy=0x7f8e14163e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:30.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.282+0000 7f8e199bd640 1 -- 172.21.15.39:0/1426708554 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e140d1830 con 0x7f8e140d0ad0 2024-05-14T14:40:30.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.282+0000 7f8e191bc640 1 -- 172.21.15.39:0/1426708554 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1961422420 0 0) 0x7f8e140d5840 con 0x7f8e140d1420 2024-05-14T14:40:30.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.282+0000 7f8e199bd640 1 --2- 172.21.15.39:0/1426708554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e140d0ad0 0x7f8e140d0ee0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8e140d66c0 tx=0x7f8e0402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48fbe0307c88f0fb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:30.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.283+0000 7f8e191bc640 1 -- 172.21.15.39:0/1426708554 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e04037070 con 0x7f8e140d0ad0 2024-05-14T14:40:30.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.283+0000 7f8e191bc640 1 -- 172.21.15.39:0/1426708554 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e04032440 con 0x7f8e140d0ad0 2024-05-14T14:40:30.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.283+0000 7f8e191bc640 1 -- 172.21.15.39:0/1426708554 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e04032810 con 0x7f8e140d0ad0 2024-05-14T14:40:30.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.283+0000 7f8e1c422640 1 -- 172.21.15.39:0/1426708554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e140d0ad0 msgr2=0x7f8e140d0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:30.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.283+0000 7f8e1c422640 1 --2- 172.21.15.39:0/1426708554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e140d0ad0 0x7f8e140d0ee0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f8e140d66c0 tx=0x7f8e0402a1a0 comp rx=0 tx=0).stop 2024-05-14T14:40:30.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.283+0000 7f8e1c422640 1 -- 172.21.15.39:0/1426708554 shutdown_connections 2024-05-14T14:40:30.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.283+0000 7f8e1c422640 1 --2- 172.21.15.39:0/1426708554 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e140d0ad0 0x7f8e140d0ee0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:30.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.283+0000 7f8e1c422640 1 --2- 172.21.15.39:0/1426708554 >> v2:172.21.15.62:3300/0 conn(0x7f8e140b4ec0 0x7f8e141602d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:30.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.283+0000 7f8e1c422640 1 -- 172.21.15.39:0/1426708554 >> 172.21.15.39:0/1426708554 conn(0x7f8e1406f270 msgr2=0x7f8e140d5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:30.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.284+0000 7f8e1c422640 1 -- 172.21.15.39:0/1426708554 shutdown_connections 2024-05-14T14:40:30.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.284+0000 7f8e1c422640 1 -- 172.21.15.39:0/1426708554 wait complete. 2024-05-14T14:40:30.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.285+0000 7f8e1c422640 1 Processor -- start 2024-05-14T14:40:30.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.285+0000 7f8e1c422640 1 -- start start 2024-05-14T14:40:30.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.287+0000 7f8e1c422640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e140b4ec0 0x7f8e14158a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:30.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.287+0000 7f8e1c422640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8e140d0ad0 0x7f8e141599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:30.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.287+0000 7f8e1c422640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e140d1420 0x7f8e1415d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:30.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.287+0000 7f8e1c422640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8e140d5560 con 0x7f8e140d1420 2024-05-14T14:40:30.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.287+0000 7f8e1c422640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f8e140d5280 con 0x7f8e140b4ec0 2024-05-14T14:40:30.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.287+0000 7f8e1c422640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f8e140b5480 con 0x7f8e140d0ad0 2024-05-14T14:40:30.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.287+0000 7f8e1a9bf640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e140d1420 0x7f8e1415d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:30.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.287+0000 7f8e1a9bf640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e140d1420 0x7f8e1415d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48042/0 (socket says 172.21.15.39:48042) 2024-05-14T14:40:30.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.287+0000 7f8e1a9bf640 1 -- 172.21.15.39:0/4011444998 learned_addr learned my addr 172.21.15.39:0/4011444998 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:30.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.287+0000 7f8e1a1be640 1 --2- 172.21.15.39:0/4011444998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e140b4ec0 0x7f8e14158a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:30.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.287+0000 7f8e199bd640 1 --2- 172.21.15.39:0/4011444998 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8e140d0ad0 0x7f8e141599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:30.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.287+0000 7f8e1a9bf640 1 -- 172.21.15.39:0/4011444998 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8e140d0ad0 msgr2=0x7f8e141599f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:30.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.287+0000 7f8e1a9bf640 1 --2- 172.21.15.39:0/4011444998 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8e140d0ad0 0x7f8e141599f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:30.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.287+0000 7f8e1a9bf640 1 -- 172.21.15.39:0/4011444998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e140b4ec0 msgr2=0x7f8e14158a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:30.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.287+0000 7f8e1a9bf640 1 --2- 172.21.15.39:0/4011444998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e140b4ec0 0x7f8e14158a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:30.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.287+0000 7f8e1a9bf640 1 -- 172.21.15.39:0/4011444998 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e14160940 con 0x7f8e140d1420 2024-05-14T14:40:30.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.287+0000 7f8e1a9bf640 1 --2- 172.21.15.39:0/4011444998 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e140d1420 0x7f8e1415d5a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c00c6e0 tx=0x7f8e0c00cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:30.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.287+0000 7f8e0affd640 1 -- 172.21.15.39:0/4011444998 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c018070 con 0x7f8e140d1420 2024-05-14T14:40:30.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.288+0000 7f8e0affd640 1 -- 172.21.15.39:0/4011444998 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e0c004d60 con 0x7f8e140d1420 2024-05-14T14:40:30.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.288+0000 7f8e1c422640 1 -- 172.21.15.39:0/4011444998 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e14160c20 con 0x7f8e140d1420 2024-05-14T14:40:30.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.288+0000 7f8e0affd640 1 -- 172.21.15.39:0/4011444998 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e0c00a880 con 0x7f8e140d1420 2024-05-14T14:40:30.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.288+0000 7f8e1c422640 1 -- 172.21.15.39:0/4011444998 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e141611e0 con 0x7f8e140d1420 2024-05-14T14:40:30.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.289+0000 7f8e1c422640 1 -- 172.21.15.39:0/4011444998 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e1415a260 con 0x7f8e140d1420 2024-05-14T14:40:30.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.289+0000 7f8e0affd640 1 -- 172.21.15.39:0/4011444998 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8e0c01b070 con 0x7f8e140d1420 2024-05-14T14:40:30.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.290+0000 7f8e0affd640 1 --2- 172.21.15.39:0/4011444998 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f8df8076300 0x7f8df8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:30.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.290+0000 7f8e0affd640 1 -- 172.21.15.39:0/4011444998 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8e0c096cb0 con 0x7f8e140d1420 2024-05-14T14:40:30.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.290+0000 7f8e1a1be640 1 --2- 172.21.15.39:0/4011444998 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f8df8076300 0x7f8df8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:30.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.290+0000 7f8e1a1be640 1 --2- 172.21.15.39:0/4011444998 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f8df8076300 0x7f8df8078810 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8e10009aa0 tx=0x7f8e10009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:30.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.295+0000 7f8e0affd640 1 -- 172.21.15.39:0/4011444998 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8e0c05fd10 con 0x7f8e140d1420 2024-05-14T14:40:30.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.482+0000 7f8e1c422640 1 -- 172.21.15.39:0/4011444998 --> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8e14076aa0 con 0x7f8df8076300 2024-05-14T14:40:30.474 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.490+0000 7f8e0affd640 1 -- 172.21.15.39:0/4011444998 <== mgr.4105 v2:172.21.15.39:6832/498853008 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332631 (secure 0 0 0) 0x7f8e14076aa0 con 0x7f8df8076300 2024-05-14T14:40:30.478 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:40:30.480 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-05-14T14:40:30.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.494+0000 7f8e1c422640 1 -- 172.21.15.39:0/4011444998 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f8df8076300 msgr2=0x7f8df8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:30.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.494+0000 7f8e1c422640 1 --2- 172.21.15.39:0/4011444998 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f8df8076300 0x7f8df8078810 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8e10009aa0 tx=0x7f8e10009190 comp rx=0 tx=0).stop 2024-05-14T14:40:30.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.494+0000 7f8e1c422640 1 -- 172.21.15.39:0/4011444998 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e140d1420 msgr2=0x7f8e1415d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:30.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.494+0000 7f8e1c422640 1 --2- 172.21.15.39:0/4011444998 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e140d1420 0x7f8e1415d5a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c00c6e0 tx=0x7f8e0c00cba0 comp rx=0 tx=0).stop 2024-05-14T14:40:30.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.494+0000 7f8e1c422640 1 -- 172.21.15.39:0/4011444998 shutdown_connections 2024-05-14T14:40:30.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.494+0000 7f8e1c422640 1 --2- 172.21.15.39:0/4011444998 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f8df8076300 0x7f8df8078810 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:30.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.494+0000 7f8e1c422640 1 --2- 172.21.15.39:0/4011444998 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8e140d1420 0x7f8e1415d5a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:30.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.494+0000 7f8e1c422640 1 --2- 172.21.15.39:0/4011444998 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8e140d0ad0 0x7f8e141599f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:30.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.494+0000 7f8e1c422640 1 --2- 172.21.15.39:0/4011444998 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e140b4ec0 0x7f8e14158a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:30.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.494+0000 7f8e1c422640 1 -- 172.21.15.39:0/4011444998 >> 172.21.15.39:0/4011444998 conn(0x7f8e1406f270 msgr2=0x7f8e140d4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:30.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.494+0000 7f8e1c422640 1 -- 172.21.15.39:0/4011444998 shutdown_connections 2024-05-14T14:40:30.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.494+0000 7f8e1c422640 1 -- 172.21.15.39:0/4011444998 wait complete. 2024-05-14T14:40:30.489 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-05-14T14:40:28.679154+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":308,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231880,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742840,"statfs":{"total":773094113280,"available":772856668160,"internally_reserved":0,"allocated":3284992,"data_stored":1987604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":234016308},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.688118"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353941+0000","last_change":"2024-05-14T14:40:14.954342+0000","last_active":"2024-05-14T14:40:21.353941+0000","last_peered":"2024-05-14T14:40:21.353941+0000","last_clean":"2024-05-14T14:40:21.353941+0000","last_became_active":"2024-05-14T14:40:14.954008+0000","last_became_peered":"2024-05-14T14:40:14.954008+0000","last_unstale":"2024-05-14T14:40:21.353941+0000","last_undegraded":"2024-05-14T14:40:21.353941+0000","last_fullsized":"2024-05-14T14:40:21.353941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:48:44.948315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351459+0000","last_change":"2024-05-14T14:40:15.977901+0000","last_active":"2024-05-14T14:40:21.351459+0000","last_peered":"2024-05-14T14:40:21.351459+0000","last_clean":"2024-05-14T14:40:21.351459+0000","last_became_active":"2024-05-14T14:40:15.977572+0000","last_became_peered":"2024-05-14T14:40:15.977572+0000","last_unstale":"2024-05-14T14:40:21.351459+0000","last_undegraded":"2024-05-14T14:40:21.351459+0000","last_fullsized":"2024-05-14T14:40:21.351459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:53.130907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351078+0000","last_change":"2024-05-14T14:40:20.380801+0000","last_active":"2024-05-14T14:40:21.351078+0000","last_peered":"2024-05-14T14:40:21.351078+0000","last_clean":"2024-05-14T14:40:21.351078+0000","last_became_active":"2024-05-14T14:40:20.379931+0000","last_became_peered":"2024-05-14T14:40:20.379931+0000","last_unstale":"2024-05-14T14:40:21.351078+0000","last_undegraded":"2024-05-14T14:40:21.351078+0000","last_fullsized":"2024-05-14T14:40:21.351078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:06:08.604105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351767+0000","last_change":"2024-05-14T14:40:14.951857+0000","last_active":"2024-05-14T14:40:21.351767+0000","last_peered":"2024-05-14T14:40:21.351767+0000","last_clean":"2024-05-14T14:40:21.351767+0000","last_became_active":"2024-05-14T14:40:14.951514+0000","last_became_peered":"2024-05-14T14:40:14.951514+0000","last_unstale":"2024-05-14T14:40:21.351767+0000","last_undegraded":"2024-05-14T14:40:21.351767+0000","last_fullsized":"2024-05-14T14:40:21.351767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:04:43.508873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353664+0000","last_change":"2024-05-14T14:40:15.954769+0000","last_active":"2024-05-14T14:40:21.353664+0000","last_peered":"2024-05-14T14:40:21.353664+0000","last_clean":"2024-05-14T14:40:21.353664+0000","last_became_active":"2024-05-14T14:40:15.954410+0000","last_became_peered":"2024-05-14T14:40:15.954410+0000","last_unstale":"2024-05-14T14:40:21.353664+0000","last_undegraded":"2024-05-14T14:40:21.353664+0000","last_fullsized":"2024-05-14T14:40:21.353664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:06:01.598712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351319+0000","last_change":"2024-05-14T14:40:20.012885+0000","last_active":"2024-05-14T14:40:21.351319+0000","last_peered":"2024-05-14T14:40:21.351319+0000","last_clean":"2024-05-14T14:40:21.351319+0000","last_became_active":"2024-05-14T14:40:20.012401+0000","last_became_peered":"2024-05-14T14:40:20.012401+0000","last_unstale":"2024-05-14T14:40:21.351319+0000","last_undegraded":"2024-05-14T14:40:21.351319+0000","last_fullsized":"2024-05-14T14:40:21.351319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:24:22.540721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353214+0000","last_change":"2024-05-14T14:40:14.952296+0000","last_active":"2024-05-14T14:40:21.353214+0000","last_peered":"2024-05-14T14:40:21.353214+0000","last_clean":"2024-05-14T14:40:21.353214+0000","last_became_active":"2024-05-14T14:40:14.951962+0000","last_became_peered":"2024-05-14T14:40:14.951962+0000","last_unstale":"2024-05-14T14:40:21.353214+0000","last_undegraded":"2024-05-14T14:40:21.353214+0000","last_fullsized":"2024-05-14T14:40:21.353214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:36:37.730760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006947+0000","last_change":"2024-05-14T14:40:15.952430+0000","last_active":"2024-05-14T14:40:21.006947+0000","last_peered":"2024-05-14T14:40:21.006947+0000","last_clean":"2024-05-14T14:40:21.006947+0000","last_became_active":"2024-05-14T14:40:15.952073+0000","last_became_peered":"2024-05-14T14:40:15.952073+0000","last_unstale":"2024-05-14T14:40:21.006947+0000","last_undegraded":"2024-05-14T14:40:21.006947+0000","last_fullsized":"2024-05-14T14:40:21.006947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:41:42.097310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351837+0000","last_change":"2024-05-14T14:40:20.020148+0000","last_active":"2024-05-14T14:40:21.351837+0000","last_peered":"2024-05-14T14:40:21.351837+0000","last_clean":"2024-05-14T14:40:21.351837+0000","last_became_active":"2024-05-14T14:40:20.019445+0000","last_became_peered":"2024-05-14T14:40:20.019445+0000","last_unstale":"2024-05-14T14:40:21.351837+0000","last_undegraded":"2024-05-14T14:40:21.351837+0000","last_fullsized":"2024-05-14T14:40:21.351837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:41:46.149184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352471+0000","last_change":"2024-05-14T14:40:14.952153+0000","last_active":"2024-05-14T14:40:21.352471+0000","last_peered":"2024-05-14T14:40:21.352471+0000","last_clean":"2024-05-14T14:40:21.352471+0000","last_became_active":"2024-05-14T14:40:14.951611+0000","last_became_peered":"2024-05-14T14:40:14.951611+0000","last_unstale":"2024-05-14T14:40:21.352471+0000","last_undegraded":"2024-05-14T14:40:21.352471+0000","last_fullsized":"2024-05-14T14:40:21.352471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:17:11.948081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.007527+0000","last_change":"2024-05-14T14:40:15.952403+0000","last_active":"2024-05-14T14:40:21.007527+0000","last_peered":"2024-05-14T14:40:21.007527+0000","last_clean":"2024-05-14T14:40:21.007527+0000","last_became_active":"2024-05-14T14:40:15.951977+0000","last_became_peered":"2024-05-14T14:40:15.951977+0000","last_unstale":"2024-05-14T14:40:21.007527+0000","last_undegraded":"2024-05-14T14:40:21.007527+0000","last_fullsized":"2024-05-14T14:40:21.007527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:28:34.783112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351495+0000","last_change":"2024-05-14T14:40:20.014394+0000","last_active":"2024-05-14T14:40:21.351495+0000","last_peered":"2024-05-14T14:40:21.351495+0000","last_clean":"2024-05-14T14:40:21.351495+0000","last_became_active":"2024-05-14T14:40:20.013530+0000","last_became_peered":"2024-05-14T14:40:20.013530+0000","last_unstale":"2024-05-14T14:40:21.351495+0000","last_undegraded":"2024-05-14T14:40:21.351495+0000","last_fullsized":"2024-05-14T14:40:21.351495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:43:19.242522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006074+0000","last_change":"2024-05-14T14:40:15.961488+0000","last_active":"2024-05-14T14:40:21.006074+0000","last_peered":"2024-05-14T14:40:21.006074+0000","last_clean":"2024-05-14T14:40:21.006074+0000","last_became_active":"2024-05-14T14:40:15.960660+0000","last_became_peered":"2024-05-14T14:40:15.960660+0000","last_unstale":"2024-05-14T14:40:21.006074+0000","last_undegraded":"2024-05-14T14:40:21.006074+0000","last_fullsized":"2024-05-14T14:40:21.006074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:54:04.167075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352322+0000","last_change":"2024-05-14T14:40:14.951723+0000","last_active":"2024-05-14T14:40:21.352322+0000","last_peered":"2024-05-14T14:40:21.352322+0000","last_clean":"2024-05-14T14:40:21.352322+0000","last_became_active":"2024-05-14T14:40:14.951352+0000","last_became_peered":"2024-05-14T14:40:14.951352+0000","last_unstale":"2024-05-14T14:40:21.352322+0000","last_undegraded":"2024-05-14T14:40:21.352322+0000","last_fullsized":"2024-05-14T14:40:21.352322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:07:48.920558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352736+0000","last_change":"2024-05-14T14:40:20.014226+0000","last_active":"2024-05-14T14:40:21.352736+0000","last_peered":"2024-05-14T14:40:21.352736+0000","last_clean":"2024-05-14T14:40:21.352736+0000","last_became_active":"2024-05-14T14:40:20.013489+0000","last_became_peered":"2024-05-14T14:40:20.013489+0000","last_unstale":"2024-05-14T14:40:21.352736+0000","last_undegraded":"2024-05-14T14:40:21.352736+0000","last_fullsized":"2024-05-14T14:40:21.352736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:28:38.834985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352716+0000","last_change":"2024-05-14T14:40:15.971905+0000","last_active":"2024-05-14T14:40:21.352716+0000","last_peered":"2024-05-14T14:40:21.352716+0000","last_clean":"2024-05-14T14:40:21.352716+0000","last_became_active":"2024-05-14T14:40:15.971131+0000","last_became_peered":"2024-05-14T14:40:15.971131+0000","last_unstale":"2024-05-14T14:40:21.352716+0000","last_undegraded":"2024-05-14T14:40:21.352716+0000","last_fullsized":"2024-05-14T14:40:21.352716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:43:15.190648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353431+0000","last_change":"2024-05-14T14:40:14.948435+0000","last_active":"2024-05-14T14:40:21.353431+0000","last_peered":"2024-05-14T14:40:21.353431+0000","last_clean":"2024-05-14T14:40:21.353431+0000","last_became_active":"2024-05-14T14:40:14.948096+0000","last_became_peered":"2024-05-14T14:40:14.948096+0000","last_unstale":"2024-05-14T14:40:21.353431+0000","last_undegraded":"2024-05-14T14:40:21.353431+0000","last_fullsized":"2024-05-14T14:40:21.353431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:30:28.647287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351533+0000","last_change":"2024-05-14T14:40:20.019546+0000","last_active":"2024-05-14T14:40:21.351533+0000","last_peered":"2024-05-14T14:40:21.351533+0000","last_clean":"2024-05-14T14:40:21.351533+0000","last_became_active":"2024-05-14T14:40:20.019087+0000","last_became_peered":"2024-05-14T14:40:20.019087+0000","last_unstale":"2024-05-14T14:40:21.351533+0000","last_undegraded":"2024-05-14T14:40:21.351533+0000","last_fullsized":"2024-05-14T14:40:21.351533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:32:25.672575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351856+0000","last_change":"2024-05-14T14:40:15.966369+0000","last_active":"2024-05-14T14:40:21.351856+0000","last_peered":"2024-05-14T14:40:21.351856+0000","last_clean":"2024-05-14T14:40:21.351856+0000","last_became_active":"2024-05-14T14:40:15.965662+0000","last_became_peered":"2024-05-14T14:40:15.965662+0000","last_unstale":"2024-05-14T14:40:21.351856+0000","last_undegraded":"2024-05-14T14:40:21.351856+0000","last_fullsized":"2024-05-14T14:40:21.351856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:23:34.578655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351349+0000","last_change":"2024-05-14T14:40:14.954350+0000","last_active":"2024-05-14T14:40:21.351349+0000","last_peered":"2024-05-14T14:40:21.351349+0000","last_clean":"2024-05-14T14:40:21.351349+0000","last_became_active":"2024-05-14T14:40:14.954046+0000","last_became_peered":"2024-05-14T14:40:14.954046+0000","last_unstale":"2024-05-14T14:40:21.351349+0000","last_undegraded":"2024-05-14T14:40:21.351349+0000","last_fullsized":"2024-05-14T14:40:21.351349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:17:11.948081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353677+0000","last_change":"2024-05-14T14:40:20.379814+0000","last_active":"2024-05-14T14:40:21.353677+0000","last_peered":"2024-05-14T14:40:21.353677+0000","last_clean":"2024-05-14T14:40:21.353677+0000","last_became_active":"2024-05-14T14:40:20.378729+0000","last_became_peered":"2024-05-14T14:40:20.378729+0000","last_unstale":"2024-05-14T14:40:21.353677+0000","last_undegraded":"2024-05-14T14:40:21.353677+0000","last_fullsized":"2024-05-14T14:40:21.353677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:36:41.517853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352411+0000","last_change":"2024-05-14T14:40:15.961572+0000","last_active":"2024-05-14T14:40:21.352411+0000","last_peered":"2024-05-14T14:40:21.352411+0000","last_clean":"2024-05-14T14:40:21.352411+0000","last_became_active":"2024-05-14T14:40:15.961236+0000","last_became_peered":"2024-05-14T14:40:15.961236+0000","last_unstale":"2024-05-14T14:40:21.352411+0000","last_undegraded":"2024-05-14T14:40:21.352411+0000","last_fullsized":"2024-05-14T14:40:21.352411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:30:29.652957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351393+0000","last_change":"2024-05-14T14:40:14.952977+0000","last_active":"2024-05-14T14:40:21.351393+0000","last_peered":"2024-05-14T14:40:21.351393+0000","last_clean":"2024-05-14T14:40:21.351393+0000","last_became_active":"2024-05-14T14:40:14.952638+0000","last_became_peered":"2024-05-14T14:40:14.952638+0000","last_unstale":"2024-05-14T14:40:21.351393+0000","last_undegraded":"2024-05-14T14:40:21.351393+0000","last_fullsized":"2024-05-14T14:40:21.351393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:30:28.647287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353054+0000","last_change":"2024-05-14T14:40:20.019116+0000","last_active":"2024-05-14T14:40:21.353054+0000","last_peered":"2024-05-14T14:40:21.353054+0000","last_clean":"2024-05-14T14:40:21.353054+0000","last_became_active":"2024-05-14T14:40:20.018572+0000","last_became_peered":"2024-05-14T14:40:20.018572+0000","last_unstale":"2024-05-14T14:40:21.353054+0000","last_undegraded":"2024-05-14T14:40:21.353054+0000","last_fullsized":"2024-05-14T14:40:21.353054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:01:01.849694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353666+0000","last_change":"2024-05-14T14:40:15.968343+0000","last_active":"2024-05-14T14:40:21.353666+0000","last_peered":"2024-05-14T14:40:21.353666+0000","last_clean":"2024-05-14T14:40:21.353666+0000","last_became_active":"2024-05-14T14:40:15.967789+0000","last_became_peered":"2024-05-14T14:40:15.967789+0000","last_unstale":"2024-05-14T14:40:21.353666+0000","last_undegraded":"2024-05-14T14:40:21.353666+0000","last_fullsized":"2024-05-14T14:40:21.353666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:53.130907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.007066+0000","last_change":"2024-05-14T14:40:14.949732+0000","last_active":"2024-05-14T14:40:21.007066+0000","last_peered":"2024-05-14T14:40:21.007066+0000","last_clean":"2024-05-14T14:40:21.007066+0000","last_became_active":"2024-05-14T14:40:14.949224+0000","last_became_peered":"2024-05-14T14:40:14.949224+0000","last_unstale":"2024-05-14T14:40:21.007066+0000","last_undegraded":"2024-05-14T14:40:21.007066+0000","last_fullsized":"2024-05-14T14:40:21.007066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:30:28.647287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351359+0000","last_change":"2024-05-14T14:40:20.374754+0000","last_active":"2024-05-14T14:40:21.351359+0000","last_peered":"2024-05-14T14:40:21.351359+0000","last_clean":"2024-05-14T14:40:21.351359+0000","last_became_active":"2024-05-14T14:40:20.373425+0000","last_became_peered":"2024-05-14T14:40:20.373425+0000","last_unstale":"2024-05-14T14:40:21.351359+0000","last_undegraded":"2024-05-14T14:40:21.351359+0000","last_fullsized":"2024-05-14T14:40:21.351359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:59:59.076038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352304+0000","last_change":"2024-05-14T14:40:15.971052+0000","last_active":"2024-05-14T14:40:21.352304+0000","last_peered":"2024-05-14T14:40:21.352304+0000","last_clean":"2024-05-14T14:40:21.352304+0000","last_became_active":"2024-05-14T14:40:15.970626+0000","last_became_peered":"2024-05-14T14:40:15.970626+0000","last_unstale":"2024-05-14T14:40:21.352304+0000","last_undegraded":"2024-05-14T14:40:21.352304+0000","last_fullsized":"2024-05-14T14:40:21.352304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:24:18.488847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353001+0000","last_change":"2024-05-14T14:40:14.945387+0000","last_active":"2024-05-14T14:40:21.353001+0000","last_peered":"2024-05-14T14:40:21.353001+0000","last_clean":"2024-05-14T14:40:21.353001+0000","last_became_active":"2024-05-14T14:40:14.945047+0000","last_became_peered":"2024-05-14T14:40:14.945047+0000","last_unstale":"2024-05-14T14:40:21.353001+0000","last_undegraded":"2024-05-14T14:40:21.353001+0000","last_fullsized":"2024-05-14T14:40:21.353001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:03:50.412968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351995+0000","last_change":"2024-05-14T14:40:20.378427+0000","last_active":"2024-05-14T14:40:21.351995+0000","last_peered":"2024-05-14T14:40:21.351995+0000","last_clean":"2024-05-14T14:40:21.351995+0000","last_became_active":"2024-05-14T14:40:20.377986+0000","last_became_peered":"2024-05-14T14:40:20.377986+0000","last_unstale":"2024-05-14T14:40:21.351995+0000","last_undegraded":"2024-05-14T14:40:21.351995+0000","last_fullsized":"2024-05-14T14:40:21.351995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:43:06.799558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353676+0000","last_change":"2024-05-14T14:40:15.961279+0000","last_active":"2024-05-14T14:40:21.353676+0000","last_peered":"2024-05-14T14:40:21.353676+0000","last_clean":"2024-05-14T14:40:21.353676+0000","last_became_active":"2024-05-14T14:40:15.960895+0000","last_became_peered":"2024-05-14T14:40:15.960895+0000","last_unstale":"2024-05-14T14:40:21.353676+0000","last_undegraded":"2024-05-14T14:40:21.353676+0000","last_fullsized":"2024-05-14T14:40:21.353676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:59:55.024165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353350+0000","last_change":"2024-05-14T14:40:14.952912+0000","last_active":"2024-05-14T14:40:21.353350+0000","last_peered":"2024-05-14T14:40:21.353350+0000","last_clean":"2024-05-14T14:40:21.353350+0000","last_became_active":"2024-05-14T14:40:14.952548+0000","last_became_peered":"2024-05-14T14:40:14.952548+0000","last_unstale":"2024-05-14T14:40:21.353350+0000","last_undegraded":"2024-05-14T14:40:21.353350+0000","last_fullsized":"2024-05-14T14:40:21.353350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:50:00.234669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352297+0000","last_change":"2024-05-14T14:40:20.372845+0000","last_active":"2024-05-14T14:40:21.352297+0000","last_peered":"2024-05-14T14:40:21.352297+0000","last_clean":"2024-05-14T14:40:21.352297+0000","last_became_active":"2024-05-14T14:40:20.372340+0000","last_became_peered":"2024-05-14T14:40:20.372340+0000","last_unstale":"2024-05-14T14:40:21.352297+0000","last_undegraded":"2024-05-14T14:40:21.352297+0000","last_fullsized":"2024-05-14T14:40:21.352297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:28:38.834985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.007718+0000","last_change":"2024-05-14T14:40:15.976323+0000","last_active":"2024-05-14T14:40:21.007718+0000","last_peered":"2024-05-14T14:40:21.007718+0000","last_clean":"2024-05-14T14:40:21.007718+0000","last_became_active":"2024-05-14T14:40:15.975931+0000","last_became_peered":"2024-05-14T14:40:15.975931+0000","last_unstale":"2024-05-14T14:40:21.007718+0000","last_undegraded":"2024-05-14T14:40:21.007718+0000","last_fullsized":"2024-05-14T14:40:21.007718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:00:58.953906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353806+0000","last_change":"2024-05-14T14:40:14.954043+0000","last_active":"2024-05-14T14:40:21.353806+0000","last_peered":"2024-05-14T14:40:21.353806+0000","last_clean":"2024-05-14T14:40:21.353806+0000","last_became_active":"2024-05-14T14:40:14.953734+0000","last_became_peered":"2024-05-14T14:40:14.953734+0000","last_unstale":"2024-05-14T14:40:21.353806+0000","last_undegraded":"2024-05-14T14:40:21.353806+0000","last_fullsized":"2024-05-14T14:40:21.353806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:42:43.352565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351130+0000","last_change":"2024-05-14T14:40:20.015959+0000","last_active":"2024-05-14T14:40:21.351130+0000","last_peered":"2024-05-14T14:40:21.351130+0000","last_clean":"2024-05-14T14:40:21.351130+0000","last_became_active":"2024-05-14T14:40:20.015515+0000","last_became_peered":"2024-05-14T14:40:20.015515+0000","last_unstale":"2024-05-14T14:40:21.351130+0000","last_undegraded":"2024-05-14T14:40:21.351130+0000","last_fullsized":"2024-05-14T14:40:21.351130+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:01:01.849694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352393+0000","last_change":"2024-05-14T14:40:15.950703+0000","last_active":"2024-05-14T14:40:21.352393+0000","last_peered":"2024-05-14T14:40:21.352393+0000","last_clean":"2024-05-14T14:40:21.352393+0000","last_became_active":"2024-05-14T14:40:15.950367+0000","last_became_peered":"2024-05-14T14:40:15.950367+0000","last_unstale":"2024-05-14T14:40:21.352393+0000","last_undegraded":"2024-05-14T14:40:21.352393+0000","last_fullsized":"2024-05-14T14:40:21.352393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:22:55.057837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006627+0000","last_change":"2024-05-14T14:40:14.942269+0000","last_active":"2024-05-14T14:40:21.006627+0000","last_peered":"2024-05-14T14:40:21.006627+0000","last_clean":"2024-05-14T14:40:21.006627+0000","last_became_active":"2024-05-14T14:40:14.941907+0000","last_became_peered":"2024-05-14T14:40:14.941907+0000","last_unstale":"2024-05-14T14:40:21.006627+0000","last_undegraded":"2024-05-14T14:40:21.006627+0000","last_fullsized":"2024-05-14T14:40:21.006627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:22:54.052167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353476+0000","last_change":"2024-05-14T14:40:20.021170+0000","last_active":"2024-05-14T14:40:21.353476+0000","last_peered":"2024-05-14T14:40:21.353476+0000","last_clean":"2024-05-14T14:40:21.353476+0000","last_became_active":"2024-05-14T14:40:20.019417+0000","last_became_peered":"2024-05-14T14:40:20.019417+0000","last_unstale":"2024-05-14T14:40:21.353476+0000","last_undegraded":"2024-05-14T14:40:21.353476+0000","last_fullsized":"2024-05-14T14:40:21.353476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:55:00.709986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351519+0000","last_change":"2024-05-14T14:40:15.962249+0000","last_active":"2024-05-14T14:40:21.351519+0000","last_peered":"2024-05-14T14:40:21.351519+0000","last_clean":"2024-05-14T14:40:21.351519+0000","last_became_active":"2024-05-14T14:40:15.961914+0000","last_became_peered":"2024-05-14T14:40:15.961914+0000","last_unstale":"2024-05-14T14:40:21.351519+0000","last_undegraded":"2024-05-14T14:40:21.351519+0000","last_fullsized":"2024-05-14T14:40:21.351519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:16:59.783346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.004576+0000","last_change":"2024-05-14T14:40:14.945511+0000","last_active":"2024-05-14T14:40:21.004576+0000","last_peered":"2024-05-14T14:40:21.004576+0000","last_clean":"2024-05-14T14:40:21.004576+0000","last_became_active":"2024-05-14T14:40:14.945162+0000","last_became_peered":"2024-05-14T14:40:14.945162+0000","last_unstale":"2024-05-14T14:40:21.004576+0000","last_undegraded":"2024-05-14T14:40:21.004576+0000","last_fullsized":"2024-05-14T14:40:21.004576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:03:50.412968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353899+0000","last_change":"2024-05-14T14:40:20.021422+0000","last_active":"2024-05-14T14:40:21.353899+0000","last_peered":"2024-05-14T14:40:21.353899+0000","last_clean":"2024-05-14T14:40:21.353899+0000","last_became_active":"2024-05-14T14:40:20.020363+0000","last_became_peered":"2024-05-14T14:40:20.020363+0000","last_unstale":"2024-05-14T14:40:21.353899+0000","last_undegraded":"2024-05-14T14:40:21.353899+0000","last_fullsized":"2024-05-14T14:40:21.353899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:09:34.037991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351255+0000","last_change":"2024-05-14T14:40:15.956227+0000","last_active":"2024-05-14T14:40:21.351255+0000","last_peered":"2024-05-14T14:40:21.351255+0000","last_clean":"2024-05-14T14:40:21.351255+0000","last_became_active":"2024-05-14T14:40:15.955850+0000","last_became_peered":"2024-05-14T14:40:15.955850+0000","last_unstale":"2024-05-14T14:40:21.351255+0000","last_undegraded":"2024-05-14T14:40:21.351255+0000","last_fullsized":"2024-05-14T14:40:21.351255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:19:45.703395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351460+0000","last_change":"2024-05-14T14:40:14.953611+0000","last_active":"2024-05-14T14:40:21.351460+0000","last_peered":"2024-05-14T14:40:21.351460+0000","last_clean":"2024-05-14T14:40:21.351460+0000","last_became_active":"2024-05-14T14:40:14.953288+0000","last_became_peered":"2024-05-14T14:40:14.953288+0000","last_unstale":"2024-05-14T14:40:21.351460+0000","last_undegraded":"2024-05-14T14:40:21.351460+0000","last_fullsized":"2024-05-14T14:40:21.351460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:22:54.052167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353571+0000","last_change":"2024-05-14T14:40:20.372908+0000","last_active":"2024-05-14T14:40:21.353571+0000","last_peered":"2024-05-14T14:40:21.353571+0000","last_clean":"2024-05-14T14:40:21.353571+0000","last_became_active":"2024-05-14T14:40:20.372440+0000","last_became_peered":"2024-05-14T14:40:20.372440+0000","last_unstale":"2024-05-14T14:40:21.353571+0000","last_undegraded":"2024-05-14T14:40:21.353571+0000","last_fullsized":"2024-05-14T14:40:21.353571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:36:41.517853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352312+0000","last_change":"2024-05-14T14:40:15.978286+0000","last_active":"2024-05-14T14:40:21.352312+0000","last_peered":"2024-05-14T14:40:21.352312+0000","last_clean":"2024-05-14T14:40:21.352312+0000","last_became_active":"2024-05-14T14:40:15.977864+0000","last_became_peered":"2024-05-14T14:40:15.977864+0000","last_unstale":"2024-05-14T14:40:21.352312+0000","last_undegraded":"2024-05-14T14:40:21.352312+0000","last_fullsized":"2024-05-14T14:40:21.352312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:16:59.783346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.005670+0000","last_change":"2024-05-14T14:40:14.939289+0000","last_active":"2024-05-14T14:40:21.005670+0000","last_peered":"2024-05-14T14:40:21.005670+0000","last_clean":"2024-05-14T14:40:21.005670+0000","last_became_active":"2024-05-14T14:40:14.938761+0000","last_became_peered":"2024-05-14T14:40:14.938761+0000","last_unstale":"2024-05-14T14:40:21.005670+0000","last_undegraded":"2024-05-14T14:40:21.005670+0000","last_fullsized":"2024-05-14T14:40:21.005670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:09:41.002376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":118,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351602+0000","last_change":"2024-05-14T14:40:06.302050+0000","last_active":"2024-05-14T14:40:21.351602+0000","last_peered":"2024-05-14T14:40:21.351602+0000","last_clean":"2024-05-14T14:40:21.351602+0000","last_became_active":"2024-05-14T14:40:06.300956+0000","last_became_peered":"2024-05-14T14:40:06.300956+0000","last_unstale":"2024-05-14T14:40:21.351602+0000","last_undegraded":"2024-05-14T14:40:21.351602+0000","last_fullsized":"2024-05-14T14:40:21.351602+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:04.850996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:04.850996+0000","last_clean_scrub_stamp":"2024-05-14T14:40:04.850996+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:08:41.028114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006296+0000","last_change":"2024-05-14T14:40:20.378549+0000","last_active":"2024-05-14T14:40:21.006296+0000","last_peered":"2024-05-14T14:40:21.006296+0000","last_clean":"2024-05-14T14:40:21.006296+0000","last_became_active":"2024-05-14T14:40:20.377998+0000","last_became_peered":"2024-05-14T14:40:20.377998+0000","last_unstale":"2024-05-14T14:40:21.006296+0000","last_undegraded":"2024-05-14T14:40:21.006296+0000","last_fullsized":"2024-05-14T14:40:21.006296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:01:01.849694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353100+0000","last_change":"2024-05-14T14:40:15.976278+0000","last_active":"2024-05-14T14:40:21.353100+0000","last_peered":"2024-05-14T14:40:21.353100+0000","last_clean":"2024-05-14T14:40:21.353100+0000","last_became_active":"2024-05-14T14:40:15.975906+0000","last_became_peered":"2024-05-14T14:40:15.975906+0000","last_unstale":"2024-05-14T14:40:21.353100+0000","last_undegraded":"2024-05-14T14:40:21.353100+0000","last_fullsized":"2024-05-14T14:40:21.353100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:41:42.097310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.004906+0000","last_change":"2024-05-14T14:40:14.949811+0000","last_active":"2024-05-14T14:40:21.004906+0000","last_peered":"2024-05-14T14:40:21.004906+0000","last_clean":"2024-05-14T14:40:21.004906+0000","last_became_active":"2024-05-14T14:40:14.949472+0000","last_became_peered":"2024-05-14T14:40:14.949472+0000","last_unstale":"2024-05-14T14:40:21.004906+0000","last_undegraded":"2024-05-14T14:40:21.004906+0000","last_fullsized":"2024-05-14T14:40:21.004906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:09:41.002376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.005991+0000","last_change":"2024-05-14T14:40:20.372940+0000","last_active":"2024-05-14T14:40:21.005991+0000","last_peered":"2024-05-14T14:40:21.005991+0000","last_clean":"2024-05-14T14:40:21.005991+0000","last_became_active":"2024-05-14T14:40:20.372407+0000","last_became_peered":"2024-05-14T14:40:20.372407+0000","last_unstale":"2024-05-14T14:40:21.005991+0000","last_undegraded":"2024-05-14T14:40:21.005991+0000","last_fullsized":"2024-05-14T14:40:21.005991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:28:38.834985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.007082+0000","last_change":"2024-05-14T14:40:15.972277+0000","last_active":"2024-05-14T14:40:21.007082+0000","last_peered":"2024-05-14T14:40:21.007082+0000","last_clean":"2024-05-14T14:40:21.007082+0000","last_became_active":"2024-05-14T14:40:15.971952+0000","last_became_peered":"2024-05-14T14:40:15.971952+0000","last_unstale":"2024-05-14T14:40:21.007082+0000","last_undegraded":"2024-05-14T14:40:21.007082+0000","last_fullsized":"2024-05-14T14:40:21.007082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:00:57.797820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352274+0000","last_change":"2024-05-14T14:40:14.940215+0000","last_active":"2024-05-14T14:40:21.352274+0000","last_peered":"2024-05-14T14:40:21.352274+0000","last_clean":"2024-05-14T14:40:21.352274+0000","last_became_active":"2024-05-14T14:40:14.939878+0000","last_became_peered":"2024-05-14T14:40:14.939878+0000","last_unstale":"2024-05-14T14:40:21.352274+0000","last_undegraded":"2024-05-14T14:40:21.352274+0000","last_fullsized":"2024-05-14T14:40:21.352274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:36:37.730760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352612+0000","last_change":"2024-05-14T14:40:20.022658+0000","last_active":"2024-05-14T14:40:21.352612+0000","last_peered":"2024-05-14T14:40:21.352612+0000","last_clean":"2024-05-14T14:40:21.352612+0000","last_became_active":"2024-05-14T14:40:20.022176+0000","last_became_peered":"2024-05-14T14:40:20.022176+0000","last_unstale":"2024-05-14T14:40:21.352612+0000","last_undegraded":"2024-05-14T14:40:21.352612+0000","last_fullsized":"2024-05-14T14:40:21.352612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:01:01.849694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352973+0000","last_change":"2024-05-14T14:40:15.973870+0000","last_active":"2024-05-14T14:40:21.352973+0000","last_peered":"2024-05-14T14:40:21.352973+0000","last_clean":"2024-05-14T14:40:21.352973+0000","last_became_active":"2024-05-14T14:40:15.973324+0000","last_became_peered":"2024-05-14T14:40:15.973324+0000","last_unstale":"2024-05-14T14:40:21.352973+0000","last_undegraded":"2024-05-14T14:40:21.352973+0000","last_fullsized":"2024-05-14T14:40:21.352973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:19:26.250841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.004828+0000","last_change":"2024-05-14T14:40:14.942944+0000","last_active":"2024-05-14T14:40:21.004828+0000","last_peered":"2024-05-14T14:40:21.004828+0000","last_clean":"2024-05-14T14:40:21.004828+0000","last_became_active":"2024-05-14T14:40:14.942604+0000","last_became_peered":"2024-05-14T14:40:14.942604+0000","last_unstale":"2024-05-14T14:40:21.004828+0000","last_undegraded":"2024-05-14T14:40:21.004828+0000","last_fullsized":"2024-05-14T14:40:21.004828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:42:43.352565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.005290+0000","last_change":"2024-05-14T14:40:20.373005+0000","last_active":"2024-05-14T14:40:21.005290+0000","last_peered":"2024-05-14T14:40:21.005290+0000","last_clean":"2024-05-14T14:40:21.005290+0000","last_became_active":"2024-05-14T14:40:20.372502+0000","last_became_peered":"2024-05-14T14:40:20.372502+0000","last_unstale":"2024-05-14T14:40:21.005290+0000","last_undegraded":"2024-05-14T14:40:21.005290+0000","last_fullsized":"2024-05-14T14:40:21.005290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:43:06.799558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352729+0000","last_change":"2024-05-14T14:40:15.978754+0000","last_active":"2024-05-14T14:40:21.352729+0000","last_peered":"2024-05-14T14:40:21.352729+0000","last_clean":"2024-05-14T14:40:21.352729+0000","last_became_active":"2024-05-14T14:40:15.978406+0000","last_became_peered":"2024-05-14T14:40:15.978406+0000","last_unstale":"2024-05-14T14:40:21.352729+0000","last_undegraded":"2024-05-14T14:40:21.352729+0000","last_fullsized":"2024-05-14T14:40:21.352729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:00:58.953906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352912+0000","last_change":"2024-05-14T14:40:14.950699+0000","last_active":"2024-05-14T14:40:21.352912+0000","last_peered":"2024-05-14T14:40:21.352912+0000","last_clean":"2024-05-14T14:40:21.352912+0000","last_became_active":"2024-05-14T14:40:14.950333+0000","last_became_peered":"2024-05-14T14:40:14.950333+0000","last_unstale":"2024-05-14T14:40:21.352912+0000","last_undegraded":"2024-05-14T14:40:21.352912+0000","last_fullsized":"2024-05-14T14:40:21.352912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:59:30.772720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351835+0000","last_change":"2024-05-14T14:40:20.019464+0000","last_active":"2024-05-14T14:40:21.351835+0000","last_peered":"2024-05-14T14:40:21.351835+0000","last_clean":"2024-05-14T14:40:21.351835+0000","last_became_active":"2024-05-14T14:40:20.018546+0000","last_became_peered":"2024-05-14T14:40:20.018546+0000","last_unstale":"2024-05-14T14:40:21.351835+0000","last_undegraded":"2024-05-14T14:40:21.351835+0000","last_fullsized":"2024-05-14T14:40:21.351835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:58:53.100702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352000+0000","last_change":"2024-05-14T14:40:15.979685+0000","last_active":"2024-05-14T14:40:21.352000+0000","last_peered":"2024-05-14T14:40:21.352000+0000","last_clean":"2024-05-14T14:40:21.352000+0000","last_became_active":"2024-05-14T14:40:15.979324+0000","last_became_peered":"2024-05-14T14:40:15.979324+0000","last_unstale":"2024-05-14T14:40:21.352000+0000","last_undegraded":"2024-05-14T14:40:21.352000+0000","last_fullsized":"2024-05-14T14:40:21.352000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:43:15.190648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.004331+0000","last_change":"2024-05-14T14:40:14.940764+0000","last_active":"2024-05-14T14:40:21.004331+0000","last_peered":"2024-05-14T14:40:21.004331+0000","last_clean":"2024-05-14T14:40:21.004331+0000","last_became_active":"2024-05-14T14:40:14.940412+0000","last_became_peered":"2024-05-14T14:40:14.940412+0000","last_unstale":"2024-05-14T14:40:21.004331+0000","last_undegraded":"2024-05-14T14:40:21.004331+0000","last_fullsized":"2024-05-14T14:40:21.004331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:04:43.508873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353379+0000","last_change":"2024-05-14T14:40:20.019451+0000","last_active":"2024-05-14T14:40:21.353379+0000","last_peered":"2024-05-14T14:40:21.353379+0000","last_clean":"2024-05-14T14:40:21.353379+0000","last_became_active":"2024-05-14T14:40:20.018790+0000","last_became_peered":"2024-05-14T14:40:20.018790+0000","last_unstale":"2024-05-14T14:40:21.353379+0000","last_undegraded":"2024-05-14T14:40:21.353379+0000","last_fullsized":"2024-05-14T14:40:21.353379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:55:00.709986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.005590+0000","last_change":"2024-05-14T14:40:15.967830+0000","last_active":"2024-05-14T14:40:21.005590+0000","last_peered":"2024-05-14T14:40:21.005590+0000","last_clean":"2024-05-14T14:40:21.005590+0000","last_became_active":"2024-05-14T14:40:15.967508+0000","last_became_peered":"2024-05-14T14:40:15.967508+0000","last_unstale":"2024-05-14T14:40:21.005590+0000","last_undegraded":"2024-05-14T14:40:21.005590+0000","last_fullsized":"2024-05-14T14:40:21.005590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:06:01.598712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006580+0000","last_change":"2024-05-14T14:40:14.940313+0000","last_active":"2024-05-14T14:40:21.006580+0000","last_peered":"2024-05-14T14:40:21.006580+0000","last_clean":"2024-05-14T14:40:21.006580+0000","last_became_active":"2024-05-14T14:40:14.939989+0000","last_became_peered":"2024-05-14T14:40:14.939989+0000","last_unstale":"2024-05-14T14:40:21.006580+0000","last_undegraded":"2024-05-14T14:40:21.006580+0000","last_fullsized":"2024-05-14T14:40:21.006580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:09:41.002376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352073+0000","last_change":"2024-05-14T14:40:20.379270+0000","last_active":"2024-05-14T14:40:21.352073+0000","last_peered":"2024-05-14T14:40:21.352073+0000","last_clean":"2024-05-14T14:40:21.352073+0000","last_became_active":"2024-05-14T14:40:20.378163+0000","last_became_peered":"2024-05-14T14:40:20.378163+0000","last_unstale":"2024-05-14T14:40:21.352073+0000","last_undegraded":"2024-05-14T14:40:21.352073+0000","last_fullsized":"2024-05-14T14:40:21.352073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:56:23.335268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352261+0000","last_change":"2024-05-14T14:40:15.979702+0000","last_active":"2024-05-14T14:40:21.352261+0000","last_peered":"2024-05-14T14:40:21.352261+0000","last_clean":"2024-05-14T14:40:21.352261+0000","last_became_active":"2024-05-14T14:40:15.978801+0000","last_became_peered":"2024-05-14T14:40:15.978801+0000","last_unstale":"2024-05-14T14:40:21.352261+0000","last_undegraded":"2024-05-14T14:40:21.352261+0000","last_fullsized":"2024-05-14T14:40:21.352261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:28:34.783112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006507+0000","last_change":"2024-05-14T14:40:14.946153+0000","last_active":"2024-05-14T14:40:21.006507+0000","last_peered":"2024-05-14T14:40:21.006507+0000","last_clean":"2024-05-14T14:40:21.006507+0000","last_became_active":"2024-05-14T14:40:14.945598+0000","last_became_peered":"2024-05-14T14:40:14.945598+0000","last_unstale":"2024-05-14T14:40:21.006507+0000","last_undegraded":"2024-05-14T14:40:21.006507+0000","last_fullsized":"2024-05-14T14:40:21.006507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:30:28.647287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352265+0000","last_change":"2024-05-14T14:40:20.373021+0000","last_active":"2024-05-14T14:40:21.352265+0000","last_peered":"2024-05-14T14:40:21.352265+0000","last_clean":"2024-05-14T14:40:21.352265+0000","last_became_active":"2024-05-14T14:40:20.372611+0000","last_became_peered":"2024-05-14T14:40:20.372611+0000","last_unstale":"2024-05-14T14:40:21.352265+0000","last_undegraded":"2024-05-14T14:40:21.352265+0000","last_fullsized":"2024-05-14T14:40:21.352265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:20:04.831495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352027+0000","last_change":"2024-05-14T14:40:15.963419+0000","last_active":"2024-05-14T14:40:21.352027+0000","last_peered":"2024-05-14T14:40:21.352027+0000","last_clean":"2024-05-14T14:40:21.352027+0000","last_became_active":"2024-05-14T14:40:15.963015+0000","last_became_peered":"2024-05-14T14:40:15.963015+0000","last_unstale":"2024-05-14T14:40:21.352027+0000","last_undegraded":"2024-05-14T14:40:21.352027+0000","last_fullsized":"2024-05-14T14:40:21.352027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:02:28.598796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353002+0000","last_change":"2024-05-14T14:40:14.950887+0000","last_active":"2024-05-14T14:40:21.353002+0000","last_peered":"2024-05-14T14:40:21.353002+0000","last_clean":"2024-05-14T14:40:21.353002+0000","last_became_active":"2024-05-14T14:40:14.950546+0000","last_became_peered":"2024-05-14T14:40:14.950546+0000","last_unstale":"2024-05-14T14:40:21.353002+0000","last_undegraded":"2024-05-14T14:40:21.353002+0000","last_fullsized":"2024-05-14T14:40:21.353002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:15:53.584304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.007527+0000","last_change":"2024-05-14T14:40:20.378686+0000","last_active":"2024-05-14T14:40:21.007527+0000","last_peered":"2024-05-14T14:40:21.007527+0000","last_clean":"2024-05-14T14:40:21.007527+0000","last_became_active":"2024-05-14T14:40:20.378123+0000","last_became_peered":"2024-05-14T14:40:20.378123+0000","last_unstale":"2024-05-14T14:40:21.007527+0000","last_undegraded":"2024-05-14T14:40:21.007527+0000","last_fullsized":"2024-05-14T14:40:21.007527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:56:23.335268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352960+0000","last_change":"2024-05-14T14:40:15.973748+0000","last_active":"2024-05-14T14:40:21.352960+0000","last_peered":"2024-05-14T14:40:21.352960+0000","last_clean":"2024-05-14T14:40:21.352960+0000","last_became_active":"2024-05-14T14:40:15.972604+0000","last_became_peered":"2024-05-14T14:40:15.972604+0000","last_unstale":"2024-05-14T14:40:21.352960+0000","last_undegraded":"2024-05-14T14:40:21.352960+0000","last_fullsized":"2024-05-14T14:40:21.352960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:00:57.797820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":28,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006767+0000","last_change":"2024-05-14T14:40:14.953883+0000","last_active":"2024-05-14T14:40:21.006767+0000","last_peered":"2024-05-14T14:40:21.006767+0000","last_clean":"2024-05-14T14:40:21.006767+0000","last_became_active":"2024-05-14T14:40:14.953540+0000","last_became_peered":"2024-05-14T14:40:14.953540+0000","last_unstale":"2024-05-14T14:40:21.006767+0000","last_undegraded":"2024-05-14T14:40:21.006767+0000","last_fullsized":"2024-05-14T14:40:21.006767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:22:54.052167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353319+0000","last_change":"2024-05-14T14:40:20.017238+0000","last_active":"2024-05-14T14:40:21.353319+0000","last_peered":"2024-05-14T14:40:21.353319+0000","last_clean":"2024-05-14T14:40:21.353319+0000","last_became_active":"2024-05-14T14:40:20.016725+0000","last_became_peered":"2024-05-14T14:40:20.016725+0000","last_unstale":"2024-05-14T14:40:21.353319+0000","last_undegraded":"2024-05-14T14:40:21.353319+0000","last_fullsized":"2024-05-14T14:40:21.353319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:01:03.005779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352553+0000","last_change":"2024-05-14T14:40:15.965371+0000","last_active":"2024-05-14T14:40:21.352553+0000","last_peered":"2024-05-14T14:40:21.352553+0000","last_clean":"2024-05-14T14:40:21.352553+0000","last_became_active":"2024-05-14T14:40:15.964988+0000","last_became_peered":"2024-05-14T14:40:15.964988+0000","last_unstale":"2024-05-14T14:40:21.352553+0000","last_undegraded":"2024-05-14T14:40:21.352553+0000","last_fullsized":"2024-05-14T14:40:21.352553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:17:12.953751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352156+0000","last_change":"2024-05-14T14:40:14.950270+0000","last_active":"2024-05-14T14:40:21.352156+0000","last_peered":"2024-05-14T14:40:21.352156+0000","last_clean":"2024-05-14T14:40:21.352156+0000","last_became_active":"2024-05-14T14:40:14.949473+0000","last_became_peered":"2024-05-14T14:40:14.949473+0000","last_unstale":"2024-05-14T14:40:21.352156+0000","last_undegraded":"2024-05-14T14:40:21.352156+0000","last_fullsized":"2024-05-14T14:40:21.352156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:22:54.052167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351973+0000","last_change":"2024-05-14T14:40:20.008055+0000","last_active":"2024-05-14T14:40:21.351973+0000","last_peered":"2024-05-14T14:40:21.351973+0000","last_clean":"2024-05-14T14:40:21.351973+0000","last_became_active":"2024-05-14T14:40:20.007482+0000","last_became_peered":"2024-05-14T14:40:20.007482+0000","last_unstale":"2024-05-14T14:40:21.351973+0000","last_undegraded":"2024-05-14T14:40:21.351973+0000","last_fullsized":"2024-05-14T14:40:21.351973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:20:24.893525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353866+0000","last_change":"2024-05-14T14:40:15.954872+0000","last_active":"2024-05-14T14:40:21.353866+0000","last_peered":"2024-05-14T14:40:21.353866+0000","last_clean":"2024-05-14T14:40:21.353866+0000","last_became_active":"2024-05-14T14:40:15.954475+0000","last_became_peered":"2024-05-14T14:40:15.954475+0000","last_unstale":"2024-05-14T14:40:21.353866+0000","last_undegraded":"2024-05-14T14:40:21.353866+0000","last_fullsized":"2024-05-14T14:40:21.353866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:16:59.783346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.007184+0000","last_change":"2024-05-14T14:40:14.946318+0000","last_active":"2024-05-14T14:40:21.007184+0000","last_peered":"2024-05-14T14:40:21.007184+0000","last_clean":"2024-05-14T14:40:21.007184+0000","last_became_active":"2024-05-14T14:40:14.945963+0000","last_became_peered":"2024-05-14T14:40:14.945963+0000","last_unstale":"2024-05-14T14:40:21.007184+0000","last_undegraded":"2024-05-14T14:40:21.007184+0000","last_fullsized":"2024-05-14T14:40:21.007184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:03:50.412968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351737+0000","last_change":"2024-05-14T14:40:20.012702+0000","last_active":"2024-05-14T14:40:21.351737+0000","last_peered":"2024-05-14T14:40:21.351737+0000","last_clean":"2024-05-14T14:40:21.351737+0000","last_became_active":"2024-05-14T14:40:20.012262+0000","last_became_peered":"2024-05-14T14:40:20.012262+0000","last_unstale":"2024-05-14T14:40:21.351737+0000","last_undegraded":"2024-05-14T14:40:21.351737+0000","last_fullsized":"2024-05-14T14:40:21.351737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:12:03.474411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.007052+0000","last_change":"2024-05-14T14:40:15.967089+0000","last_active":"2024-05-14T14:40:21.007052+0000","last_peered":"2024-05-14T14:40:21.007052+0000","last_clean":"2024-05-14T14:40:21.007052+0000","last_became_active":"2024-05-14T14:40:15.963492+0000","last_became_peered":"2024-05-14T14:40:15.963492+0000","last_unstale":"2024-05-14T14:40:21.007052+0000","last_undegraded":"2024-05-14T14:40:21.007052+0000","last_fullsized":"2024-05-14T14:40:21.007052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:54:56.658112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006874+0000","last_change":"2024-05-14T14:40:14.949559+0000","last_active":"2024-05-14T14:40:21.006874+0000","last_peered":"2024-05-14T14:40:21.006874+0000","last_clean":"2024-05-14T14:40:21.006874+0000","last_became_active":"2024-05-14T14:40:14.949108+0000","last_became_peered":"2024-05-14T14:40:14.949108+0000","last_unstale":"2024-05-14T14:40:21.006874+0000","last_undegraded":"2024-05-14T14:40:21.006874+0000","last_fullsized":"2024-05-14T14:40:21.006874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:03:50.412968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352199+0000","last_change":"2024-05-14T14:40:20.380409+0000","last_active":"2024-05-14T14:40:21.352199+0000","last_peered":"2024-05-14T14:40:21.352199+0000","last_clean":"2024-05-14T14:40:21.352199+0000","last_became_active":"2024-05-14T14:40:20.377982+0000","last_became_peered":"2024-05-14T14:40:20.377982+0000","last_unstale":"2024-05-14T14:40:21.352199+0000","last_undegraded":"2024-05-14T14:40:21.352199+0000","last_fullsized":"2024-05-14T14:40:21.352199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:54:43.610454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353208+0000","last_change":"2024-05-14T14:40:20.378415+0000","last_active":"2024-05-14T14:40:21.353208+0000","last_peered":"2024-05-14T14:40:21.353208+0000","last_clean":"2024-05-14T14:40:21.353208+0000","last_became_active":"2024-05-14T14:40:20.378008+0000","last_became_peered":"2024-05-14T14:40:20.378008+0000","last_unstale":"2024-05-14T14:40:21.353208+0000","last_undegraded":"2024-05-14T14:40:21.353208+0000","last_fullsized":"2024-05-14T14:40:21.353208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:01:03.005779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351155+0000","last_change":"2024-05-14T14:40:15.973814+0000","last_active":"2024-05-14T14:40:21.351155+0000","last_peered":"2024-05-14T14:40:21.351155+0000","last_clean":"2024-05-14T14:40:21.351155+0000","last_became_active":"2024-05-14T14:40:15.972930+0000","last_became_peered":"2024-05-14T14:40:15.972930+0000","last_unstale":"2024-05-14T14:40:21.351155+0000","last_undegraded":"2024-05-14T14:40:21.351155+0000","last_fullsized":"2024-05-14T14:40:21.351155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:54:04.167075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.005569+0000","last_change":"2024-05-14T14:40:14.940248+0000","last_active":"2024-05-14T14:40:21.005569+0000","last_peered":"2024-05-14T14:40:21.005569+0000","last_clean":"2024-05-14T14:40:21.005569+0000","last_became_active":"2024-05-14T14:40:14.938524+0000","last_became_peered":"2024-05-14T14:40:14.938524+0000","last_unstale":"2024-05-14T14:40:21.005569+0000","last_undegraded":"2024-05-14T14:40:21.005569+0000","last_fullsized":"2024-05-14T14:40:21.005569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:42:43.352565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006899+0000","last_change":"2024-05-14T14:40:20.017769+0000","last_active":"2024-05-14T14:40:21.006899+0000","last_peered":"2024-05-14T14:40:21.006899+0000","last_clean":"2024-05-14T14:40:21.006899+0000","last_became_active":"2024-05-14T14:40:20.017248+0000","last_became_peered":"2024-05-14T14:40:20.017248+0000","last_unstale":"2024-05-14T14:40:21.006899+0000","last_undegraded":"2024-05-14T14:40:21.006899+0000","last_fullsized":"2024-05-14T14:40:21.006899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:01:03.005779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351813+0000","last_change":"2024-05-14T14:40:15.970841+0000","last_active":"2024-05-14T14:40:21.351813+0000","last_peered":"2024-05-14T14:40:21.351813+0000","last_clean":"2024-05-14T14:40:21.351813+0000","last_became_active":"2024-05-14T14:40:15.970405+0000","last_became_peered":"2024-05-14T14:40:15.970405+0000","last_unstale":"2024-05-14T14:40:21.351813+0000","last_undegraded":"2024-05-14T14:40:21.351813+0000","last_fullsized":"2024-05-14T14:40:21.351813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:06:01.598712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351688+0000","last_change":"2024-05-14T14:40:14.952894+0000","last_active":"2024-05-14T14:40:21.351688+0000","last_peered":"2024-05-14T14:40:21.351688+0000","last_clean":"2024-05-14T14:40:21.351688+0000","last_became_active":"2024-05-14T14:40:14.952591+0000","last_became_peered":"2024-05-14T14:40:14.952591+0000","last_unstale":"2024-05-14T14:40:21.351688+0000","last_undegraded":"2024-05-14T14:40:21.351688+0000","last_fullsized":"2024-05-14T14:40:21.351688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:09:41.002376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006239+0000","last_change":"2024-05-14T14:40:14.942311+0000","last_active":"2024-05-14T14:40:21.006239+0000","last_peered":"2024-05-14T14:40:21.006239+0000","last_clean":"2024-05-14T14:40:21.006239+0000","last_became_active":"2024-05-14T14:40:14.941964+0000","last_became_peered":"2024-05-14T14:40:14.941964+0000","last_unstale":"2024-05-14T14:40:21.006239+0000","last_undegraded":"2024-05-14T14:40:21.006239+0000","last_fullsized":"2024-05-14T14:40:21.006239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:42:43.352565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352830+0000","last_change":"2024-05-14T14:40:15.955268+0000","last_active":"2024-05-14T14:40:21.352830+0000","last_peered":"2024-05-14T14:40:21.352830+0000","last_clean":"2024-05-14T14:40:21.352830+0000","last_became_active":"2024-05-14T14:40:15.954880+0000","last_became_peered":"2024-05-14T14:40:15.954880+0000","last_unstale":"2024-05-14T14:40:21.352830+0000","last_undegraded":"2024-05-14T14:40:21.352830+0000","last_fullsized":"2024-05-14T14:40:21.352830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:24:18.488847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.004720+0000","last_change":"2024-05-14T14:40:20.009663+0000","last_active":"2024-05-14T14:40:21.004720+0000","last_peered":"2024-05-14T14:40:21.004720+0000","last_clean":"2024-05-14T14:40:21.004720+0000","last_became_active":"2024-05-14T14:40:20.009220+0000","last_became_peered":"2024-05-14T14:40:20.009220+0000","last_unstale":"2024-05-14T14:40:21.004720+0000","last_undegraded":"2024-05-14T14:40:21.004720+0000","last_fullsized":"2024-05-14T14:40:21.004720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:19:49.755269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352741+0000","last_change":"2024-05-14T14:40:14.947750+0000","last_active":"2024-05-14T14:40:21.352741+0000","last_peered":"2024-05-14T14:40:21.352741+0000","last_clean":"2024-05-14T14:40:21.352741+0000","last_became_active":"2024-05-14T14:40:14.947440+0000","last_became_peered":"2024-05-14T14:40:14.947440+0000","last_unstale":"2024-05-14T14:40:21.352741+0000","last_undegraded":"2024-05-14T14:40:21.352741+0000","last_fullsized":"2024-05-14T14:40:21.352741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:48:44.948315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352347+0000","last_change":"2024-05-14T14:40:15.970419+0000","last_active":"2024-05-14T14:40:21.352347+0000","last_peered":"2024-05-14T14:40:21.352347+0000","last_clean":"2024-05-14T14:40:21.352347+0000","last_became_active":"2024-05-14T14:40:15.969621+0000","last_became_peered":"2024-05-14T14:40:15.969621+0000","last_unstale":"2024-05-14T14:40:21.352347+0000","last_undegraded":"2024-05-14T14:40:21.352347+0000","last_fullsized":"2024-05-14T14:40:21.352347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:03:51.418638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353215+0000","last_change":"2024-05-14T14:40:20.023154+0000","last_active":"2024-05-14T14:40:21.353215+0000","last_peered":"2024-05-14T14:40:21.353215+0000","last_clean":"2024-05-14T14:40:21.353215+0000","last_became_active":"2024-05-14T14:40:20.022012+0000","last_became_peered":"2024-05-14T14:40:20.022012+0000","last_unstale":"2024-05-14T14:40:21.353215+0000","last_undegraded":"2024-05-14T14:40:21.353215+0000","last_fullsized":"2024-05-14T14:40:21.353215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:52:47.149904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.005435+0000","last_change":"2024-05-14T14:40:15.968635+0000","last_active":"2024-05-14T14:40:21.005435+0000","last_peered":"2024-05-14T14:40:21.005435+0000","last_clean":"2024-05-14T14:40:21.005435+0000","last_became_active":"2024-05-14T14:40:15.968332+0000","last_became_peered":"2024-05-14T14:40:15.968332+0000","last_unstale":"2024-05-14T14:40:21.005435+0000","last_undegraded":"2024-05-14T14:40:21.005435+0000","last_fullsized":"2024-05-14T14:40:21.005435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:23:34.578655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.004351+0000","last_change":"2024-05-14T14:40:15.976612+0000","last_active":"2024-05-14T14:40:21.004351+0000","last_peered":"2024-05-14T14:40:21.004351+0000","last_clean":"2024-05-14T14:40:21.004351+0000","last_became_active":"2024-05-14T14:40:15.975536+0000","last_became_peered":"2024-05-14T14:40:15.975536+0000","last_unstale":"2024-05-14T14:40:21.004351+0000","last_undegraded":"2024-05-14T14:40:21.004351+0000","last_fullsized":"2024-05-14T14:40:21.004351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:17:12.953751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006389+0000","last_change":"2024-05-14T14:40:15.977511+0000","last_active":"2024-05-14T14:40:21.006389+0000","last_peered":"2024-05-14T14:40:21.006389+0000","last_clean":"2024-05-14T14:40:21.006389+0000","last_became_active":"2024-05-14T14:40:15.977176+0000","last_became_peered":"2024-05-14T14:40:15.977176+0000","last_unstale":"2024-05-14T14:40:21.006389+0000","last_undegraded":"2024-05-14T14:40:21.006389+0000","last_fullsized":"2024-05-14T14:40:21.006389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:32:21.620701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352721+0000","last_change":"2024-05-14T14:40:15.969442+0000","last_active":"2024-05-14T14:40:21.352721+0000","last_peered":"2024-05-14T14:40:21.352721+0000","last_clean":"2024-05-14T14:40:21.352721+0000","last_became_active":"2024-05-14T14:40:15.968989+0000","last_became_peered":"2024-05-14T14:40:15.968989+0000","last_unstale":"2024-05-14T14:40:21.352721+0000","last_undegraded":"2024-05-14T14:40:21.352721+0000","last_fullsized":"2024-05-14T14:40:21.352721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:59:55.024165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352423+0000","last_change":"2024-05-14T14:40:15.981801+0000","last_active":"2024-05-14T14:40:21.352423+0000","last_peered":"2024-05-14T14:40:21.352423+0000","last_clean":"2024-05-14T14:40:21.352423+0000","last_became_active":"2024-05-14T14:40:15.981444+0000","last_became_peered":"2024-05-14T14:40:15.981444+0000","last_unstale":"2024-05-14T14:40:21.352423+0000","last_undegraded":"2024-05-14T14:40:21.352423+0000","last_fullsized":"2024-05-14T14:40:21.352423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:59:55.024165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351958+0000","last_change":"2024-05-14T14:40:15.973771+0000","last_active":"2024-05-14T14:40:21.351958+0000","last_peered":"2024-05-14T14:40:21.351958+0000","last_clean":"2024-05-14T14:40:21.351958+0000","last_became_active":"2024-05-14T14:40:15.973388+0000","last_became_peered":"2024-05-14T14:40:15.973388+0000","last_unstale":"2024-05-14T14:40:21.351958+0000","last_undegraded":"2024-05-14T14:40:21.351958+0000","last_fullsized":"2024-05-14T14:40:21.351958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:53.130907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006356+0000","last_change":"2024-05-14T14:40:15.969745+0000","last_active":"2024-05-14T14:40:21.006356+0000","last_peered":"2024-05-14T14:40:21.006356+0000","last_clean":"2024-05-14T14:40:21.006356+0000","last_became_active":"2024-05-14T14:40:15.969412+0000","last_became_peered":"2024-05-14T14:40:15.969412+0000","last_unstale":"2024-05-14T14:40:21.006356+0000","last_undegraded":"2024-05-14T14:40:21.006356+0000","last_fullsized":"2024-05-14T14:40:21.006356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:24:18.488847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352189+0000","last_change":"2024-05-14T14:40:15.982718+0000","last_active":"2024-05-14T14:40:21.352189+0000","last_peered":"2024-05-14T14:40:21.352189+0000","last_clean":"2024-05-14T14:40:21.352189+0000","last_became_active":"2024-05-14T14:40:15.982354+0000","last_became_peered":"2024-05-14T14:40:15.982354+0000","last_unstale":"2024-05-14T14:40:21.352189+0000","last_undegraded":"2024-05-14T14:40:21.352189+0000","last_fullsized":"2024-05-14T14:40:21.352189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:32:21.620701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.005438+0000","last_change":"2024-05-14T14:40:15.966798+0000","last_active":"2024-05-14T14:40:21.005438+0000","last_peered":"2024-05-14T14:40:21.005438+0000","last_clean":"2024-05-14T14:40:21.005438+0000","last_became_active":"2024-05-14T14:40:15.966408+0000","last_became_peered":"2024-05-14T14:40:15.966408+0000","last_unstale":"2024-05-14T14:40:21.005438+0000","last_undegraded":"2024-05-14T14:40:21.005438+0000","last_fullsized":"2024-05-14T14:40:21.005438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:24:18.488847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351504+0000","last_change":"2024-05-14T14:40:15.970022+0000","last_active":"2024-05-14T14:40:21.351504+0000","last_peered":"2024-05-14T14:40:21.351504+0000","last_clean":"2024-05-14T14:40:21.351504+0000","last_became_active":"2024-05-14T14:40:15.969695+0000","last_became_peered":"2024-05-14T14:40:15.969695+0000","last_unstale":"2024-05-14T14:40:21.351504+0000","last_undegraded":"2024-05-14T14:40:21.351504+0000","last_fullsized":"2024-05-14T14:40:21.351504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:58:49.048828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006273+0000","last_change":"2024-05-14T14:40:15.963064+0000","last_active":"2024-05-14T14:40:21.006273+0000","last_peered":"2024-05-14T14:40:21.006273+0000","last_clean":"2024-05-14T14:40:21.006273+0000","last_became_active":"2024-05-14T14:40:15.962710+0000","last_became_peered":"2024-05-14T14:40:15.962710+0000","last_unstale":"2024-05-14T14:40:21.006273+0000","last_undegraded":"2024-05-14T14:40:21.006273+0000","last_fullsized":"2024-05-14T14:40:21.006273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:20:20.841651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352408+0000","last_change":"2024-05-14T14:40:15.967114+0000","last_active":"2024-05-14T14:40:21.352408+0000","last_peered":"2024-05-14T14:40:21.352408+0000","last_clean":"2024-05-14T14:40:21.352408+0000","last_became_active":"2024-05-14T14:40:15.966769+0000","last_became_peered":"2024-05-14T14:40:15.966769+0000","last_unstale":"2024-05-14T14:40:21.352408+0000","last_undegraded":"2024-05-14T14:40:21.352408+0000","last_fullsized":"2024-05-14T14:40:21.352408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:54:04.167075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006690+0000","last_change":"2024-05-14T14:40:15.959522+0000","last_active":"2024-05-14T14:40:21.006690+0000","last_peered":"2024-05-14T14:40:21.006690+0000","last_clean":"2024-05-14T14:40:21.006690+0000","last_became_active":"2024-05-14T14:40:15.959175+0000","last_became_peered":"2024-05-14T14:40:15.959175+0000","last_unstale":"2024-05-14T14:40:21.006690+0000","last_undegraded":"2024-05-14T14:40:21.006690+0000","last_fullsized":"2024-05-14T14:40:21.006690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:16:59.783346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353319+0000","last_change":"2024-05-14T14:40:15.965742+0000","last_active":"2024-05-14T14:40:21.353319+0000","last_peered":"2024-05-14T14:40:21.353319+0000","last_clean":"2024-05-14T14:40:21.353319+0000","last_became_active":"2024-05-14T14:40:15.965402+0000","last_became_peered":"2024-05-14T14:40:15.965402+0000","last_unstale":"2024-05-14T14:40:21.353319+0000","last_undegraded":"2024-05-14T14:40:21.353319+0000","last_fullsized":"2024-05-14T14:40:21.353319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:54:56.658112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.004698+0000","last_change":"2024-05-14T14:40:15.958876+0000","last_active":"2024-05-14T14:40:21.004698+0000","last_peered":"2024-05-14T14:40:21.004698+0000","last_clean":"2024-05-14T14:40:21.004698+0000","last_became_active":"2024-05-14T14:40:15.958527+0000","last_became_peered":"2024-05-14T14:40:15.958527+0000","last_unstale":"2024-05-14T14:40:21.004698+0000","last_undegraded":"2024-05-14T14:40:21.004698+0000","last_fullsized":"2024-05-14T14:40:21.004698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:36:38.736430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.007564+0000","last_change":"2024-05-14T14:40:15.962954+0000","last_active":"2024-05-14T14:40:21.007564+0000","last_peered":"2024-05-14T14:40:21.007564+0000","last_clean":"2024-05-14T14:40:21.007564+0000","last_became_active":"2024-05-14T14:40:15.962607+0000","last_became_peered":"2024-05-14T14:40:15.962607+0000","last_unstale":"2024-05-14T14:40:21.007564+0000","last_undegraded":"2024-05-14T14:40:21.007564+0000","last_fullsized":"2024-05-14T14:40:21.007564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:36:37.465980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.005302+0000","last_change":"2024-05-14T14:40:15.959274+0000","last_active":"2024-05-14T14:40:21.005302+0000","last_peered":"2024-05-14T14:40:21.005302+0000","last_clean":"2024-05-14T14:40:21.005302+0000","last_became_active":"2024-05-14T14:40:15.958645+0000","last_became_peered":"2024-05-14T14:40:15.958645+0000","last_unstale":"2024-05-14T14:40:21.005302+0000","last_undegraded":"2024-05-14T14:40:21.005302+0000","last_fullsized":"2024-05-14T14:40:21.005302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:59:55.024165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351254+0000","last_change":"2024-05-14T14:40:15.969772+0000","last_active":"2024-05-14T14:40:21.351254+0000","last_peered":"2024-05-14T14:40:21.351254+0000","last_clean":"2024-05-14T14:40:21.351254+0000","last_became_active":"2024-05-14T14:40:15.969426+0000","last_became_peered":"2024-05-14T14:40:15.969426+0000","last_unstale":"2024-05-14T14:40:21.351254+0000","last_undegraded":"2024-05-14T14:40:21.351254+0000","last_fullsized":"2024-05-14T14:40:21.351254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:23:34.578655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351920+0000","last_change":"2024-05-14T14:40:15.968134+0000","last_active":"2024-05-14T14:40:21.351920+0000","last_peered":"2024-05-14T14:40:21.351920+0000","last_clean":"2024-05-14T14:40:21.351920+0000","last_became_active":"2024-05-14T14:40:15.967777+0000","last_became_peered":"2024-05-14T14:40:15.967777+0000","last_unstale":"2024-05-14T14:40:21.351920+0000","last_undegraded":"2024-05-14T14:40:21.351920+0000","last_fullsized":"2024-05-14T14:40:21.351920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:55:12.523931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352640+0000","last_change":"2024-05-14T14:40:15.968186+0000","last_active":"2024-05-14T14:40:21.352640+0000","last_peered":"2024-05-14T14:40:21.352640+0000","last_clean":"2024-05-14T14:40:21.352640+0000","last_became_active":"2024-05-14T14:40:15.967015+0000","last_became_peered":"2024-05-14T14:40:15.967015+0000","last_unstale":"2024-05-14T14:40:21.352640+0000","last_undegraded":"2024-05-14T14:40:21.352640+0000","last_fullsized":"2024-05-14T14:40:21.352640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:20:20.841651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352491+0000","last_change":"2024-05-14T14:40:15.957490+0000","last_active":"2024-05-14T14:40:21.352491+0000","last_peered":"2024-05-14T14:40:21.352491+0000","last_clean":"2024-05-14T14:40:21.352491+0000","last_became_active":"2024-05-14T14:40:15.957138+0000","last_became_peered":"2024-05-14T14:40:15.957138+0000","last_unstale":"2024-05-14T14:40:21.352491+0000","last_undegraded":"2024-05-14T14:40:21.352491+0000","last_fullsized":"2024-05-14T14:40:21.352491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:36:38.736430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.007117+0000","last_change":"2024-05-14T14:40:15.980390+0000","last_active":"2024-05-14T14:40:21.007117+0000","last_peered":"2024-05-14T14:40:21.007117+0000","last_clean":"2024-05-14T14:40:21.007117+0000","last_became_active":"2024-05-14T14:40:15.975197+0000","last_became_peered":"2024-05-14T14:40:15.975197+0000","last_unstale":"2024-05-14T14:40:21.007117+0000","last_undegraded":"2024-05-14T14:40:21.007117+0000","last_fullsized":"2024-05-14T14:40:21.007117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:53.130907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006219+0000","last_change":"2024-05-14T14:40:15.980514+0000","last_active":"2024-05-14T14:40:21.006219+0000","last_peered":"2024-05-14T14:40:21.006219+0000","last_clean":"2024-05-14T14:40:21.006219+0000","last_became_active":"2024-05-14T14:40:15.980024+0000","last_became_peered":"2024-05-14T14:40:15.980024+0000","last_unstale":"2024-05-14T14:40:21.006219+0000","last_undegraded":"2024-05-14T14:40:21.006219+0000","last_fullsized":"2024-05-14T14:40:21.006219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:59:55.024165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352960+0000","last_change":"2024-05-14T14:40:15.977265+0000","last_active":"2024-05-14T14:40:21.352960+0000","last_peered":"2024-05-14T14:40:21.352960+0000","last_clean":"2024-05-14T14:40:21.352960+0000","last_became_active":"2024-05-14T14:40:15.976826+0000","last_became_peered":"2024-05-14T14:40:15.976826+0000","last_unstale":"2024-05-14T14:40:21.352960+0000","last_undegraded":"2024-05-14T14:40:21.352960+0000","last_fullsized":"2024-05-14T14:40:21.352960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:36:37.465980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351694+0000","last_change":"2024-05-14T14:40:15.979087+0000","last_active":"2024-05-14T14:40:21.351694+0000","last_peered":"2024-05-14T14:40:21.351694+0000","last_clean":"2024-05-14T14:40:21.351694+0000","last_became_active":"2024-05-14T14:40:15.978749+0000","last_became_peered":"2024-05-14T14:40:15.978749+0000","last_unstale":"2024-05-14T14:40:21.351694+0000","last_undegraded":"2024-05-14T14:40:21.351694+0000","last_fullsized":"2024-05-14T14:40:21.351694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:54:04.167075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351866+0000","last_change":"2024-05-14T14:40:15.972565+0000","last_active":"2024-05-14T14:40:21.351866+0000","last_peered":"2024-05-14T14:40:21.351866+0000","last_clean":"2024-05-14T14:40:21.351866+0000","last_became_active":"2024-05-14T14:40:15.972197+0000","last_became_peered":"2024-05-14T14:40:15.972197+0000","last_unstale":"2024-05-14T14:40:21.351866+0000","last_undegraded":"2024-05-14T14:40:21.351866+0000","last_fullsized":"2024-05-14T14:40:21.351866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:20:20.841651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006142+0000","last_change":"2024-05-14T14:40:15.962025+0000","last_active":"2024-05-14T14:40:21.006142+0000","last_peered":"2024-05-14T14:40:21.006142+0000","last_clean":"2024-05-14T14:40:21.006142+0000","last_became_active":"2024-05-14T14:40:15.961314+0000","last_became_peered":"2024-05-14T14:40:15.961314+0000","last_unstale":"2024-05-14T14:40:21.006142+0000","last_undegraded":"2024-05-14T14:40:21.006142+0000","last_fullsized":"2024-05-14T14:40:21.006142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:58:49.048828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352128+0000","last_change":"2024-05-14T14:40:15.964970+0000","last_active":"2024-05-14T14:40:21.352128+0000","last_peered":"2024-05-14T14:40:21.352128+0000","last_clean":"2024-05-14T14:40:21.352128+0000","last_became_active":"2024-05-14T14:40:15.964611+0000","last_became_peered":"2024-05-14T14:40:15.964611+0000","last_unstale":"2024-05-14T14:40:21.352128+0000","last_undegraded":"2024-05-14T14:40:21.352128+0000","last_fullsized":"2024-05-14T14:40:21.352128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:32:21.620701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006800+0000","last_change":"2024-05-14T14:40:15.974010+0000","last_active":"2024-05-14T14:40:21.006800+0000","last_peered":"2024-05-14T14:40:21.006800+0000","last_clean":"2024-05-14T14:40:21.006800+0000","last_became_active":"2024-05-14T14:40:15.973683+0000","last_became_peered":"2024-05-14T14:40:15.973683+0000","last_unstale":"2024-05-14T14:40:21.006800+0000","last_undegraded":"2024-05-14T14:40:21.006800+0000","last_fullsized":"2024-05-14T14:40:21.006800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:43:15.190648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352691+0000","last_change":"2024-05-14T14:40:15.958806+0000","last_active":"2024-05-14T14:40:21.352691+0000","last_peered":"2024-05-14T14:40:21.352691+0000","last_clean":"2024-05-14T14:40:21.352691+0000","last_became_active":"2024-05-14T14:40:15.958397+0000","last_became_peered":"2024-05-14T14:40:15.958397+0000","last_unstale":"2024-05-14T14:40:21.352691+0000","last_undegraded":"2024-05-14T14:40:21.352691+0000","last_fullsized":"2024-05-14T14:40:21.352691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:23:34.578655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352925+0000","last_change":"2024-05-14T14:40:15.968981+0000","last_active":"2024-05-14T14:40:21.352925+0000","last_peered":"2024-05-14T14:40:21.352925+0000","last_clean":"2024-05-14T14:40:21.352925+0000","last_became_active":"2024-05-14T14:40:15.968588+0000","last_became_peered":"2024-05-14T14:40:15.968588+0000","last_unstale":"2024-05-14T14:40:21.352925+0000","last_undegraded":"2024-05-14T14:40:21.352925+0000","last_fullsized":"2024-05-14T14:40:21.352925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:24:18.488847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352818+0000","last_change":"2024-05-14T14:40:15.967640+0000","last_active":"2024-05-14T14:40:21.352818+0000","last_peered":"2024-05-14T14:40:21.352818+0000","last_clean":"2024-05-14T14:40:21.352818+0000","last_became_active":"2024-05-14T14:40:15.967316+0000","last_became_peered":"2024-05-14T14:40:15.967316+0000","last_unstale":"2024-05-14T14:40:21.352818+0000","last_undegraded":"2024-05-14T14:40:21.352818+0000","last_fullsized":"2024-05-14T14:40:21.352818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:09:29.986117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":101868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":266240,"data_stored":101868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T14:40:30.494 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-14T14:40:30.494 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-14T14:40:30.495 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-14T14:40:30.495 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-14T14:40:30.495 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-14T14:40:30.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.660+0000 7fb21c861640 1 Processor -- start 2024-05-14T14:40:30.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.660+0000 7fb21c861640 1 -- start start 2024-05-14T14:40:30.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.661+0000 7fb21c861640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb2180cf610 0x7fb218160590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:30.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.661+0000 7fb21c861640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb2180736e0 0x7fb2180b6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:30.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.661+0000 7fb21c861640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb218164c60 con 0x7fb2180cffb0 2024-05-14T14:40:30.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.661+0000 7fb21c861640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fb2180d03c0 con 0x7fb2180cf610 2024-05-14T14:40:30.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.661+0000 7fb21c861640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fb218164a10 con 0x7fb2180736e0 2024-05-14T14:40:30.649 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.662+0000 7fb215d9b640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fb2180cffb0 0x7fb218072fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:56300/0 (socket says 172.21.15.39:56300) 2024-05-14T14:40:30.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.662+0000 7fb215d9b640 1 -- 172.21.15.39:0/3995765562 learned_addr learned my addr 172.21.15.39:0/3995765562 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:30.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.662+0000 7fb21659c640 1 --2- 172.21.15.39:0/3995765562 >> v2:172.21.15.62:3300/0 conn(0x7fb2180cf610 0x7fb218160590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:30.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.662+0000 7fb216d9d640 1 --2- 172.21.15.39:0/3995765562 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb2180736e0 0x7fb2180b6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:30.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.662+0000 7fb21559a640 1 -- 172.21.15.39:0/3995765562 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3444180198 0 0) 0x7fb218164c60 con 0x7fb2180cffb0 2024-05-14T14:40:30.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.662+0000 7fb21559a640 1 -- 172.21.15.39:0/3995765562 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb200003520 con 0x7fb2180cffb0 2024-05-14T14:40:30.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.662+0000 7fb21659c640 1 -- 172.21.15.39:0/3995765562 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb2180736e0 msgr2=0x7fb2180b6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:30.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.662+0000 7fb21659c640 1 --2- 172.21.15.39:0/3995765562 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb2180736e0 0x7fb2180b6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:30.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.662+0000 7fb21559a640 1 -- 172.21.15.39:0/3995765562 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2846264655 0 0) 0x7fb200003520 con 0x7fb2180cffb0 2024-05-14T14:40:30.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.662+0000 7fb21659c640 1 -- 172.21.15.39:0/3995765562 >> v1:172.21.15.39:6789/0 conn(0x7fb2180cffb0 legacy=0x7fb218072fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:30.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.662+0000 7fb21659c640 1 -- 172.21.15.39:0/3995765562 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2180d3470 con 0x7fb2180cf610 2024-05-14T14:40:30.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.662+0000 7fb216d9d640 1 --2- 172.21.15.39:0/3995765562 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb2180736e0 0x7fb2180b6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T14:40:30.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.663+0000 7fb21659c640 1 --2- 172.21.15.39:0/3995765562 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2180cf610 0x7fb218160590 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb208009d90 tx=0x7fb20802a4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=876a10f2eb5795b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:30.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.663+0000 7fb21559a640 1 -- 172.21.15.39:0/3995765562 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb20c0016f0 con 0x7fb2180cf610 2024-05-14T14:40:30.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.663+0000 7fb21559a640 1 -- 172.21.15.39:0/3995765562 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb208007540 con 0x7fb2180cf610 2024-05-14T14:40:30.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.663+0000 7fb21559a640 1 -- 172.21.15.39:0/3995765562 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb208007910 con 0x7fb2180cf610 2024-05-14T14:40:30.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.664+0000 7fb21c861640 1 -- 172.21.15.39:0/3995765562 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2180cf610 msgr2=0x7fb218160590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:30.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.664+0000 7fb21c861640 1 --2- 172.21.15.39:0/3995765562 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2180cf610 0x7fb218160590 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb208009d90 tx=0x7fb20802a4d0 comp rx=0 tx=0).stop 2024-05-14T14:40:30.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.664+0000 7fb21c861640 1 -- 172.21.15.39:0/3995765562 shutdown_connections 2024-05-14T14:40:30.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.664+0000 7fb21c861640 1 --2- 172.21.15.39:0/3995765562 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb2180736e0 0x7fb2180b6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:30.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.664+0000 7fb21c861640 1 --2- 172.21.15.39:0/3995765562 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2180cf610 0x7fb218160590 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:30.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.664+0000 7fb21c861640 1 -- 172.21.15.39:0/3995765562 >> 172.21.15.39:0/3995765562 conn(0x7fb2180d3ae0 msgr2=0x7fb2180d3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:30.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.664+0000 7fb21c861640 1 -- 172.21.15.39:0/3995765562 shutdown_connections 2024-05-14T14:40:30.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.664+0000 7fb21c861640 1 -- 172.21.15.39:0/3995765562 wait complete. 2024-05-14T14:40:30.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.666+0000 7fb21c861640 1 Processor -- start 2024-05-14T14:40:30.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.666+0000 7fb21c861640 1 -- start start 2024-05-14T14:40:30.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.667+0000 7fb21c861640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb2180cf610 0x7fb21814ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:30.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.667+0000 7fb21c861640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2180cffb0 0x7fb21806e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:30.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.667+0000 7fb21c861640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb21806e580 0x7fb21815f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:30.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.668+0000 7fb21c861640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb2180ce130 con 0x7fb21806e580 2024-05-14T14:40:30.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.668+0000 7fb21c861640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb218164f40 con 0x7fb2180cffb0 2024-05-14T14:40:30.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.668+0000 7fb21c861640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fb2180ce2b0 con 0x7fb2180cf610 2024-05-14T14:40:30.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.668+0000 7fb216d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb21806e580 0x7fb21815f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:30.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.668+0000 7fb216d9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb21806e580 0x7fb21815f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48044/0 (socket says 172.21.15.39:48044) 2024-05-14T14:40:30.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.668+0000 7fb216d9d640 1 -- 172.21.15.39:0/1720441197 learned_addr learned my addr 172.21.15.39:0/1720441197 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:30.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.668+0000 7fb215d9b640 1 --2- 172.21.15.39:0/1720441197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2180cffb0 0x7fb21806e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:30.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.668+0000 7fb21659c640 1 --2- 172.21.15.39:0/1720441197 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb2180cf610 0x7fb21814ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:30.661 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.668+0000 7fb216d9d640 1 -- 172.21.15.39:0/1720441197 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb2180cf610 msgr2=0x7fb21814ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:30.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.668+0000 7fb216d9d640 1 --2- 172.21.15.39:0/1720441197 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb2180cf610 0x7fb21814ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:30.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.668+0000 7fb216d9d640 1 -- 172.21.15.39:0/1720441197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2180cffb0 msgr2=0x7fb21806e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:30.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.668+0000 7fb216d9d640 1 --2- 172.21.15.39:0/1720441197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2180cffb0 0x7fb21806e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:30.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.668+0000 7fb216d9d640 1 -- 172.21.15.39:0/1720441197 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb21814d350 con 0x7fb21806e580 2024-05-14T14:40:30.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.668+0000 7fb216d9d640 1 --2- 172.21.15.39:0/1720441197 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb21806e580 0x7fb21815f550 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb21000e8b0 tx=0x7fb21000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:30.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.668+0000 7fb206ffd640 1 -- 172.21.15.39:0/1720441197 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb210017070 con 0x7fb21806e580 2024-05-14T14:40:30.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.668+0000 7fb206ffd640 1 -- 172.21.15.39:0/1720441197 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb210004020 con 0x7fb21806e580 2024-05-14T14:40:30.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.668+0000 7fb206ffd640 1 -- 172.21.15.39:0/1720441197 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2100043f0 con 0x7fb21806e580 2024-05-14T14:40:30.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.668+0000 7fb21c861640 1 -- 172.21.15.39:0/1720441197 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb21806ed30 con 0x7fb21806e580 2024-05-14T14:40:30.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.668+0000 7fb21c861640 1 -- 172.21.15.39:0/1720441197 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb21806f2f0 con 0x7fb21806e580 2024-05-14T14:40:30.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.670+0000 7fb21c861640 1 -- 172.21.15.39:0/1720441197 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb218076aa0 con 0x7fb21806e580 2024-05-14T14:40:30.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.670+0000 7fb206ffd640 1 -- 172.21.15.39:0/1720441197 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb21000c940 con 0x7fb21806e580 2024-05-14T14:40:30.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.671+0000 7fb206ffd640 1 --2- 172.21.15.39:0/1720441197 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fb1f80762d0 0x7fb1f80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:30.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.671+0000 7fb206ffd640 1 -- 172.21.15.39:0/1720441197 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb210097aa0 con 0x7fb21806e580 2024-05-14T14:40:30.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.671+0000 7fb21659c640 1 --2- 172.21.15.39:0/1720441197 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fb1f80762d0 0x7fb1f80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:30.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.671+0000 7fb21659c640 1 --2- 172.21.15.39:0/1720441197 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fb1f80762d0 0x7fb1f80787e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb208034000 tx=0x7fb20802f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:30.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.676+0000 7fb206ffd640 1 -- 172.21.15.39:0/1720441197 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb2100609e0 con 0x7fb21806e580 2024-05-14T14:40:30.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.918+0000 7fb21c861640 1 -- 172.21.15.39:0/1720441197 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fb2180d3120 con 0x7fb21806e580 2024-05-14T14:40:30.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.921+0000 7fb206ffd640 1 -- 172.21.15.39:0/1720441197 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+189518 (secure 0 0 0) 0x7fb210064ce0 con 0x7fb21806e580 2024-05-14T14:40:30.908 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:40:30.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.924+0000 7fb21c861640 1 -- 172.21.15.39:0/1720441197 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fb1f80762d0 msgr2=0x7fb1f80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:30.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.924+0000 7fb21c861640 1 --2- 172.21.15.39:0/1720441197 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fb1f80762d0 0x7fb1f80787e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb208034000 tx=0x7fb20802f000 comp rx=0 tx=0).stop 2024-05-14T14:40:30.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.924+0000 7fb21c861640 1 -- 172.21.15.39:0/1720441197 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb21806e580 msgr2=0x7fb21815f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:30.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.924+0000 7fb21c861640 1 --2- 172.21.15.39:0/1720441197 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb21806e580 0x7fb21815f550 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb21000e8b0 tx=0x7fb21000ed70 comp rx=0 tx=0).stop 2024-05-14T14:40:30.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.924+0000 7fb21c861640 1 -- 172.21.15.39:0/1720441197 shutdown_connections 2024-05-14T14:40:30.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.924+0000 7fb21c861640 1 --2- 172.21.15.39:0/1720441197 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fb1f80762d0 0x7fb1f80787e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:30.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.924+0000 7fb21c861640 1 --2- 172.21.15.39:0/1720441197 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb21806e580 0x7fb21815f550 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:30.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.924+0000 7fb21c861640 1 --2- 172.21.15.39:0/1720441197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2180cffb0 0x7fb21806e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:30.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.924+0000 7fb21c861640 1 --2- 172.21.15.39:0/1720441197 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb2180cf610 0x7fb21814ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:30.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.924+0000 7fb21c861640 1 -- 172.21.15.39:0/1720441197 >> 172.21.15.39:0/1720441197 conn(0x7fb2180d3ae0 msgr2=0x7fb2180ce720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:30.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.924+0000 7fb21c861640 1 -- 172.21.15.39:0/1720441197 shutdown_connections 2024-05-14T14:40:30.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:30.924+0000 7fb21c861640 1 -- 172.21.15.39:0/1720441197 wait complete. 2024-05-14T14:40:30.919 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6832","nonce":498853008},{"type":"v1","addr":"172.21.15.39:6833","nonce":498853008}]},"active_addr":"172.21.15.39:6833/498853008","active_change":"2024-05-14T14:39:56.663990+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4109,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.39:0","nonce":3850460934}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.39:0","nonce":2676155640}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.39:0","nonce":2112719131}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.39:0","nonce":3391225283}]}]} 2024-05-14T14:40:30.923 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-14T14:40:30.923 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-14T14:40:30.923 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T14:40:31.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.054+0000 7fc657a8b640 1 Processor -- start 2024-05-14T14:40:31.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.054+0000 7fc657a8b640 1 -- start start 2024-05-14T14:40:31.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.056+0000 7fc657a8b640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc6500cff10 0x7fc6500d32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.056+0000 7fc657a8b640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6500b5320 con 0x7fc65006eb60 2024-05-14T14:40:31.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.056+0000 7fc657a8b640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6500b49f0 con 0x7fc65006e040 2024-05-14T14:40:31.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.056+0000 7fc657a8b640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fc6500b47a0 con 0x7fc6500cff10 2024-05-14T14:40:31.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.056+0000 7fc655827640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc6500cff10 0x7fc6500d32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.056+0000 7fc656028640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fc65006eb60 0x7fc6500cd300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:56312/0 (socket says 172.21.15.39:56312) 2024-05-14T14:40:31.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.056+0000 7fc656028640 1 -- 172.21.15.39:0/3506503664 learned_addr learned my addr 172.21.15.39:0/3506503664 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:31.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.056+0000 7fc655827640 1 -- 172.21.15.39:0/3506503664 >> v1:172.21.15.62:6789/0 conn(0x7fc65006e040 legacy=0x7fc65006e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.056+0000 7fc655827640 1 -- 172.21.15.39:0/3506503664 >> v1:172.21.15.39:6789/0 conn(0x7fc65006eb60 legacy=0x7fc6500cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.056+0000 7fc655827640 1 -- 172.21.15.39:0/3506503664 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6500b4cd0 con 0x7fc6500cff10 2024-05-14T14:40:31.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.057+0000 7fc655827640 1 --2- 172.21.15.39:0/3506503664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6500cff10 0x7fc6500d32b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc64c0097a0 tx=0x7fc64c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6922b26825547e26 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:31.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.058+0000 7fc654825640 1 -- 172.21.15.39:0/3506503664 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc64c037070 con 0x7fc6500cff10 2024-05-14T14:40:31.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.058+0000 7fc654825640 1 -- 172.21.15.39:0/3506503664 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc64c032440 con 0x7fc6500cff10 2024-05-14T14:40:31.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.058+0000 7fc654825640 1 -- 172.21.15.39:0/3506503664 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc64c032810 con 0x7fc6500cff10 2024-05-14T14:40:31.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.059+0000 7fc657a8b640 1 -- 172.21.15.39:0/3506503664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6500cff10 msgr2=0x7fc6500d32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.059+0000 7fc657a8b640 1 --2- 172.21.15.39:0/3506503664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6500cff10 0x7fc6500d32b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc64c0097a0 tx=0x7fc64c02a230 comp rx=0 tx=0).stop 2024-05-14T14:40:31.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.059+0000 7fc657a8b640 1 -- 172.21.15.39:0/3506503664 shutdown_connections 2024-05-14T14:40:31.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.059+0000 7fc657a8b640 1 --2- 172.21.15.39:0/3506503664 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc6500cff10 0x7fc6500d32b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.059+0000 7fc657a8b640 1 -- 172.21.15.39:0/3506503664 >> 172.21.15.39:0/3506503664 conn(0x7fc65009b5f0 msgr2=0x7fc65009ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:31.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.059+0000 7fc657a8b640 1 -- 172.21.15.39:0/3506503664 shutdown_connections 2024-05-14T14:40:31.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.059+0000 7fc657a8b640 1 -- 172.21.15.39:0/3506503664 wait complete. 2024-05-14T14:40:31.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.061+0000 7fc657a8b640 1 Processor -- start 2024-05-14T14:40:31.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.061+0000 7fc657a8b640 1 -- start start 2024-05-14T14:40:31.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.062+0000 7fc657a8b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc65006e040 0x7fc650156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.062+0000 7fc657a8b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc65006eb60 0x7fc6500c9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.062+0000 7fc657a8b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6500cff10 0x7fc6500ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.062+0000 7fc657a8b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc65006f8a0 con 0x7fc65006eb60 2024-05-14T14:40:31.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.062+0000 7fc657a8b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc65006f720 con 0x7fc6500cff10 2024-05-14T14:40:31.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.062+0000 7fc657a8b640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc6500cda10 con 0x7fc65006e040 2024-05-14T14:40:31.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.062+0000 7fc655026640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc65006eb60 0x7fc6500c9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.062+0000 7fc655026640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc65006eb60 0x7fc6500c9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48072/0 (socket says 172.21.15.39:48072) 2024-05-14T14:40:31.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.062+0000 7fc655026640 1 -- 172.21.15.39:0/2799403625 learned_addr learned my addr 172.21.15.39:0/2799403625 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:31.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.063+0000 7fc655827640 1 --2- 172.21.15.39:0/2799403625 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc65006e040 0x7fc650156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.063+0000 7fc656028640 1 --2- 172.21.15.39:0/2799403625 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6500cff10 0x7fc6500ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.063+0000 7fc655026640 1 -- 172.21.15.39:0/2799403625 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc65006e040 msgr2=0x7fc650156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.063+0000 7fc655026640 1 --2- 172.21.15.39:0/2799403625 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc65006e040 0x7fc650156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.063+0000 7fc655026640 1 -- 172.21.15.39:0/2799403625 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6500cff10 msgr2=0x7fc6500ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.063+0000 7fc655026640 1 --2- 172.21.15.39:0/2799403625 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6500cff10 0x7fc6500ca7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.063+0000 7fc655026640 1 -- 172.21.15.39:0/2799403625 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc65015ead0 con 0x7fc65006eb60 2024-05-14T14:40:31.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.063+0000 7fc655827640 1 --2- 172.21.15.39:0/2799403625 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc65006e040 0x7fc650156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:40:31.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.063+0000 7fc655026640 1 --2- 172.21.15.39:0/2799403625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc65006eb60 0x7fc6500c9f50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc64000c370 tx=0x7fc64000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:31.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.063+0000 7fc6467fc640 1 -- 172.21.15.39:0/2799403625 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6400052d0 con 0x7fc65006eb60 2024-05-14T14:40:31.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.063+0000 7fc6467fc640 1 -- 172.21.15.39:0/2799403625 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc640005490 con 0x7fc65006eb60 2024-05-14T14:40:31.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.063+0000 7fc657a8b640 1 -- 172.21.15.39:0/2799403625 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc65015edb0 con 0x7fc65006eb60 2024-05-14T14:40:31.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.063+0000 7fc6467fc640 1 -- 172.21.15.39:0/2799403625 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc640007260 con 0x7fc65006eb60 2024-05-14T14:40:31.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.063+0000 7fc657a8b640 1 -- 172.21.15.39:0/2799403625 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc65015f370 con 0x7fc65006eb60 2024-05-14T14:40:31.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.064+0000 7fc657a8b640 1 -- 172.21.15.39:0/2799403625 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc650076aa0 con 0x7fc65006eb60 2024-05-14T14:40:31.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.065+0000 7fc6467fc640 1 -- 172.21.15.39:0/2799403625 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc640007400 con 0x7fc65006eb60 2024-05-14T14:40:31.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.065+0000 7fc6467fc640 1 --2- 172.21.15.39:0/2799403625 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fc6340762d0 0x7fc6340787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.066+0000 7fc6467fc640 1 -- 172.21.15.39:0/2799403625 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc640096d20 con 0x7fc65006eb60 2024-05-14T14:40:31.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.066+0000 7fc655827640 1 --2- 172.21.15.39:0/2799403625 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fc6340762d0 0x7fc6340787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.066+0000 7fc655827640 1 --2- 172.21.15.39:0/2799403625 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fc6340762d0 0x7fc6340787e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc64c034000 tx=0x7fc64c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:31.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.070+0000 7fc6467fc640 1 -- 172.21.15.39:0/2799403625 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc6400603d0 con 0x7fc65006eb60 2024-05-14T14:40:31.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.262+0000 7fc657a8b640 1 -- 172.21.15.39:0/2799403625 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc6500cf520 con 0x7fc65006eb60 2024-05-14T14:40:31.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.263+0000 7fc6467fc640 1 -- 172.21.15.39:0/2799403625 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18454 (secure 0 0 0) 0x7fc6400683c0 con 0x7fc65006eb60 2024-05-14T14:40:31.248 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:40:31.248 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"fsid":"d7983fec-79c7-4991-b19c-1aecead64611","created":"2024-05-14T14:39:52.157167+0000","modified":"2024-05-14T14:40:20.397684+0000","last_up_change":"2024-05-14T14:40:03.848608+0000","last_in_change":"2024-05-14T14:39:54.591920+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T14:40:04.692846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T14:40:13.794415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T14:40:14.273154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T14:40:17.979457+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c4ec4534-6301-4dd7-b4d6-d560b096d442","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6801","nonce":4023478848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6803","nonce":4023478848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6807","nonce":4023478848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6805","nonce":4023478848}]},"public_addr":"172.21.15.39:6801/4023478848","cluster_addr":"172.21.15.39:6803/4023478848","heartbeat_back_addr":"172.21.15.39:6807/4023478848","heartbeat_front_addr":"172.21.15.39:6805/4023478848","state":["exists","up"]},{"osd":1,"uuid":"93f91b0e-096e-4bdf-aed0-d1136f73f136","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6817","nonce":926357398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6819","nonce":926357398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6823","nonce":926357398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6821","nonce":926357398}]},"public_addr":"172.21.15.39:6817/926357398","cluster_addr":"172.21.15.39:6819/926357398","heartbeat_back_addr":"172.21.15.39:6823/926357398","heartbeat_front_addr":"172.21.15.39:6821/926357398","state":["exists","up"]},{"osd":2,"uuid":"c590b1e0-67eb-452e-8e80-d2208da17d09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6809","nonce":610616754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6811","nonce":610616754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6815","nonce":610616754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6813","nonce":610616754}]},"public_addr":"172.21.15.39:6809/610616754","cluster_addr":"172.21.15.39:6811/610616754","heartbeat_back_addr":"172.21.15.39:6815/610616754","heartbeat_front_addr":"172.21.15.39:6813/610616754","state":["exists","up"]},{"osd":3,"uuid":"d57661b0-44f6-4355-9115-83eceb9b8f71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6825","nonce":1469314579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6827","nonce":1469314579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6831","nonce":1469314579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6829","nonce":1469314579}]},"public_addr":"172.21.15.39:6825/1469314579","cluster_addr":"172.21.15.39:6827/1469314579","heartbeat_back_addr":"172.21.15.39:6831/1469314579","heartbeat_front_addr":"172.21.15.39:6829/1469314579","state":["exists","up"]},{"osd":4,"uuid":"b131436f-f6e1-4d72-a86e-de200afdcebb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6825","nonce":3481507129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6827","nonce":3481507129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6831","nonce":3481507129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6829","nonce":3481507129}]},"public_addr":"172.21.15.62:6825/3481507129","cluster_addr":"172.21.15.62:6827/3481507129","heartbeat_back_addr":"172.21.15.62:6831/3481507129","heartbeat_front_addr":"172.21.15.62:6829/3481507129","state":["exists","up"]},{"osd":5,"uuid":"12e10b40-28b1-410f-9ce0-7b427daa111e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6801","nonce":3291934116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6803","nonce":3291934116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6807","nonce":3291934116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6805","nonce":3291934116}]},"public_addr":"172.21.15.62:6801/3291934116","cluster_addr":"172.21.15.62:6803/3291934116","heartbeat_back_addr":"172.21.15.62:6807/3291934116","heartbeat_front_addr":"172.21.15.62:6805/3291934116","state":["exists","up"]},{"osd":6,"uuid":"ad8950a5-70bd-488c-8f29-010515cc4a04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6817","nonce":3005996101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6819","nonce":3005996101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6823","nonce":3005996101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6821","nonce":3005996101}]},"public_addr":"172.21.15.62:6817/3005996101","cluster_addr":"172.21.15.62:6819/3005996101","heartbeat_back_addr":"172.21.15.62:6823/3005996101","heartbeat_front_addr":"172.21.15.62:6821/3005996101","state":["exists","up"]},{"osd":7,"uuid":"e0d4b8b7-3c80-4760-a342-1d508cdecc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6809","nonce":2800379225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6811","nonce":2800379225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6815","nonce":2800379225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6813","nonce":2800379225}]},"public_addr":"172.21.15.62:6809/2800379225","cluster_addr":"172.21.15.62:6811/2800379225","heartbeat_back_addr":"172.21.15.62:6815/2800379225","heartbeat_front_addr":"172.21.15.62:6813/2800379225","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.773714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.760037+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.811225+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.752810+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.745165+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.700634+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.768477+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.747301+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T14:40:31.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.265+0000 7fc657a8b640 1 -- 172.21.15.39:0/2799403625 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fc6340762d0 msgr2=0x7fc6340787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.265+0000 7fc657a8b640 1 --2- 172.21.15.39:0/2799403625 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fc6340762d0 0x7fc6340787e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc64c034000 tx=0x7fc64c02e000 comp rx=0 tx=0).stop 2024-05-14T14:40:31.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.265+0000 7fc657a8b640 1 -- 172.21.15.39:0/2799403625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc65006eb60 msgr2=0x7fc6500c9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.265+0000 7fc657a8b640 1 --2- 172.21.15.39:0/2799403625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc65006eb60 0x7fc6500c9f50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc64000c370 tx=0x7fc64000c830 comp rx=0 tx=0).stop 2024-05-14T14:40:31.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.265+0000 7fc657a8b640 1 -- 172.21.15.39:0/2799403625 shutdown_connections 2024-05-14T14:40:31.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.265+0000 7fc657a8b640 1 --2- 172.21.15.39:0/2799403625 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fc6340762d0 0x7fc6340787e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.265+0000 7fc657a8b640 1 --2- 172.21.15.39:0/2799403625 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6500cff10 0x7fc6500ca7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.265+0000 7fc657a8b640 1 --2- 172.21.15.39:0/2799403625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc65006eb60 0x7fc6500c9f50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.265+0000 7fc657a8b640 1 --2- 172.21.15.39:0/2799403625 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc65006e040 0x7fc650156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.265+0000 7fc657a8b640 1 -- 172.21.15.39:0/2799403625 >> 172.21.15.39:0/2799403625 conn(0x7fc65009b5f0 msgr2=0x7fc65015fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:31.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.265+0000 7fc657a8b640 1 -- 172.21.15.39:0/2799403625 shutdown_connections 2024-05-14T14:40:31.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.265+0000 7fc657a8b640 1 -- 172.21.15.39:0/2799403625 wait complete. 2024-05-14T14:40:31.262 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-14T14:40:31.262 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T14:40:31.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.393+0000 7f7e3aa96640 1 Processor -- start 2024-05-14T14:40:31.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.393+0000 7f7e3aa96640 1 -- start start 2024-05-14T14:40:31.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.395+0000 7f7e3aa96640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7e3406e570 0x7f7e341601c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.395+0000 7f7e3aa96640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7e340b55e0 0x7f7e340cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.395+0000 7f7e3aa96640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e340d2440 con 0x7f7e340d0570 2024-05-14T14:40:31.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.395+0000 7f7e3aa96640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f7e34160700 con 0x7f7e3406e570 2024-05-14T14:40:31.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.395+0000 7f7e3aa96640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f7e340b5b10 con 0x7f7e340b55e0 2024-05-14T14:40:31.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.395+0000 7f7e39033640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f7e340d0570 0x7f7e340d0980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:56316/0 (socket says 172.21.15.39:56316) 2024-05-14T14:40:31.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.395+0000 7f7e39033640 1 -- 172.21.15.39:0/502012990 learned_addr learned my addr 172.21.15.39:0/502012990 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:31.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.395+0000 7f7e33fff640 1 --2- 172.21.15.39:0/502012990 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7e340b55e0 0x7f7e340cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.395+0000 7f7e38832640 1 --2- 172.21.15.39:0/502012990 >> v2:172.21.15.62:3300/0 conn(0x7f7e3406e570 0x7f7e341601c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.395+0000 7f7e337fe640 1 -- 172.21.15.39:0/502012990 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2641305656 0 0) 0x7f7e340d2440 con 0x7f7e340d0570 2024-05-14T14:40:31.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.395+0000 7f7e337fe640 1 -- 172.21.15.39:0/502012990 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e1c003520 con 0x7f7e340d0570 2024-05-14T14:40:31.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.395+0000 7f7e337fe640 1 -- 172.21.15.39:0/502012990 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3179839221 0 0) 0x7f7e1c003520 con 0x7f7e340d0570 2024-05-14T14:40:31.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.395+0000 7f7e337fe640 1 -- 172.21.15.39:0/502012990 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7e340b55e0 msgr2=0x7f7e340cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:31.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.395+0000 7f7e337fe640 1 --2- 172.21.15.39:0/502012990 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7e340b55e0 0x7f7e340cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.395+0000 7f7e337fe640 1 -- 172.21.15.39:0/502012990 >> v2:172.21.15.62:3300/0 conn(0x7f7e3406e570 msgr2=0x7f7e341601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:31.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.395+0000 7f7e337fe640 1 --2- 172.21.15.39:0/502012990 >> v2:172.21.15.62:3300/0 conn(0x7f7e3406e570 0x7f7e341601c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.395+0000 7f7e337fe640 1 -- 172.21.15.39:0/502012990 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e340b5df0 con 0x7f7e340d0570 2024-05-14T14:40:31.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.395+0000 7f7e337fe640 1 -- 172.21.15.39:0/502012990 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1803005051 0 0) 0x7f7e2c001a70 con 0x7f7e340d0570 2024-05-14T14:40:31.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.395+0000 7f7e337fe640 1 -- 172.21.15.39:0/502012990 >> v1:172.21.15.39:6789/0 conn(0x7f7e340d0570 legacy=0x7f7e340d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.395+0000 7f7e337fe640 1 --2- 172.21.15.39:0/502012990 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e1c003a00 0x7f7e1c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.395+0000 7f7e337fe640 1 --2- 172.21.15.39:0/502012990 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7e340b55e0 0x7f7e1c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.395+0000 7f7e337fe640 1 --2- 172.21.15.39:0/502012990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e1c004d40 0x7f7e1c005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.395+0000 7f7e337fe640 1 -- 172.21.15.39:0/502012990 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7e34160700 con 0x7f7e1c003a00 2024-05-14T14:40:31.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.395+0000 7f7e337fe640 1 -- 172.21.15.39:0/502012990 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f7e340b5b10 con 0x7f7e1c004d40 2024-05-14T14:40:31.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.395+0000 7f7e337fe640 1 -- 172.21.15.39:0/502012990 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f7e1c00ba70 con 0x7f7e340b55e0 2024-05-14T14:40:31.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.396+0000 7f7e38832640 1 --2- 172.21.15.39:0/502012990 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e1c003a00 0x7f7e1c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.396+0000 7f7e33fff640 1 --2- 172.21.15.39:0/502012990 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7e340b55e0 0x7f7e1c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.396+0000 7f7e39033640 1 --2- 172.21.15.39:0/502012990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e1c004d40 0x7f7e1c005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.396+0000 7f7e38832640 1 -- 172.21.15.39:0/502012990 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7e340b55e0 msgr2=0x7f7e1c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:31.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.396+0000 7f7e38832640 1 --2- 172.21.15.39:0/502012990 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7e340b55e0 0x7f7e1c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.396+0000 7f7e38832640 1 -- 172.21.15.39:0/502012990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e1c004d40 msgr2=0x7f7e1c005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:31.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.396+0000 7f7e38832640 1 --2- 172.21.15.39:0/502012990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e1c004d40 0x7f7e1c005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.396+0000 7f7e38832640 1 -- 172.21.15.39:0/502012990 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e1c003520 con 0x7f7e1c003a00 2024-05-14T14:40:31.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.397+0000 7f7e38832640 1 --2- 172.21.15.39:0/502012990 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e1c003a00 0x7f7e1c003e70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7e24009ac0 tx=0x7f7e1c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb925963fc0fc6ae server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:31.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.397+0000 7f7e337fe640 1 -- 172.21.15.39:0/502012990 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e24036070 con 0x7f7e1c003a00 2024-05-14T14:40:31.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.397+0000 7f7e337fe640 1 -- 172.21.15.39:0/502012990 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e24031400 con 0x7f7e1c003a00 2024-05-14T14:40:31.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.397+0000 7f7e337fe640 1 -- 172.21.15.39:0/502012990 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e24009690 con 0x7f7e1c003a00 2024-05-14T14:40:31.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.397+0000 7f7e3aa96640 1 -- 172.21.15.39:0/502012990 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e1c003a00 msgr2=0x7f7e1c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.397+0000 7f7e3aa96640 1 --2- 172.21.15.39:0/502012990 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e1c003a00 0x7f7e1c003e70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7e24009ac0 tx=0x7f7e1c005830 comp rx=0 tx=0).stop 2024-05-14T14:40:31.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.397+0000 7f7e39033640 1 -- 172.21.15.39:0/502012990 reap_dead start 2024-05-14T14:40:31.384 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.397+0000 7f7e3aa96640 1 -- 172.21.15.39:0/502012990 shutdown_connections 2024-05-14T14:40:31.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.397+0000 7f7e3aa96640 1 -- 172.21.15.39:0/502012990 >> 172.21.15.39:0/502012990 conn(0x7f7e34071680 msgr2=0x7f7e34071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:31.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.397+0000 7f7e3aa96640 1 -- 172.21.15.39:0/502012990 shutdown_connections 2024-05-14T14:40:31.385 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.398+0000 7f7e3aa96640 1 -- 172.21.15.39:0/502012990 wait complete. 2024-05-14T14:40:31.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.399+0000 7f7e3aa96640 1 Processor -- start 2024-05-14T14:40:31.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.399+0000 7f7e3aa96640 1 -- start start 2024-05-14T14:40:31.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.401+0000 7f7e3aa96640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7e1c003a00 0x7f7e340cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.401+0000 7f7e3aa96640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e341584e0 0x7f7e341588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.401+0000 7f7e3aa96640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e3415da20 0x7f7e3415de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.401+0000 7f7e3aa96640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7e340cf0c0 con 0x7f7e3415da20 2024-05-14T14:40:31.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.401+0000 7f7e3aa96640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f7e340b63b0 con 0x7f7e341584e0 2024-05-14T14:40:31.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.401+0000 7f7e3aa96640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f7e340cf240 con 0x7f7e1c003a00 2024-05-14T14:40:31.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.401+0000 7f7e39033640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e3415da20 0x7f7e3415de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.401+0000 7f7e39033640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e3415da20 0x7f7e3415de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48090/0 (socket says 172.21.15.39:48090) 2024-05-14T14:40:31.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.401+0000 7f7e39033640 1 -- 172.21.15.39:0/3219053881 learned_addr learned my addr 172.21.15.39:0/3219053881 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:31.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.401+0000 7f7e38832640 1 --2- 172.21.15.39:0/3219053881 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7e1c003a00 0x7f7e340cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.401+0000 7f7e33fff640 1 --2- 172.21.15.39:0/3219053881 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e341584e0 0x7f7e341588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.401+0000 7f7e39033640 1 -- 172.21.15.39:0/3219053881 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7e1c003a00 msgr2=0x7f7e340cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.401+0000 7f7e39033640 1 --2- 172.21.15.39:0/3219053881 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7e1c003a00 0x7f7e340cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.401+0000 7f7e39033640 1 -- 172.21.15.39:0/3219053881 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e341584e0 msgr2=0x7f7e341588f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.401+0000 7f7e39033640 1 --2- 172.21.15.39:0/3219053881 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e341584e0 0x7f7e341588f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.401+0000 7f7e39033640 1 -- 172.21.15.39:0/3219053881 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e3415e370 con 0x7f7e3415da20 2024-05-14T14:40:31.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.401+0000 7f7e38832640 1 --2- 172.21.15.39:0/3219053881 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7e1c003a00 0x7f7e340cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:40:31.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.401+0000 7f7e39033640 1 --2- 172.21.15.39:0/3219053881 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e3415da20 0x7f7e3415de30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7e34163d90 tx=0x7f7e2c007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:31.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.401+0000 7f7e317fa640 1 -- 172.21.15.39:0/3219053881 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c00ab00 con 0x7f7e3415da20 2024-05-14T14:40:31.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.402+0000 7f7e317fa640 1 -- 172.21.15.39:0/3219053881 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e2c018070 con 0x7f7e3415da20 2024-05-14T14:40:31.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.402+0000 7f7e3aa96640 1 -- 172.21.15.39:0/3219053881 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e34146990 con 0x7f7e3415da20 2024-05-14T14:40:31.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.402+0000 7f7e317fa640 1 -- 172.21.15.39:0/3219053881 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e2c0133f0 con 0x7f7e3415da20 2024-05-14T14:40:31.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.402+0000 7f7e3aa96640 1 -- 172.21.15.39:0/3219053881 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e34146f50 con 0x7f7e3415da20 2024-05-14T14:40:31.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.403+0000 7f7e3aa96640 1 -- 172.21.15.39:0/3219053881 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e34076aa0 con 0x7f7e3415da20 2024-05-14T14:40:31.389 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.403+0000 7f7e317fa640 1 -- 172.21.15.39:0/3219053881 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7e2c013590 con 0x7f7e3415da20 2024-05-14T14:40:31.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.404+0000 7f7e317fa640 1 --2- 172.21.15.39:0/3219053881 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f7e200762d0 0x7f7e200787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.404+0000 7f7e38832640 1 --2- 172.21.15.39:0/3219053881 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f7e200762d0 0x7f7e200787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.404+0000 7f7e317fa640 1 -- 172.21.15.39:0/3219053881 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7e2c097f40 con 0x7f7e3415da20 2024-05-14T14:40:31.390 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.404+0000 7f7e38832640 1 --2- 172.21.15.39:0/3219053881 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f7e200762d0 0x7f7e200787e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7e24009ac0 tx=0x7f7e24008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:31.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.409+0000 7f7e317fa640 1 -- 172.21.15.39:0/3219053881 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7e2c0614d0 con 0x7f7e3415da20 2024-05-14T14:40:31.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.599+0000 7f7e3aa96640 1 -- 172.21.15.39:0/3219053881 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7e340d1ff0 con 0x7f7e3415da20 2024-05-14T14:40:31.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.600+0000 7f7e317fa640 1 -- 172.21.15.39:0/3219053881 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18454 (secure 0 0 0) 0x7f7e2c060dd0 con 0x7f7e3415da20 2024-05-14T14:40:31.585 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:40:31.585 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"fsid":"d7983fec-79c7-4991-b19c-1aecead64611","created":"2024-05-14T14:39:52.157167+0000","modified":"2024-05-14T14:40:20.397684+0000","last_up_change":"2024-05-14T14:40:03.848608+0000","last_in_change":"2024-05-14T14:39:54.591920+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T14:40:04.692846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T14:40:13.794415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T14:40:14.273154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T14:40:17.979457+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c4ec4534-6301-4dd7-b4d6-d560b096d442","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6801","nonce":4023478848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6803","nonce":4023478848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6807","nonce":4023478848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6805","nonce":4023478848}]},"public_addr":"172.21.15.39:6801/4023478848","cluster_addr":"172.21.15.39:6803/4023478848","heartbeat_back_addr":"172.21.15.39:6807/4023478848","heartbeat_front_addr":"172.21.15.39:6805/4023478848","state":["exists","up"]},{"osd":1,"uuid":"93f91b0e-096e-4bdf-aed0-d1136f73f136","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6817","nonce":926357398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6819","nonce":926357398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6823","nonce":926357398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6821","nonce":926357398}]},"public_addr":"172.21.15.39:6817/926357398","cluster_addr":"172.21.15.39:6819/926357398","heartbeat_back_addr":"172.21.15.39:6823/926357398","heartbeat_front_addr":"172.21.15.39:6821/926357398","state":["exists","up"]},{"osd":2,"uuid":"c590b1e0-67eb-452e-8e80-d2208da17d09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6809","nonce":610616754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6811","nonce":610616754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6815","nonce":610616754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6813","nonce":610616754}]},"public_addr":"172.21.15.39:6809/610616754","cluster_addr":"172.21.15.39:6811/610616754","heartbeat_back_addr":"172.21.15.39:6815/610616754","heartbeat_front_addr":"172.21.15.39:6813/610616754","state":["exists","up"]},{"osd":3,"uuid":"d57661b0-44f6-4355-9115-83eceb9b8f71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6825","nonce":1469314579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6827","nonce":1469314579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6831","nonce":1469314579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6829","nonce":1469314579}]},"public_addr":"172.21.15.39:6825/1469314579","cluster_addr":"172.21.15.39:6827/1469314579","heartbeat_back_addr":"172.21.15.39:6831/1469314579","heartbeat_front_addr":"172.21.15.39:6829/1469314579","state":["exists","up"]},{"osd":4,"uuid":"b131436f-f6e1-4d72-a86e-de200afdcebb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6825","nonce":3481507129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6827","nonce":3481507129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6831","nonce":3481507129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6829","nonce":3481507129}]},"public_addr":"172.21.15.62:6825/3481507129","cluster_addr":"172.21.15.62:6827/3481507129","heartbeat_back_addr":"172.21.15.62:6831/3481507129","heartbeat_front_addr":"172.21.15.62:6829/3481507129","state":["exists","up"]},{"osd":5,"uuid":"12e10b40-28b1-410f-9ce0-7b427daa111e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6801","nonce":3291934116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6803","nonce":3291934116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6807","nonce":3291934116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6805","nonce":3291934116}]},"public_addr":"172.21.15.62:6801/3291934116","cluster_addr":"172.21.15.62:6803/3291934116","heartbeat_back_addr":"172.21.15.62:6807/3291934116","heartbeat_front_addr":"172.21.15.62:6805/3291934116","state":["exists","up"]},{"osd":6,"uuid":"ad8950a5-70bd-488c-8f29-010515cc4a04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6817","nonce":3005996101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6819","nonce":3005996101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6823","nonce":3005996101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6821","nonce":3005996101}]},"public_addr":"172.21.15.62:6817/3005996101","cluster_addr":"172.21.15.62:6819/3005996101","heartbeat_back_addr":"172.21.15.62:6823/3005996101","heartbeat_front_addr":"172.21.15.62:6821/3005996101","state":["exists","up"]},{"osd":7,"uuid":"e0d4b8b7-3c80-4760-a342-1d508cdecc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6809","nonce":2800379225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6811","nonce":2800379225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6815","nonce":2800379225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6813","nonce":2800379225}]},"public_addr":"172.21.15.62:6809/2800379225","cluster_addr":"172.21.15.62:6811/2800379225","heartbeat_back_addr":"172.21.15.62:6815/2800379225","heartbeat_front_addr":"172.21.15.62:6813/2800379225","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.773714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.760037+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.811225+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.752810+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.745165+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.700634+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.768477+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.747301+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T14:40:31.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.603+0000 7f7e3aa96640 1 -- 172.21.15.39:0/3219053881 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f7e200762d0 msgr2=0x7f7e200787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.603+0000 7f7e3aa96640 1 --2- 172.21.15.39:0/3219053881 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f7e200762d0 0x7f7e200787e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7e24009ac0 tx=0x7f7e24008030 comp rx=0 tx=0).stop 2024-05-14T14:40:31.587 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.603+0000 7f7e3aa96640 1 -- 172.21.15.39:0/3219053881 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e3415da20 msgr2=0x7f7e3415de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.603+0000 7f7e3aa96640 1 --2- 172.21.15.39:0/3219053881 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e3415da20 0x7f7e3415de30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7e34163d90 tx=0x7f7e2c007b00 comp rx=0 tx=0).stop 2024-05-14T14:40:31.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.603+0000 7f7e3aa96640 1 -- 172.21.15.39:0/3219053881 shutdown_connections 2024-05-14T14:40:31.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.603+0000 7f7e3aa96640 1 --2- 172.21.15.39:0/3219053881 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f7e200762d0 0x7f7e200787e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.603+0000 7f7e3aa96640 1 --2- 172.21.15.39:0/3219053881 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7e3415da20 0x7f7e3415de30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.603+0000 7f7e3aa96640 1 --2- 172.21.15.39:0/3219053881 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e341584e0 0x7f7e341588f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.603+0000 7f7e3aa96640 1 --2- 172.21.15.39:0/3219053881 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7e1c003a00 0x7f7e340cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.603+0000 7f7e3aa96640 1 -- 172.21.15.39:0/3219053881 >> 172.21.15.39:0/3219053881 conn(0x7f7e34071680 msgr2=0x7f7e340cf620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:31.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.603+0000 7f7e3aa96640 1 -- 172.21.15.39:0/3219053881 shutdown_connections 2024-05-14T14:40:31.588 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.603+0000 7f7e3aa96640 1 -- 172.21.15.39:0/3219053881 wait complete. 2024-05-14T14:40:31.599 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-14T14:40:31.600 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-14T14:40:31.600 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-14T14:40:31.600 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-14T14:40:31.601 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-14T14:40:31.601 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-14T14:40:31.601 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-14T14:40:31.602 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-14T14:40:31.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.840+0000 7fb492277640 1 Processor -- start 2024-05-14T14:40:31.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.840+0000 7fb492277640 1 -- start start 2024-05-14T14:40:31.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.841+0000 7ff95210d640 1 Processor -- start 2024-05-14T14:40:31.825 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.841+0000 7ff95210d640 1 -- start start 2024-05-14T14:40:31.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.842+0000 7f028b231640 1 Processor -- start 2024-05-14T14:40:31.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.842+0000 7f028b231640 1 -- start start 2024-05-14T14:40:31.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.842+0000 7fb492277640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb484050350 0x7fb4840e3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.843+0000 7fb492277640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb4840e73a0 0x7fb4840e77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.843+0000 7fb492277640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb484006490 0x7fb4840068a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.843+0000 7fb492277640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fb4840e7cf0 con 0x7fb484006490 2024-05-14T14:40:31.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.843+0000 7ff95210d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7ff94c164af0 0x7ff94c168af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.843+0000 7ff95210d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff94c06ddc0 0x7ff94c0cd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.843+0000 7fb492277640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fb484049040 con 0x7fb4840e73a0 2024-05-14T14:40:31.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.843+0000 7fb492277640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fb484034c50 con 0x7fb484050350 2024-05-14T14:40:31.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.843+0000 7ff95210d640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff94c0ccbc0 con 0x7ff94c0cf230 2024-05-14T14:40:31.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.843+0000 7ff95210d640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7ff94c169030 con 0x7ff94c164af0 2024-05-14T14:40:31.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.843+0000 7ff95210d640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7ff94c164fb0 con 0x7ff94c06ddc0 2024-05-14T14:40:31.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.843+0000 7ff94bfff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff94c06ddc0 0x7ff94c0cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.843+0000 7ff94bfff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff94c06ddc0 0x7ff94c0cd080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.39:56758/0 (socket says 172.21.15.39:56758) 2024-05-14T14:40:31.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.843+0000 7ff94bfff640 1 -- 172.21.15.39:0/458397096 learned_addr learned my addr 172.21.15.39:0/458397096 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:31.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.843+0000 7fb490a74640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb4840e73a0 0x7fb4840e77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.843+0000 7fb491275640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb484050350 0x7fb4840e3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.844+0000 7ff94b7fe640 1 --2- 172.21.15.39:0/458397096 >> v2:172.21.15.39:3300/0 conn(0x7ff94c164af0 0x7ff94c168af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.844+0000 7fb490a74640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb4840e73a0 0x7fb4840e77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.39:56754/0 (socket says 172.21.15.39:56754) 2024-05-14T14:40:31.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.844+0000 7fb490a74640 1 -- 172.21.15.39:0/2408826424 learned_addr learned my addr 172.21.15.39:0/2408826424 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:31.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.844+0000 7ff94bfff640 1 -- 172.21.15.39:0/458397096 >> v2:172.21.15.39:3300/0 conn(0x7ff94c164af0 msgr2=0x7ff94c168af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:31.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.844+0000 7ff94bfff640 1 --2- 172.21.15.39:0/458397096 >> v2:172.21.15.39:3300/0 conn(0x7ff94c164af0 0x7ff94c168af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.844+0000 7ff94bfff640 1 -- 172.21.15.39:0/458397096 >> v1:172.21.15.62:6789/0 conn(0x7ff94c0cf230 legacy=0x7ff94c06d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.844+0000 7ff94bfff640 1 -- 172.21.15.39:0/458397096 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff94c165290 con 0x7ff94c06ddc0 2024-05-14T14:40:31.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.844+0000 7ff94b7fe640 1 --2- 172.21.15.39:0/458397096 >> v2:172.21.15.39:3300/0 conn(0x7ff94c164af0 0x7ff94c168af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:40:31.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.844+0000 7fb490a74640 1 -- 172.21.15.39:0/2408826424 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb484050350 msgr2=0x7fb4840e3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:31.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.844+0000 7fb490a74640 1 --2- 172.21.15.39:0/2408826424 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb484050350 0x7fb4840e3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.844+0000 7fb490a74640 1 -- 172.21.15.39:0/2408826424 >> v2:172.21.15.39:3300/0 conn(0x7fb484006490 msgr2=0x7fb4840068a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:31.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.844+0000 7f6c91866640 1 Processor -- start 2024-05-14T14:40:31.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.844+0000 7fb490a74640 1 --2- 172.21.15.39:0/2408826424 >> v2:172.21.15.39:3300/0 conn(0x7fb484006490 0x7fb4840068a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.844+0000 7fb490a74640 1 -- 172.21.15.39:0/2408826424 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb484050760 con 0x7fb4840e73a0 2024-05-14T14:40:31.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.845+0000 7f028b231640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f027c00c2d0 0x7f027c0e3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.845+0000 7f028b231640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f027c0544c0 0x7f027c0e38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.845+0000 7f30b60eb640 1 Processor -- start 2024-05-14T14:40:31.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.845+0000 7f028b231640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f027c0e0a90 con 0x7f027c0dfd80 2024-05-14T14:40:31.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.845+0000 7f028b231640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f027c054030 con 0x7f027c00c2d0 2024-05-14T14:40:31.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.845+0000 7f028b231640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f027c053cc0 con 0x7f027c0544c0 2024-05-14T14:40:31.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.845+0000 7f028a22f640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f027c00c2d0 0x7f027c0e3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.845+0000 7f028a22f640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f027c00c2d0 0x7f027c0e3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48120/0 (socket says 172.21.15.39:48120) 2024-05-14T14:40:31.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.845+0000 7ff94bfff640 1 --2- 172.21.15.39:0/458397096 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff94c06ddc0 0x7ff94c0cd080 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff94c0743d0 tx=0x7ff93802a280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13509e4fd654e16 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:31.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.845+0000 7f32c644d640 1 Processor -- start 2024-05-14T14:40:31.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.845+0000 7f32c644d640 1 -- start start 2024-05-14T14:40:31.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.845+0000 7f7853abd640 1 Processor -- start 2024-05-14T14:40:31.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.845+0000 7f028a22f640 1 -- 172.21.15.39:0/2008120079 learned_addr learned my addr 172.21.15.39:0/2008120079 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:31.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.845+0000 7f0289a2e640 1 --2- 172.21.15.39:0/2008120079 >> v2:172.21.15.62:3300/0 conn(0x7f027c0544c0 0x7f027c0e38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.846+0000 7ff94a7fc640 1 -- 172.21.15.39:0/458397096 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff938037070 con 0x7ff94c06ddc0 2024-05-14T14:40:31.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.844+0000 7f6c91866640 1 -- start start 2024-05-14T14:40:31.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.846+0000 7f028a22f640 1 -- 172.21.15.39:0/2008120079 >> v2:172.21.15.62:3300/0 conn(0x7f027c0544c0 msgr2=0x7f027c0e38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:31.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.846+0000 7f028a22f640 1 --2- 172.21.15.39:0/2008120079 >> v2:172.21.15.62:3300/0 conn(0x7f027c0544c0 0x7f027c0e38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.846+0000 7ff94a7fc640 1 -- 172.21.15.39:0/458397096 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff938032440 con 0x7ff94c06ddc0 2024-05-14T14:40:31.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.846+0000 7f028a22f640 1 -- 172.21.15.39:0/2008120079 >> v1:172.21.15.62:6789/0 conn(0x7f027c0dfd80 legacy=0x7f027c0e0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.846+0000 7f028922d640 1 -- 172.21.15.39:0/2008120079 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2704228677 0 0) 0x7f027c0e0a90 con 0x7f027c0dfd80 2024-05-14T14:40:31.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.846+0000 7fb490a74640 1 --2- 172.21.15.39:0/2408826424 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4840e73a0 0x7fb4840e77b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb48c06b020 tx=0x7fb48c06a690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a83a4c6575f4bf97 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:31.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.846+0000 7f028a22f640 1 -- 172.21.15.39:0/2008120079 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f027c048550 con 0x7f027c00c2d0 2024-05-14T14:40:31.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.846+0000 7f2ff1522640 1 Processor -- start 2024-05-14T14:40:31.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.846+0000 7f2ff1522640 1 -- start start 2024-05-14T14:40:31.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.847+0000 7fb483fff640 1 -- 172.21.15.39:0/2408826424 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb48c0b4070 con 0x7fb4840e73a0 2024-05-14T14:40:31.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.847+0000 7f028a22f640 1 --2- 172.21.15.39:0/2008120079 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f027c00c2d0 0x7f027c0e3370 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f027c055ba0 tx=0x7f028002a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1de6e4d4cbd784e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:31.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.847+0000 7fb483fff640 1 -- 172.21.15.39:0/2408826424 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb48c0a7e00 con 0x7fb4840e73a0 2024-05-14T14:40:31.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.847+0000 7fb483fff640 1 -- 172.21.15.39:0/2408826424 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb48c0af640 con 0x7fb4840e73a0 2024-05-14T14:40:31.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.847+0000 7ff94a7fc640 1 -- 172.21.15.39:0/458397096 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff938032810 con 0x7ff94c06ddc0 2024-05-14T14:40:31.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.847+0000 7ff95210d640 1 -- 172.21.15.39:0/458397096 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff94c06ddc0 msgr2=0x7ff94c0cd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.846+0000 7f7853abd640 1 -- start start 2024-05-14T14:40:31.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.847+0000 7ff95210d640 1 --2- 172.21.15.39:0/458397096 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff94c06ddc0 0x7ff94c0cd080 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff94c0743d0 tx=0x7ff93802a280 comp rx=0 tx=0).stop 2024-05-14T14:40:31.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.847+0000 7f6c91866640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6c84052fb0 0x7f6c8404f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.847+0000 7f6c91866640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6c84007320 0x7f6c84033a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.847+0000 7f6c91866640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6c84007730 0x7f6c84033fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.847+0000 7f6c91866640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f6c840533c0 con 0x7f6c84007730 2024-05-14T14:40:31.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.847+0000 7f6c91866640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f6c840e8230 con 0x7f6c84052fb0 2024-05-14T14:40:31.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.847+0000 7f6c91866640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f6c84006280 con 0x7f6c84007320 2024-05-14T14:40:31.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.847+0000 7f6c90864640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6c84052fb0 0x7f6c8404f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.847+0000 7f6c90864640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6c84052fb0 0x7f6c8404f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.39:56788/0 (socket says 172.21.15.39:56788) 2024-05-14T14:40:31.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.847+0000 7f6c90864640 1 -- 172.21.15.39:0/3839017206 learned_addr learned my addr 172.21.15.39:0/3839017206 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:31.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.845+0000 7f30b60eb640 1 -- start start 2024-05-14T14:40:31.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.847+0000 7f32c644d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f32b80e3360 0x7f32b80e3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.847+0000 7f32c644d640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32b80e3cb0 con 0x7f32b80544b0 2024-05-14T14:40:31.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.847+0000 7f32c644d640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32b8050d90 con 0x7f32b800c2c0 2024-05-14T14:40:31.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.847+0000 7f32c644d640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f32b8054020 con 0x7f32b80e3360 2024-05-14T14:40:31.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.847+0000 7f30b60eb640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f30a8055190 0x7f30a8054220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.848+0000 7f30b60eb640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30a8039440 0x7f30a80090e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.848+0000 7f30b60eb640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30a8055930 con 0x7f30a80e04c0 2024-05-14T14:40:31.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.848+0000 7ff95210d640 1 -- 172.21.15.39:0/458397096 shutdown_connections 2024-05-14T14:40:31.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.848+0000 7ff95210d640 1 --2- 172.21.15.39:0/458397096 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff94c06ddc0 0x7ff94c0cd080 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.848+0000 7ff95210d640 1 --2- 172.21.15.39:0/458397096 >> v2:172.21.15.39:3300/0 conn(0x7ff94c164af0 0x7ff94c168af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.848+0000 7ff95210d640 1 -- 172.21.15.39:0/458397096 >> 172.21.15.39:0/458397096 conn(0x7ff94c073200 msgr2=0x7ff94c073610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:31.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.848+0000 7f30b60eb640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f30a8008540 con 0x7f30a8055190 2024-05-14T14:40:31.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.848+0000 7f30b60eb640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f30a80e08d0 con 0x7f30a8039440 2024-05-14T14:40:31.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.848+0000 7ff95210d640 1 -- 172.21.15.39:0/458397096 shutdown_connections 2024-05-14T14:40:31.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.848+0000 7ff95210d640 1 -- 172.21.15.39:0/458397096 wait complete. 2024-05-14T14:40:31.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.848+0000 7f32c4c4a640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f32b80e3360 0x7f32b80e3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.848+0000 7f32c544b640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f32b80544b0 0x7f32b8050680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:56322/0 (socket says 172.21.15.39:56322) 2024-05-14T14:40:31.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.848+0000 7f32c544b640 1 -- 172.21.15.39:0/3668409723 learned_addr learned my addr 172.21.15.39:0/3668409723 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:31.848 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.848+0000 7f30b58ea640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30a8039440 0x7f30a80090e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.848+0000 7f30b50e9640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f30a8055190 0x7f30a8054220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.848+0000 7f30b58ea640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30a8039440 0x7f30a80090e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.39:41676/0 (socket says 172.21.15.39:41676) 2024-05-14T14:40:31.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.848+0000 7f30b58ea640 1 -- 172.21.15.39:0/2318192003 learned_addr learned my addr 172.21.15.39:0/2318192003 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:31.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.848+0000 7f7853abd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f784c06c6a0 0x7f784c0cff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.848+0000 7f7853abd640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f784c165410 0x7f784c165820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.848+0000 7f7853abd640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f784c06cab0 con 0x7f784c070c20 2024-05-14T14:40:31.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.848+0000 7f7853abd640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f784c06d5d0 con 0x7f784c165410 2024-05-14T14:40:31.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.848+0000 7f7853abd640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f784c06cd30 con 0x7f784c06c6a0 2024-05-14T14:40:31.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.848+0000 7f028922d640 1 -- 172.21.15.39:0/2008120079 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0280037070 con 0x7f027c00c2d0 2024-05-14T14:40:31.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.848+0000 7f028922d640 1 -- 172.21.15.39:0/2008120079 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0280032440 con 0x7f027c00c2d0 2024-05-14T14:40:31.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.848+0000 7f028922d640 1 -- 172.21.15.39:0/2008120079 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02800327f0 con 0x7f027c00c2d0 2024-05-14T14:40:31.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.848+0000 7fb492277640 1 -- 172.21.15.39:0/2408826424 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4840e73a0 msgr2=0x7fb4840e77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.848+0000 7fb492277640 1 --2- 172.21.15.39:0/2408826424 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4840e73a0 0x7fb4840e77b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb48c06b020 tx=0x7fb48c06a690 comp rx=0 tx=0).stop 2024-05-14T14:40:31.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.848+0000 7f7851058640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f784c06c6a0 0x7f784c0cff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.848+0000 7f7851058640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f784c06c6a0 0x7f784c0cff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.39:41688/0 (socket says 172.21.15.39:41688) 2024-05-14T14:40:31.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.848+0000 7f7851058640 1 -- 172.21.15.39:0/1331754537 learned_addr learned my addr 172.21.15.39:0/1331754537 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:31.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.849+0000 7f785205a640 1 --2- 172.21.15.39:0/1331754537 >> v2:172.21.15.39:3300/0 conn(0x7f784c165410 0x7f784c165820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.849+0000 7f30b58ea640 1 -- 172.21.15.39:0/2318192003 >> v2:172.21.15.39:3300/0 conn(0x7f30a8055190 msgr2=0x7f30a8054220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:31.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.849+0000 7f30b58ea640 1 --2- 172.21.15.39:0/2318192003 >> v2:172.21.15.39:3300/0 conn(0x7f30a8055190 0x7f30a8054220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.849+0000 7f30b58ea640 1 -- 172.21.15.39:0/2318192003 >> v1:172.21.15.62:6789/0 conn(0x7f30a80e04c0 legacy=0x7f30a80089d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.849+0000 7f30b58ea640 1 -- 172.21.15.39:0/2318192003 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a8007f30 con 0x7f30a8039440 2024-05-14T14:40:31.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.849+0000 7f2ff1522640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2fe40544b0 0x7f2fe4050680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.849+0000 7f2ff1522640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2fe40e3360 0x7f2fe40e3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.849+0000 7f2ff1522640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f2fe40dfd70 0x7f2fe40e0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.849+0000 7fb492277640 1 -- 172.21.15.39:0/2408826424 shutdown_connections 2024-05-14T14:40:31.854 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.849+0000 7fb492277640 1 --2- 172.21.15.39:0/2408826424 >> v2:172.21.15.39:3300/0 conn(0x7fb484006490 0x7fb4840068a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.849+0000 7f2ff1522640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f2fe4054020 con 0x7f2fe40dfd70 2024-05-14T14:40:31.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.849+0000 7f028b231640 1 -- 172.21.15.39:0/2008120079 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f027c00c2d0 msgr2=0x7f027c0e3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.849+0000 7f2ff1522640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f2fe40e3cb0 con 0x7f2fe40544b0 2024-05-14T14:40:31.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.849+0000 7f028b231640 1 --2- 172.21.15.39:0/2008120079 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f027c00c2d0 0x7f027c0e3370 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f027c055ba0 tx=0x7f028002a290 comp rx=0 tx=0).stop 2024-05-14T14:40:31.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.850+0000 7f2ff1522640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f2fe40539f0 con 0x7f2fe40e3360 2024-05-14T14:40:31.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.850+0000 7f2feb7fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2fe40e3360 0x7f2fe40e3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.850+0000 7f2feb7fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2fe40e3360 0x7f2fe40e3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.39:41700/0 (socket says 172.21.15.39:41700) 2024-05-14T14:40:31.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.850+0000 7f2feb7fe640 1 -- 172.21.15.39:0/3464510275 learned_addr learned my addr 172.21.15.39:0/3464510275 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:31.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.850+0000 7f028b231640 1 -- 172.21.15.39:0/2008120079 shutdown_connections 2024-05-14T14:40:31.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.850+0000 7f028b231640 1 --2- 172.21.15.39:0/2008120079 >> v2:172.21.15.62:3300/0 conn(0x7f027c0544c0 0x7f027c0e38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.850+0000 7f028b231640 1 --2- 172.21.15.39:0/2008120079 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f027c00c2d0 0x7f027c0e3370 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.850+0000 7f028b231640 1 -- 172.21.15.39:0/2008120079 >> 172.21.15.39:0/2008120079 conn(0x7f027c054cf0 msgr2=0x7f027c055100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:31.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.849+0000 7f32b7fff640 1 -- 172.21.15.39:0/3668409723 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2306389279 0 0) 0x7f32b8050d90 con 0x7f32b800c2c0 2024-05-14T14:40:31.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.849+0000 7f32b7fff640 1 -- 172.21.15.39:0/3668409723 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32ac003520 con 0x7f32b800c2c0 2024-05-14T14:40:31.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.849+0000 7f32c4c4a640 1 -- 172.21.15.39:0/3668409723 >> v1:172.21.15.62:6789/0 conn(0x7f32b800c2c0 legacy=0x7f32b80060d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.849+0000 7f32c4c4a640 1 -- 172.21.15.39:0/3668409723 >> v1:172.21.15.39:6789/0 conn(0x7f32b80544b0 legacy=0x7f32b8050680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.849+0000 7f32c4c4a640 1 -- 172.21.15.39:0/3668409723 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b80539f0 con 0x7f32b80e3360 2024-05-14T14:40:31.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.850+0000 7f028b231640 1 -- 172.21.15.39:0/2008120079 shutdown_connections 2024-05-14T14:40:31.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.848+0000 7f6c91065640 1 --2- 172.21.15.39:0/3839017206 >> v2:172.21.15.39:3300/0 conn(0x7f6c84007730 0x7f6c84033fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.848+0000 7f6c8bfff640 1 --2- 172.21.15.39:0/3839017206 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6c84007320 0x7f6c84033a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.849+0000 7f6c8bfff640 1 -- 172.21.15.39:0/3839017206 >> v2:172.21.15.62:3300/0 conn(0x7f6c84052fb0 msgr2=0x7f6c8404f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:31.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.849+0000 7f6c8bfff640 1 --2- 172.21.15.39:0/3839017206 >> v2:172.21.15.62:3300/0 conn(0x7f6c84052fb0 0x7f6c8404f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.849+0000 7f6c8bfff640 1 -- 172.21.15.39:0/3839017206 >> v2:172.21.15.39:3300/0 conn(0x7f6c84007730 msgr2=0x7f6c84033fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:31.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.849+0000 7f6c8bfff640 1 --2- 172.21.15.39:0/3839017206 >> v2:172.21.15.39:3300/0 conn(0x7f6c84007730 0x7f6c84033fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.849+0000 7f6c8bfff640 1 -- 172.21.15.39:0/3839017206 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c84006560 con 0x7f6c84007320 2024-05-14T14:40:31.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.849+0000 7f6c91065640 1 --2- 172.21.15.39:0/3839017206 >> v2:172.21.15.39:3300/0 conn(0x7f6c84007730 0x7f6c84033fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:40:31.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.849+0000 7fb492277640 1 --2- 172.21.15.39:0/2408826424 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb4840e73a0 0x7fb4840e77b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.849+0000 7fb492277640 1 --2- 172.21.15.39:0/2408826424 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb484050350 0x7fb4840e3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.849+0000 7fb492277640 1 -- 172.21.15.39:0/2408826424 >> 172.21.15.39:0/2408826424 conn(0x7fb48400aa70 msgr2=0x7fb48400ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:31.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.850+0000 7f2febfff640 1 --2- 172.21.15.39:0/3464510275 >> v2:172.21.15.62:3300/0 conn(0x7f2fe40544b0 0x7f2fe4050680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.850+0000 7f028b231640 1 -- 172.21.15.39:0/2008120079 wait complete. 2024-05-14T14:40:31.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.849+0000 7f7851058640 1 -- 172.21.15.39:0/1331754537 >> v2:172.21.15.39:3300/0 conn(0x7f784c165410 msgr2=0x7f784c165820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:31.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.849+0000 7f7851058640 1 --2- 172.21.15.39:0/1331754537 >> v2:172.21.15.39:3300/0 conn(0x7f784c165410 0x7f784c165820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.849+0000 7f7851058640 1 -- 172.21.15.39:0/1331754537 >> v1:172.21.15.62:6789/0 conn(0x7f784c070c20 legacy=0x7f784c168340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.849+0000 7f7851058640 1 -- 172.21.15.39:0/1331754537 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f784c06d010 con 0x7f784c06c6a0 2024-05-14T14:40:31.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.850+0000 7f2feb7fe640 1 -- 172.21.15.39:0/3464510275 >> v2:172.21.15.62:3300/0 conn(0x7f2fe40544b0 msgr2=0x7f2fe4050680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:31.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.850+0000 7f2ff0d21640 1 --2- 172.21.15.39:0/3464510275 >> v2:172.21.15.39:3300/0 conn(0x7f2fe40dfd70 0x7f2fe40e0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.850+0000 7f2feb7fe640 1 --2- 172.21.15.39:0/3464510275 >> v2:172.21.15.62:3300/0 conn(0x7f2fe40544b0 0x7f2fe4050680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.850+0000 7fb492277640 1 -- 172.21.15.39:0/2408826424 shutdown_connections 2024-05-14T14:40:31.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.850+0000 7f2feb7fe640 1 -- 172.21.15.39:0/3464510275 >> v2:172.21.15.39:3300/0 conn(0x7f2fe40dfd70 msgr2=0x7f2fe40e0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:31.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.850+0000 7f7851058640 1 --2- 172.21.15.39:0/1331754537 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f784c06c6a0 0x7f784c0cff30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7844009e50 tx=0x7f784402a7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcd2347ca5a1f202 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:31.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.850+0000 7f2feb7fe640 1 --2- 172.21.15.39:0/3464510275 >> v2:172.21.15.39:3300/0 conn(0x7f2fe40dfd70 0x7f2fe40e0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.850+0000 7f6c8bfff640 1 --2- 172.21.15.39:0/3839017206 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6c84007320 0x7f6c84033a70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6c84006490 tx=0x7f6c7802a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fde59828e13ecd6c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:31.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.850+0000 7f2feb7fe640 1 -- 172.21.15.39:0/3464510275 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe40e0a80 con 0x7f2fe40e3360 2024-05-14T14:40:31.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.850+0000 7fb492277640 1 -- 172.21.15.39:0/2408826424 wait complete. 2024-05-14T14:40:31.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.850+0000 7f2ff0d21640 1 --2- 172.21.15.39:0/3464510275 >> v2:172.21.15.39:3300/0 conn(0x7f2fe40dfd70 0x7f2fe40e0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:40:31.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.850+0000 7f30b58ea640 1 --2- 172.21.15.39:0/2318192003 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30a8039440 0x7f30a80090e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f30ac00bb10 tx=0x7f30ac02c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30d234e22dd3a4b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:31.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.851+0000 7f6c8b7fe640 1 -- 172.21.15.39:0/3839017206 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c78037070 con 0x7f6c84007320 2024-05-14T14:40:31.872 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.851+0000 7f32c4c4a640 1 --2- 172.21.15.39:0/3668409723 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f32b80e3360 0x7f32b80e3770 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f32c0000b60 tx=0x7f32c00752c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5af81bef420505a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:31.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.851+0000 7f30a7fff640 1 -- 172.21.15.39:0/2318192003 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ac032790 con 0x7f30a8039440 2024-05-14T14:40:31.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.851+0000 7f30a7fff640 1 -- 172.21.15.39:0/2318192003 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30ac038070 con 0x7f30a8039440 2024-05-14T14:40:31.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.851+0000 7f6c8b7fe640 1 -- 172.21.15.39:0/3839017206 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c7802add0 con 0x7f6c84007320 2024-05-14T14:40:31.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.851+0000 7f6c8b7fe640 1 -- 172.21.15.39:0/3839017206 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c78037070 con 0x7f6c84007320 2024-05-14T14:40:31.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.851+0000 7f30a7fff640 1 -- 172.21.15.39:0/2318192003 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ac032790 con 0x7f30a8039440 2024-05-14T14:40:31.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.851+0000 7f32b7fff640 1 -- 172.21.15.39:0/3668409723 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c00b4070 con 0x7f32b80e3360 2024-05-14T14:40:31.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.851+0000 7f32b7fff640 1 -- 172.21.15.39:0/3668409723 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32c00a7d70 con 0x7f32b80e3360 2024-05-14T14:40:31.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.851+0000 7f32b7fff640 1 -- 172.21.15.39:0/3668409723 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c00af640 con 0x7f32b80e3360 2024-05-14T14:40:31.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.851+0000 7f7850857640 1 -- 172.21.15.39:0/1331754537 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7844036070 con 0x7f784c06c6a0 2024-05-14T14:40:31.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.851+0000 7f7850857640 1 -- 172.21.15.39:0/1331754537 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7844031600 con 0x7f784c06c6a0 2024-05-14T14:40:31.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.851+0000 7f7850857640 1 -- 172.21.15.39:0/1331754537 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78440319f0 con 0x7f784c06c6a0 2024-05-14T14:40:31.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.851+0000 7ff95210d640 1 Processor -- start 2024-05-14T14:40:31.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.851+0000 7ff95210d640 1 -- start start 2024-05-14T14:40:31.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.852+0000 7f6c91866640 1 -- 172.21.15.39:0/3839017206 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6c84007320 msgr2=0x7f6c84033a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.852+0000 7f6c91866640 1 --2- 172.21.15.39:0/3839017206 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6c84007320 0x7f6c84033a70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6c84006490 tx=0x7f6c7802a080 comp rx=0 tx=0).stop 2024-05-14T14:40:31.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.852+0000 7f6c91866640 1 -- 172.21.15.39:0/3839017206 shutdown_connections 2024-05-14T14:40:31.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.852+0000 7f6c91866640 1 --2- 172.21.15.39:0/3839017206 >> v2:172.21.15.39:3300/0 conn(0x7f6c84007730 0x7f6c84033fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.852+0000 7f6c91866640 1 --2- 172.21.15.39:0/3839017206 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6c84007320 0x7f6c84033a70 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.852+0000 7f6c91866640 1 --2- 172.21.15.39:0/3839017206 >> v2:172.21.15.62:3300/0 conn(0x7f6c84052fb0 0x7f6c8404f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.852+0000 7f6c91866640 1 -- 172.21.15.39:0/3839017206 >> 172.21.15.39:0/3839017206 conn(0x7f6c84054cf0 msgr2=0x7f6c84055100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:31.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.852+0000 7f7853abd640 1 -- 172.21.15.39:0/1331754537 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f784c06c6a0 msgr2=0x7f784c0cff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.852+0000 7f30b60eb640 1 -- 172.21.15.39:0/2318192003 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30a8039440 msgr2=0x7f30a80090e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.852+0000 7f30b60eb640 1 --2- 172.21.15.39:0/2318192003 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30a8039440 0x7f30a80090e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f30ac00bb10 tx=0x7f30ac02c890 comp rx=0 tx=0).stop 2024-05-14T14:40:31.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.852+0000 7f2feb7fe640 1 --2- 172.21.15.39:0/3464510275 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2fe40e3360 0x7f2fe40e3770 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2fe400d9a0 tx=0x7f2fe002b3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e62328bc84103c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:31.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.852+0000 7f6c91866640 1 -- 172.21.15.39:0/3839017206 shutdown_connections 2024-05-14T14:40:31.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.852+0000 7f6c91866640 1 -- 172.21.15.39:0/3839017206 wait complete. 2024-05-14T14:40:31.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.852+0000 7f7853abd640 1 --2- 172.21.15.39:0/1331754537 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f784c06c6a0 0x7f784c0cff30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7844009e50 tx=0x7f784402a7c0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.852+0000 7f30b60eb640 1 -- 172.21.15.39:0/2318192003 shutdown_connections 2024-05-14T14:40:31.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.853+0000 7f30b60eb640 1 --2- 172.21.15.39:0/2318192003 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30a8039440 0x7f30a80090e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.853+0000 7f30b60eb640 1 --2- 172.21.15.39:0/2318192003 >> v2:172.21.15.39:3300/0 conn(0x7f30a8055190 0x7f30a8054220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.853+0000 7f30b60eb640 1 -- 172.21.15.39:0/2318192003 >> 172.21.15.39:0/2318192003 conn(0x7f30a8055df0 msgr2=0x7f30a8056200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:31.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.852+0000 7f32c644d640 1 -- 172.21.15.39:0/3668409723 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f32b80e3360 msgr2=0x7f32b80e3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.852+0000 7f32c644d640 1 --2- 172.21.15.39:0/3668409723 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f32b80e3360 0x7f32b80e3770 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f32c0000b60 tx=0x7f32c00752c0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.853+0000 7f7853abd640 1 -- 172.21.15.39:0/1331754537 shutdown_connections 2024-05-14T14:40:31.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.853+0000 7f7853abd640 1 --2- 172.21.15.39:0/1331754537 >> v2:172.21.15.39:3300/0 conn(0x7f784c165410 0x7f784c165820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.853+0000 7f30b60eb640 1 -- 172.21.15.39:0/2318192003 shutdown_connections 2024-05-14T14:40:31.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.853+0000 7f7853abd640 1 --2- 172.21.15.39:0/1331754537 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f784c06c6a0 0x7f784c0cff30 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.853+0000 7f7853abd640 1 -- 172.21.15.39:0/1331754537 >> 172.21.15.39:0/1331754537 conn(0x7f784c0d1f20 msgr2=0x7f784c0ce390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:31.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.853+0000 7f32c644d640 1 -- 172.21.15.39:0/3668409723 shutdown_connections 2024-05-14T14:40:31.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.853+0000 7f32c644d640 1 --2- 172.21.15.39:0/3668409723 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f32b80e3360 0x7f32b80e3770 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.853+0000 7f32c644d640 1 -- 172.21.15.39:0/3668409723 >> 172.21.15.39:0/3668409723 conn(0x7f32b8054ce0 msgr2=0x7f32b80550f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:31.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.853+0000 7f30b60eb640 1 -- 172.21.15.39:0/2318192003 wait complete. 2024-05-14T14:40:31.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.853+0000 7f028b231640 1 Processor -- start 2024-05-14T14:40:31.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.853+0000 7f028b231640 1 -- start start 2024-05-14T14:40:31.884 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.853+0000 7f2feaffd640 1 -- 172.21.15.39:0/3464510275 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe0037070 con 0x7f2fe40e3360 2024-05-14T14:40:31.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.853+0000 7f32c644d640 1 -- 172.21.15.39:0/3668409723 shutdown_connections 2024-05-14T14:40:31.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.853+0000 7f2feaffd640 1 -- 172.21.15.39:0/3464510275 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fe0030710 con 0x7f2fe40e3360 2024-05-14T14:40:31.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.853+0000 7f2feaffd640 1 -- 172.21.15.39:0/3464510275 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe0030ae0 con 0x7f2fe40e3360 2024-05-14T14:40:31.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.853+0000 7fb492277640 1 Processor -- start 2024-05-14T14:40:31.885 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.854+0000 7fb492277640 1 -- start start 2024-05-14T14:40:31.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.854+0000 7ff95210d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff94c0cf230 0x7ff94c165b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.854+0000 7ff94b7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff94c0cf230 0x7ff94c165b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.854+0000 7ff94b7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff94c0cf230 0x7ff94c165b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48152/0 (socket says 172.21.15.39:48152) 2024-05-14T14:40:31.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.854+0000 7f2ff1522640 1 -- 172.21.15.39:0/3464510275 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2fe40e3360 msgr2=0x7f2fe40e3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.886 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.854+0000 7f2ff1522640 1 --2- 172.21.15.39:0/3464510275 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2fe40e3360 0x7f2fe40e3770 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2fe400d9a0 tx=0x7f2fe002b3f0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.854+0000 7ff94b7fe640 1 -- 172.21.15.39:0/2619783748 learned_addr learned my addr 172.21.15.39:0/2619783748 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:31.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.854+0000 7ff95210d640 1 --2- 172.21.15.39:0/2619783748 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff94c148480 0x7ff94c145c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.854+0000 7ff95210d640 1 --2- 172.21.15.39:0/2619783748 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff94c0b1bd0 0x7ff94c0b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.855+0000 7ff94affd640 1 --2- 172.21.15.39:0/2619783748 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff94c148480 0x7ff94c145c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.855+0000 7ff95210d640 1 -- 172.21.15.39:0/2619783748 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff94c0c7f80 con 0x7ff94c0cf230 2024-05-14T14:40:31.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.855+0000 7ff94bfff640 1 --2- 172.21.15.39:0/2619783748 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff94c0b1bd0 0x7ff94c0b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.887 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.855+0000 7ff95210d640 1 -- 172.21.15.39:0/2619783748 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff94c165850 con 0x7ff94c0b1bd0 2024-05-14T14:40:31.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.855+0000 7ff95210d640 1 -- 172.21.15.39:0/2619783748 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7ff94c14ab30 con 0x7ff94c148480 2024-05-14T14:40:31.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.856+0000 7f028b231640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f027c00c2d0 0x7f027c179550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.856+0000 7f6c91866640 1 Processor -- start 2024-05-14T14:40:31.888 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.853+0000 7f32c644d640 1 -- 172.21.15.39:0/3668409723 wait complete. 2024-05-14T14:40:31.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.856+0000 7f2ff1522640 1 -- 172.21.15.39:0/3464510275 shutdown_connections 2024-05-14T14:40:31.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.856+0000 7f2ff1522640 1 --2- 172.21.15.39:0/3464510275 >> v2:172.21.15.39:3300/0 conn(0x7f2fe40dfd70 0x7f2fe40e0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.856+0000 7f2ff1522640 1 --2- 172.21.15.39:0/3464510275 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2fe40e3360 0x7f2fe40e3770 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.856+0000 7f2ff1522640 1 --2- 172.21.15.39:0/3464510275 >> v2:172.21.15.62:3300/0 conn(0x7f2fe40544b0 0x7f2fe4050680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.856+0000 7f6c91866640 1 -- start start 2024-05-14T14:40:31.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.856+0000 7f2ff1522640 1 -- 172.21.15.39:0/3464510275 >> 172.21.15.39:0/3464510275 conn(0x7f2fe4054ce0 msgr2=0x7f2fe40550f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:31.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.856+0000 7f30b60eb640 1 Processor -- start 2024-05-14T14:40:31.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.856+0000 7f30b60eb640 1 -- start start 2024-05-14T14:40:31.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.856+0000 7f32c644d640 1 Processor -- start 2024-05-14T14:40:31.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.856+0000 7fb492277640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb484006490 0x7fb4840e5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.856+0000 7f32c644d640 1 -- start start 2024-05-14T14:40:31.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.856+0000 7f028a22f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f027c00c2d0 0x7f027c179550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.856+0000 7f7853abd640 1 -- 172.21.15.39:0/1331754537 shutdown_connections 2024-05-14T14:40:31.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.856+0000 7fb492277640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb484050350 0x7fb484181aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.856+0000 7f028a22f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f027c00c2d0 0x7f027c179550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48162/0 (socket says 172.21.15.39:48162) 2024-05-14T14:40:31.892 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.856+0000 7fb491275640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb484006490 0x7fb4840e5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.856+0000 7fb492277640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb4840e73a0 0x7fb484181fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.856+0000 7ff94b7fe640 1 -- 172.21.15.39:0/2619783748 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff94c148480 msgr2=0x7ff94c145c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.856+0000 7ff94b7fe640 1 --2- 172.21.15.39:0/2619783748 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff94c148480 0x7ff94c145c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.856+0000 7ff94b7fe640 1 -- 172.21.15.39:0/2619783748 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff94c0b1bd0 msgr2=0x7ff94c0b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.893 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.857+0000 7ff94b7fe640 1 --2- 172.21.15.39:0/2619783748 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff94c0b1bd0 0x7ff94c0b1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.857+0000 7fb492277640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb4840539d0 con 0x7fb484050350 2024-05-14T14:40:31.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.857+0000 7fb492277640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb4840536f0 con 0x7fb484006490 2024-05-14T14:40:31.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.857+0000 7fb492277640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fb484053cb0 con 0x7fb4840e73a0 2024-05-14T14:40:31.894 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.857+0000 7fb491a76640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb4840e73a0 0x7fb484181fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.856+0000 7fb490a74640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb484050350 0x7fb484181aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.857+0000 7fb490a74640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb484050350 0x7fb484181aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48176/0 (socket says 172.21.15.39:48176) 2024-05-14T14:40:31.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.857+0000 7fb490a74640 1 -- 172.21.15.39:0/1518741401 learned_addr learned my addr 172.21.15.39:0/1518741401 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:31.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.857+0000 7f028a22f640 1 -- 172.21.15.39:0/606525198 learned_addr learned my addr 172.21.15.39:0/606525198 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:31.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.857+0000 7f7853abd640 1 -- 172.21.15.39:0/1331754537 wait complete. 2024-05-14T14:40:31.895 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.857+0000 7ff94b7fe640 1 -- 172.21.15.39:0/2619783748 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff94c0b2520 con 0x7ff94c0cf230 2024-05-14T14:40:31.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.857+0000 7f028b231640 1 --2- 172.21.15.39:0/606525198 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f027c0544c0 0x7f027c04a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.857+0000 7ff94affd640 1 --2- 172.21.15.39:0/2619783748 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff94c148480 0x7ff94c145c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:40:31.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.857+0000 7f028b231640 1 --2- 172.21.15.39:0/606525198 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f027c0dfd80 0x7f027c006910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.896 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.857+0000 7ff94b7fe640 1 --2- 172.21.15.39:0/2619783748 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff94c0cf230 0x7ff94c165b80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff94000c960 tx=0x7ff94000ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:31.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.857+0000 7f2ff1522640 1 -- 172.21.15.39:0/3464510275 shutdown_connections 2024-05-14T14:40:31.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.857+0000 7f0289a2e640 1 --2- 172.21.15.39:0/606525198 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f027c0544c0 0x7f027c04a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.897 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.857+0000 7f2ff1522640 1 -- 172.21.15.39:0/3464510275 wait complete. 2024-05-14T14:40:31.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.857+0000 7f028b231640 1 -- 172.21.15.39:0/606525198 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f027c050a20 con 0x7f027c00c2d0 2024-05-14T14:40:31.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.858+0000 7f028b231640 1 -- 172.21.15.39:0/606525198 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f027c0508a0 con 0x7f027c0dfd80 2024-05-14T14:40:31.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.858+0000 7ff937fff640 1 -- 172.21.15.39:0/2619783748 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff940015070 con 0x7ff94c0cf230 2024-05-14T14:40:31.898 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.858+0000 7f028aa30640 1 --2- 172.21.15.39:0/606525198 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f027c0dfd80 0x7f027c006910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.858+0000 7ff937fff640 1 -- 172.21.15.39:0/2619783748 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff940007880 con 0x7ff94c0cf230 2024-05-14T14:40:31.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.858+0000 7ff95210d640 1 -- 172.21.15.39:0/2619783748 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff94c166480 con 0x7ff94c0cf230 2024-05-14T14:40:31.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.858+0000 7ff95210d640 1 -- 172.21.15.39:0/2619783748 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff94c166a40 con 0x7ff94c0cf230 2024-05-14T14:40:31.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.858+0000 7fb490a74640 1 -- 172.21.15.39:0/1518741401 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb4840e73a0 msgr2=0x7fb484181fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.858+0000 7fb490a74640 1 --2- 172.21.15.39:0/1518741401 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb4840e73a0 0x7fb484181fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.858+0000 7fb490a74640 1 -- 172.21.15.39:0/1518741401 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb484006490 msgr2=0x7fb4840e5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.858+0000 7fb490a74640 1 --2- 172.21.15.39:0/1518741401 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb484006490 0x7fb4840e5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.858+0000 7fb490a74640 1 -- 172.21.15.39:0/1518741401 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4840dbea0 con 0x7fb484050350 2024-05-14T14:40:31.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.858+0000 7f028b231640 1 -- 172.21.15.39:0/606525198 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f027c050ba0 con 0x7f027c0544c0 2024-05-14T14:40:31.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.858+0000 7fb490a74640 1 --2- 172.21.15.39:0/1518741401 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb484050350 0x7fb484181aa0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb48c000b60 tx=0x7fb48c0696a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:31.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.858+0000 7f0289a2e640 1 -- 172.21.15.39:0/606525198 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f027c0dfd80 msgr2=0x7f027c006910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.858+0000 7f0289a2e640 1 --2- 172.21.15.39:0/606525198 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f027c0dfd80 0x7f027c006910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.858+0000 7f0289a2e640 1 -- 172.21.15.39:0/606525198 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f027c00c2d0 msgr2=0x7f027c179550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.859+0000 7f6c91866640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c84007320 0x7f6c840d43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.859+0000 7f32c644d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f32b800c2c0 0x7f32b80bdd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.859+0000 7f0289a2e640 1 --2- 172.21.15.39:0/606525198 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f027c00c2d0 0x7f027c179550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.859+0000 7f0289a2e640 1 -- 172.21.15.39:0/606525198 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f027c0d3700 con 0x7f027c0544c0 2024-05-14T14:40:31.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.859+0000 7f30b60eb640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30a8039440 0x7f30a80d1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.901 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.859+0000 7f6c91866640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6c84007730 0x7f6c84171bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.859+0000 7f028a22f640 1 --2- 172.21.15.39:0/606525198 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f027c00c2d0 0x7f027c179550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T14:40:31.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.859+0000 7f30b60eb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30a80e04c0 0x7f30a804f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.859+0000 7f6c90864640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c84007320 0x7f6c840d43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.902 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.859+0000 7f30b60eb640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30a81755e0 0x7f30a8036a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.859+0000 7f6c90864640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c84007320 0x7f6c840d43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.39:56834/0 (socket says 172.21.15.39:56834) 2024-05-14T14:40:31.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.859+0000 7f6c90864640 1 -- 172.21.15.39:0/2830972534 learned_addr learned my addr 172.21.15.39:0/2830972534 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:31.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.859+0000 7f30b60eb640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f30a80081d0 con 0x7f30a80e04c0 2024-05-14T14:40:31.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.859+0000 7f30b48e8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30a80e04c0 0x7f30a804f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.903 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.859+0000 7f6c8bfff640 1 --2- 172.21.15.39:0/2830972534 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6c84007730 0x7f6c84171bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.859+0000 7f30b48e8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30a80e04c0 0x7f30a804f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48182/0 (socket says 172.21.15.39:48182) 2024-05-14T14:40:31.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.859+0000 7f30b48e8640 1 -- 172.21.15.39:0/2201398144 learned_addr learned my addr 172.21.15.39:0/2201398144 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:31.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.859+0000 7f30b58ea640 1 --2- 172.21.15.39:0/2201398144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30a81755e0 0x7f30a8036a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.859+0000 7f6c91866640 1 --2- 172.21.15.39:0/2830972534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6c84052fb0 0x7f6c840d6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.859+0000 7f0289a2e640 1 --2- 172.21.15.39:0/606525198 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f027c0544c0 0x7f027c04a310 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f027400e8a0 tx=0x7f027400ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:31.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.859+0000 7f32c644d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32b80544b0 0x7f32b80cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.859+0000 7f30b60eb640 1 -- 172.21.15.39:0/2201398144 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f30a8055650 con 0x7f30a81755e0 2024-05-14T14:40:31.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.859+0000 7f30b60eb640 1 -- 172.21.15.39:0/2201398144 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f30a8009620 con 0x7f30a8039440 2024-05-14T14:40:31.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.859+0000 7f30b50e9640 1 --2- 172.21.15.39:0/2201398144 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30a8039440 0x7f30a80d1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.859+0000 7f32c644d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32b80e3360 0x7f32b80cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.859+0000 7f32c544b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f32b800c2c0 0x7f32b80bdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.859+0000 7f32c544b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f32b800c2c0 0x7f32b80bdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.39:41752/0 (socket says 172.21.15.39:41752) 2024-05-14T14:40:31.906 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.860+0000 7f32c4c4a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32b80544b0 0x7f32b80cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.860+0000 7f7853abd640 1 Processor -- start 2024-05-14T14:40:31.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.860+0000 7f7853abd640 1 -- start start 2024-05-14T14:40:31.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.860+0000 7f30b48e8640 1 -- 172.21.15.39:0/2201398144 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30a8039440 msgr2=0x7f30a80d1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.860+0000 7f32c4c4a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32b80544b0 0x7f32b80cc1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.39:56840/0 (socket says 172.21.15.39:56840) 2024-05-14T14:40:31.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.860+0000 7f30b48e8640 1 --2- 172.21.15.39:0/2201398144 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30a8039440 0x7f30a80d1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.860+0000 7f30b48e8640 1 -- 172.21.15.39:0/2201398144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30a81755e0 msgr2=0x7f30a8036a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.860+0000 7f32c544b640 1 -- 172.21.15.39:0/2961700032 learned_addr learned my addr 172.21.15.39:0/2961700032 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:31.908 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.860+0000 7f32c5c4c640 1 --2- 172.21.15.39:0/2961700032 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32b80e3360 0x7f32b80cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.860+0000 7ff937fff640 1 -- 172.21.15.39:0/2619783748 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff940007c70 con 0x7ff94c0cf230 2024-05-14T14:40:31.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.860+0000 7f32c644d640 1 -- 172.21.15.39:0/2961700032 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f32b80077f0 con 0x7f32b80e3360 2024-05-14T14:40:31.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.860+0000 7f32c644d640 1 -- 172.21.15.39:0/2961700032 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f32b8053cb0 con 0x7f32b80544b0 2024-05-14T14:40:31.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.859+0000 7f027affd640 1 -- 172.21.15.39:0/606525198 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0274017070 con 0x7f027c0544c0 2024-05-14T14:40:31.909 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.859+0000 7f027affd640 1 -- 172.21.15.39:0/606525198 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f027400c940 con 0x7f027c0544c0 2024-05-14T14:40:31.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.859+0000 7f027affd640 1 -- 172.21.15.39:0/606525198 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0274009e60 con 0x7f027c0544c0 2024-05-14T14:40:31.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.859+0000 7f028b231640 1 -- 172.21.15.39:0/606525198 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f027c0d39e0 con 0x7f027c0544c0 2024-05-14T14:40:31.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.860+0000 7f028b231640 1 -- 172.21.15.39:0/606525198 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f027c0d3fa0 con 0x7f027c0544c0 2024-05-14T14:40:31.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.860+0000 7f32c644d640 1 -- 172.21.15.39:0/2961700032 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f32b8007970 con 0x7f32b800c2c0 2024-05-14T14:40:31.910 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.860+0000 7f30b48e8640 1 --2- 172.21.15.39:0/2201398144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30a81755e0 0x7f30a8036a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.860+0000 7f30b48e8640 1 -- 172.21.15.39:0/2201398144 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a804d7b0 con 0x7f30a80e04c0 2024-05-14T14:40:31.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.861+0000 7f2ff1522640 1 Processor -- start 2024-05-14T14:40:31.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.861+0000 7f32c4c4a640 1 -- 172.21.15.39:0/2961700032 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f32b800c2c0 msgr2=0x7f32b80bdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.861+0000 7f32c4c4a640 1 --2- 172.21.15.39:0/2961700032 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f32b800c2c0 0x7f32b80bdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.861+0000 7f32c4c4a640 1 -- 172.21.15.39:0/2961700032 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32b80e3360 msgr2=0x7f32b80cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.861+0000 7f32c4c4a640 1 --2- 172.21.15.39:0/2961700032 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f32b80e3360 0x7f32b80cc6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.861+0000 7f32c4c4a640 1 -- 172.21.15.39:0/2961700032 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b80c65b0 con 0x7f32b80544b0 2024-05-14T14:40:31.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.861+0000 7f30b58ea640 1 --2- 172.21.15.39:0/2201398144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30a81755e0 0x7f30a8036a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:40:31.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.861+0000 7f30b50e9640 1 --2- 172.21.15.39:0/2201398144 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30a8039440 0x7f30a80d1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:40:31.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.861+0000 7f30b48e8640 1 --2- 172.21.15.39:0/2201398144 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30a80e04c0 0x7f30a804f660 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f30b00769a0 tx=0x7f30b0076db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:31.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.861+0000 7f2ff1522640 1 -- start start 2024-05-14T14:40:31.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.861+0000 7f32c4c4a640 1 --2- 172.21.15.39:0/2961700032 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32b80544b0 0x7f32b80cc1a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f32c0051620 tx=0x7f32c006a820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:31.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.861+0000 7f30a5ffb640 1 -- 172.21.15.39:0/2201398144 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b006d820 con 0x7f30a80e04c0 2024-05-14T14:40:31.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.860+0000 7f6c91866640 1 -- 172.21.15.39:0/2830972534 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6c84006e00 con 0x7f6c84052fb0 2024-05-14T14:40:31.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.860+0000 7f6c91065640 1 --2- 172.21.15.39:0/2830972534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6c84052fb0 0x7f6c840d6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.860+0000 7f6c91866640 1 -- 172.21.15.39:0/2830972534 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6c84006b20 con 0x7f6c84007320 2024-05-14T14:40:31.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.860+0000 7f6c91866640 1 -- 172.21.15.39:0/2830972534 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f6c84038340 con 0x7f6c84007730 2024-05-14T14:40:31.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.861+0000 7f30a5ffb640 1 -- 172.21.15.39:0/2201398144 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30b006d9e0 con 0x7f30a80e04c0 2024-05-14T14:40:31.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.862+0000 7f30a5ffb640 1 -- 172.21.15.39:0/2201398144 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b006de10 con 0x7f30a80e04c0 2024-05-14T14:40:31.914 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.862+0000 7ff95210d640 1 -- 172.21.15.39:0/2619783748 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff94c069ad0 con 0x7ff94c0cf230 2024-05-14T14:40:31.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.862+0000 7f7853abd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f784c06c6a0 0x7f784c161c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.862+0000 7f30b60eb640 1 -- 172.21.15.39:0/2201398144 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30a804dcb0 con 0x7f30a80e04c0 2024-05-14T14:40:31.915 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.862+0000 7f32b5ffb640 1 -- 172.21.15.39:0/2961700032 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c00bc070 con 0x7f32b80544b0 2024-05-14T14:40:31.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.861+0000 7fb481ffb640 1 -- 172.21.15.39:0/1518741401 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb48c0bc070 con 0x7fb484050350 2024-05-14T14:40:31.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.861+0000 7fb481ffb640 1 -- 172.21.15.39:0/1518741401 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb48c0b8410 con 0x7fb484050350 2024-05-14T14:40:31.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.862+0000 7fb481ffb640 1 -- 172.21.15.39:0/1518741401 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb48c0b4040 con 0x7fb484050350 2024-05-14T14:40:31.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.862+0000 7fb492277640 1 -- 172.21.15.39:0/1518741401 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4840dae00 con 0x7fb484050350 2024-05-14T14:40:31.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.862+0000 7f32b5ffb640 1 -- 172.21.15.39:0/2961700032 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32c00b8610 con 0x7f32b80544b0 2024-05-14T14:40:31.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.862+0000 7f32c644d640 1 -- 172.21.15.39:0/2961700032 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32b80c6890 con 0x7f32b80544b0 2024-05-14T14:40:31.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.862+0000 7f32c644d640 1 -- 172.21.15.39:0/2961700032 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32b80c6e50 con 0x7f32b80544b0 2024-05-14T14:40:31.916 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.862+0000 7f7851859640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f784c06c6a0 0x7f784c161c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.862+0000 7f7851859640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f784c06c6a0 0x7f784c161c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48204/0 (socket says 172.21.15.39:48204) 2024-05-14T14:40:31.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.862+0000 7f7851859640 1 -- 172.21.15.39:0/936534358 learned_addr learned my addr 172.21.15.39:0/936534358 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:31.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.862+0000 7f7853abd640 1 --2- 172.21.15.39:0/936534358 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f784c070c20 0x7f784c0b5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.862+0000 7f7853abd640 1 --2- 172.21.15.39:0/936534358 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f784c165410 0x7f784c0b5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.862+0000 7f7851058640 1 --2- 172.21.15.39:0/936534358 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f784c070c20 0x7f784c0b5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.862+0000 7f785205a640 1 --2- 172.21.15.39:0/936534358 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f784c165410 0x7f784c0b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.862+0000 7f30b60eb640 1 -- 172.21.15.39:0/2201398144 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30a804b530 con 0x7f30a80e04c0 2024-05-14T14:40:31.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.863+0000 7f7853abd640 1 -- 172.21.15.39:0/936534358 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f784c168a50 con 0x7f784c06c6a0 2024-05-14T14:40:31.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.863+0000 7f7853abd640 1 -- 172.21.15.39:0/936534358 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f784c0b1270 con 0x7f784c070c20 2024-05-14T14:40:31.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.863+0000 7f7853abd640 1 -- 172.21.15.39:0/936534358 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f784c09dff0 con 0x7f784c165410 2024-05-14T14:40:31.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.863+0000 7fb492277640 1 -- 172.21.15.39:0/1518741401 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4840db3c0 con 0x7fb484050350 2024-05-14T14:40:31.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.863+0000 7f6c91065640 1 -- 172.21.15.39:0/2830972534 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6c84007730 msgr2=0x7f6c84171bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.863+0000 7f6c91065640 1 --2- 172.21.15.39:0/2830972534 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6c84007730 0x7f6c84171bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.863+0000 7f6c91065640 1 -- 172.21.15.39:0/2830972534 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c84007320 msgr2=0x7f6c840d43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.863+0000 7f6c91065640 1 --2- 172.21.15.39:0/2830972534 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c84007320 0x7f6c840d43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.863+0000 7f028b231640 1 -- 172.21.15.39:0/606525198 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f027c179a90 con 0x7f027c0544c0 2024-05-14T14:40:31.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.863+0000 7f7851859640 1 -- 172.21.15.39:0/936534358 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f784c165410 msgr2=0x7f784c0b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.863+0000 7f7851859640 1 --2- 172.21.15.39:0/936534358 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f784c165410 0x7f784c0b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.863+0000 7f7851859640 1 -- 172.21.15.39:0/936534358 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f784c070c20 msgr2=0x7f784c0b5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.863+0000 7f7851859640 1 --2- 172.21.15.39:0/936534358 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f784c070c20 0x7f784c0b5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.863+0000 7f7851859640 1 -- 172.21.15.39:0/936534358 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f784c160370 con 0x7f784c06c6a0 2024-05-14T14:40:31.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.862+0000 7ff937fff640 1 -- 172.21.15.39:0/2619783748 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff940018070 con 0x7ff94c0cf230 2024-05-14T14:40:31.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.863+0000 7ff937fff640 1 --2- 172.21.15.39:0/2619783748 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7ff930076320 0x7ff930078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.863+0000 7f6c91065640 1 -- 172.21.15.39:0/2830972534 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c840d48e0 con 0x7f6c84052fb0 2024-05-14T14:40:31.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.864+0000 7f6c91065640 1 --2- 172.21.15.39:0/2830972534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6c84052fb0 0x7f6c840d6c60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c051ae0 tx=0x7f6c8c08df60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:31.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.864+0000 7f2ff1522640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2fe40544b0 0x7f2fe404b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.864+0000 7f2ff1522640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2fe40dfd70 0x7f2fe40d0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.864+0000 7f32b5ffb640 1 -- 172.21.15.39:0/2961700032 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32c00b4040 con 0x7f32b80544b0 2024-05-14T14:40:31.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.864+0000 7f6c897fa640 1 -- 172.21.15.39:0/2830972534 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c075480 con 0x7f6c84052fb0 2024-05-14T14:40:31.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.864+0000 7f2ff1522640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2fe40e3360 0x7f2fe40de370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.864+0000 7f6c897fa640 1 -- 172.21.15.39:0/2830972534 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c8c075680 con 0x7f6c84052fb0 2024-05-14T14:40:31.922 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.864+0000 7fb492277640 1 -- 172.21.15.39:0/1518741401 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb48400ae80 con 0x7fb484050350 2024-05-14T14:40:31.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.864+0000 7f7851859640 1 --2- 172.21.15.39:0/936534358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f784c06c6a0 0x7f784c161c10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f784800c430 tx=0x7f784800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:31.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.865+0000 7f2ff1522640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe40e0840 con 0x7f2fe40dfd70 2024-05-14T14:40:31.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.864+0000 7f027affd640 1 -- 172.21.15.39:0/606525198 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f027401a070 con 0x7f027c0544c0 2024-05-14T14:40:31.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.865+0000 7f2ff0d21640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2fe40e3360 0x7f2fe40de370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.923 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.865+0000 7f2ff0d21640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2fe40e3360 0x7f2fe40de370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.39:41772/0 (socket says 172.21.15.39:41772) 2024-05-14T14:40:31.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.865+0000 7f2ff0d21640 1 -- 172.21.15.39:0/3593918850 learned_addr learned my addr 172.21.15.39:0/3593918850 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:31.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.865+0000 7f2feb7fe640 1 --2- 172.21.15.39:0/3593918850 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2fe40dfd70 0x7f2fe40d0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.865+0000 7f2ff1522640 1 -- 172.21.15.39:0/3593918850 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe40e06c0 con 0x7f2fe40544b0 2024-05-14T14:40:31.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.865+0000 7f2ff1522640 1 -- 172.21.15.39:0/3593918850 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f2fe4050bc0 con 0x7f2fe40e3360 2024-05-14T14:40:31.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.866+0000 7f6c897fa640 1 -- 172.21.15.39:0/2830972534 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c06d820 con 0x7f6c84052fb0 2024-05-14T14:40:31.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.866+0000 7f6c91866640 1 -- 172.21.15.39:0/2830972534 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c84172940 con 0x7f6c84052fb0 2024-05-14T14:40:31.924 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.866+0000 7f6c91866640 1 -- 172.21.15.39:0/2830972534 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c840d5030 con 0x7f6c84052fb0 2024-05-14T14:40:31.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.865+0000 7ff94affd640 1 --2- 172.21.15.39:0/2619783748 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7ff930076320 0x7ff930078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.865+0000 7ff937fff640 1 -- 172.21.15.39:0/2619783748 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff94005cca0 con 0x7ff94c0cf230 2024-05-14T14:40:31.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.865+0000 7ff937fff640 1 --2- 172.21.15.39:0/2619783748 >> [v2:172.21.15.39:6816/926357398,v1:172.21.15.39:6817/926357398] conn(0x7ff930080740 0x7ff930082c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.865+0000 7ff937fff640 1 -- 172.21.15.39:0/2619783748 --> [v2:172.21.15.39:6816/926357398,v1:172.21.15.39:6817/926357398] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff940007880 con 0x7ff930080740 2024-05-14T14:40:31.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.867+0000 7ff94bfff640 1 --2- 172.21.15.39:0/2619783748 >> [v2:172.21.15.39:6816/926357398,v1:172.21.15.39:6817/926357398] conn(0x7ff930080740 0x7ff930082c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.867+0000 7ff937fff640 1 -- 172.21.15.39:0/2619783748 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff94005cea0 con 0x7ff94c0cf230 2024-05-14T14:40:31.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.866+0000 7fb481ffb640 1 -- 172.21.15.39:0/1518741401 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb48c0b87c0 con 0x7fb484050350 2024-05-14T14:40:31.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.867+0000 7fb481ffb640 1 --2- 172.21.15.39:0/1518741401 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fb4700763a0 0x7fb4700788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.925 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.867+0000 7fb481ffb640 1 -- 172.21.15.39:0/1518741401 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb48c134390 con 0x7fb484050350 2024-05-14T14:40:31.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.865+0000 7f027affd640 1 --2- 172.21.15.39:0/606525198 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f02680763a0 0x7f02680788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.865+0000 7f027affd640 1 -- 172.21.15.39:0/606525198 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0274097680 con 0x7f027c0544c0 2024-05-14T14:40:31.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.865+0000 7f027affd640 1 --2- 172.21.15.39:0/606525198 >> [v2:172.21.15.62:6824/3481507129,v1:172.21.15.62:6825/3481507129] conn(0x7f026807fb60 0x7f0268081ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.865+0000 7f027affd640 1 -- 172.21.15.39:0/606525198 --> [v2:172.21.15.62:6824/3481507129,v1:172.21.15.62:6825/3481507129] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f027400ce90 con 0x7f026807fb60 2024-05-14T14:40:31.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.865+0000 7f027affd640 1 -- 172.21.15.39:0/606525198 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f027409e050 con 0x7f027c0544c0 2024-05-14T14:40:31.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.866+0000 7f028a22f640 1 --2- 172.21.15.39:0/606525198 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f02680763a0 0x7f02680788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.866+0000 7f028aa30640 1 --2- 172.21.15.39:0/606525198 >> [v2:172.21.15.62:6824/3481507129,v1:172.21.15.62:6825/3481507129] conn(0x7f026807fb60 0x7f0268081ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.867+0000 7f028a22f640 1 --2- 172.21.15.39:0/606525198 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f02680763a0 0x7f02680788b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0280009630 tx=0x7f028002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:31.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.867+0000 7f028aa30640 1 --2- 172.21.15.39:0/606525198 >> [v2:172.21.15.62:6824/3481507129,v1:172.21.15.62:6825/3481507129] conn(0x7f026807fb60 0x7f0268081ff0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:31.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.866+0000 7f32b5ffb640 1 -- 172.21.15.39:0/2961700032 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f32c00bf070 con 0x7f32b80544b0 2024-05-14T14:40:31.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.867+0000 7f32ab7fe640 1 -- 172.21.15.39:0/2961700032 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f32b8005490 con 0x7f32b80544b0 2024-05-14T14:40:31.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.867+0000 7f32b5ffb640 1 --2- 172.21.15.39:0/2961700032 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f32a40763d0 0x7f32a40788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.865+0000 7f78427fc640 1 -- 172.21.15.39:0/936534358 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7848017070 con 0x7f784c06c6a0 2024-05-14T14:40:31.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.865+0000 7f78427fc640 1 -- 172.21.15.39:0/936534358 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78480052d0 con 0x7f784c06c6a0 2024-05-14T14:40:31.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.865+0000 7f7853abd640 1 -- 172.21.15.39:0/936534358 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f784c160650 con 0x7f784c06c6a0 2024-05-14T14:40:31.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.865+0000 7f7853abd640 1 -- 172.21.15.39:0/936534358 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f784c160c10 con 0x7f784c06c6a0 2024-05-14T14:40:31.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.867+0000 7f78427fc640 1 -- 172.21.15.39:0/936534358 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78480037f0 con 0x7f784c06c6a0 2024-05-14T14:40:31.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.867+0000 7f7853abd640 1 -- 172.21.15.39:0/936534358 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7834001030 con 0x7f784c06c6a0 2024-05-14T14:40:31.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.866+0000 7f30a5ffb640 1 -- 172.21.15.39:0/2201398144 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f30b0096430 con 0x7f30a80e04c0 2024-05-14T14:40:31.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.866+0000 7f30b60eb640 1 -- 172.21.15.39:0/2201398144 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f30a80058e0 con 0x7f30a80e04c0 2024-05-14T14:40:31.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.867+0000 7f30a5ffb640 1 --2- 172.21.15.39:0/2201398144 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f30940763a0 0x7f30940788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.867+0000 7f30a5ffb640 1 -- 172.21.15.39:0/2201398144 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f30b0113da0 con 0x7f30a80e04c0 2024-05-14T14:40:31.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.867+0000 7f30a5ffb640 1 --2- 172.21.15.39:0/2201398144 >> [v2:172.21.15.62:6808/2800379225,v1:172.21.15.62:6809/2800379225] conn(0x7f309407fae0 0x7f3094081f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.867+0000 7f30a5ffb640 1 -- 172.21.15.39:0/2201398144 --> [v2:172.21.15.62:6808/2800379225,v1:172.21.15.62:6809/2800379225] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3094082640 con 0x7f309407fae0 2024-05-14T14:40:31.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.867+0000 7fb481ffb640 1 --2- 172.21.15.39:0/1518741401 >> [v2:172.21.15.39:6808/610616754,v1:172.21.15.39:6809/610616754] conn(0x7fb47007fae0 0x7fb470081f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.867+0000 7fb481ffb640 1 -- 172.21.15.39:0/1518741401 --> [v2:172.21.15.39:6808/610616754,v1:172.21.15.39:6809/610616754] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb48c0b0e80 con 0x7fb47007fae0 2024-05-14T14:40:31.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.867+0000 7fb481ffb640 1 -- 172.21.15.39:0/1518741401 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb48c13b050 con 0x7fb484050350 2024-05-14T14:40:31.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.867+0000 7f32c544b640 1 --2- 172.21.15.39:0/2961700032 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f32a40763d0 0x7f32a40788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.867+0000 7f30b50e9640 1 --2- 172.21.15.39:0/2201398144 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f30940763a0 0x7f30940788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.868+0000 7f30b58ea640 1 --2- 172.21.15.39:0/2201398144 >> [v2:172.21.15.62:6808/2800379225,v1:172.21.15.62:6809/2800379225] conn(0x7f309407fae0 0x7f3094081f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.868+0000 7f32b5ffb640 1 -- 172.21.15.39:0/2961700032 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f32c0134a30 con 0x7f32b80544b0 2024-05-14T14:40:31.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.868+0000 7f32b5ffb640 1 --2- 172.21.15.39:0/2961700032 >> [v2:172.21.15.62:6800/3291934116,v1:172.21.15.62:6801/3291934116] conn(0x7f32a407fb10 0x7f32a4081fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.868+0000 7f32b5ffb640 1 -- 172.21.15.39:0/2961700032 --> [v2:172.21.15.62:6800/3291934116,v1:172.21.15.62:6801/3291934116] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f32c00b8610 con 0x7f32a407fb10 2024-05-14T14:40:31.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.868+0000 7f32b5ffb640 1 -- 172.21.15.39:0/2961700032 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f32c013b050 con 0x7f32b80544b0 2024-05-14T14:40:31.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.865+0000 7f2febfff640 1 --2- 172.21.15.39:0/3593918850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2fe40544b0 0x7f2fe404b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.930 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.868+0000 7f32c5c4c640 1 --2- 172.21.15.39:0/2961700032 >> [v2:172.21.15.62:6800/3291934116,v1:172.21.15.62:6801/3291934116] conn(0x7f32a407fb10 0x7f32a4081fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.868+0000 7f6c91866640 1 -- 172.21.15.39:0/2830972534 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6c840054a0 con 0x7f6c84052fb0 2024-05-14T14:40:31.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.868+0000 7ff94bfff640 1 --2- 172.21.15.39:0/2619783748 >> [v2:172.21.15.39:6816/926357398,v1:172.21.15.39:6817/926357398] conn(0x7ff930080740 0x7ff930082c30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:31.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.868+0000 7fb491a76640 1 --2- 172.21.15.39:0/1518741401 >> [v2:172.21.15.39:6808/610616754,v1:172.21.15.39:6809/610616754] conn(0x7fb47007fae0 0x7fb470081f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.931 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.868+0000 7f32c544b640 1 --2- 172.21.15.39:0/2961700032 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f32a40763d0 0x7f32a40788e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f32b0000f60 tx=0x7f32b0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:31.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.868+0000 7fb491275640 1 --2- 172.21.15.39:0/1518741401 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fb4700763a0 0x7fb4700788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.868+0000 7f30b50e9640 1 --2- 172.21.15.39:0/2201398144 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f30940763a0 0x7f30940788b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f30a0009a10 tx=0x7f30a0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:31.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.868+0000 7f30b58ea640 1 --2- 172.21.15.39:0/2201398144 >> [v2:172.21.15.62:6808/2800379225,v1:172.21.15.62:6809/2800379225] conn(0x7f309407fae0 0x7f3094081f70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:31.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.869+0000 7ff937fff640 1 -- 172.21.15.39:0/2619783748 <== osd.1 v2:172.21.15.39:6816/926357398 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff940007880 con 0x7ff930080740 2024-05-14T14:40:31.932 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.869+0000 7f027affd640 1 -- 172.21.15.39:0/606525198 <== osd.4 v2:172.21.15.62:6824/3481507129 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f027400ce90 con 0x7f026807fb60 2024-05-14T14:40:31.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.869+0000 7ff94affd640 1 --2- 172.21.15.39:0/2619783748 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7ff930076320 0x7ff930078830 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff944001310 tx=0x7ff944009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:31.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.869+0000 7fb491a76640 1 --2- 172.21.15.39:0/1518741401 >> [v2:172.21.15.39:6808/610616754,v1:172.21.15.39:6809/610616754] conn(0x7fb47007fae0 0x7fb470081f70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:31.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.869+0000 7f2feb7fe640 1 -- 172.21.15.39:0/3593918850 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2fe40e3360 msgr2=0x7f2fe40de370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.869+0000 7f2feb7fe640 1 --2- 172.21.15.39:0/3593918850 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2fe40e3360 0x7f2fe40de370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.869+0000 7f2feb7fe640 1 -- 172.21.15.39:0/3593918850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2fe40544b0 msgr2=0x7f2fe404b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.869+0000 7f2feb7fe640 1 --2- 172.21.15.39:0/3593918850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2fe40544b0 0x7f2fe404b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.869+0000 7f6c897fa640 1 -- 172.21.15.39:0/2830972534 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6c8c06d9c0 con 0x7f6c84052fb0 2024-05-14T14:40:31.934 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.869+0000 7f2feb7fe640 1 -- 172.21.15.39:0/3593918850 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe40d14c0 con 0x7f2fe40dfd70 2024-05-14T14:40:31.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.870+0000 7f30a5ffb640 1 -- 172.21.15.39:0/2201398144 <== osd.7 v2:172.21.15.62:6808/2800379225 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3094082640 con 0x7f309407fae0 2024-05-14T14:40:31.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.870+0000 7f32c5c4c640 1 --2- 172.21.15.39:0/2961700032 >> [v2:172.21.15.62:6800/3291934116,v1:172.21.15.62:6801/3291934116] conn(0x7f32a407fb10 0x7f32a4081fa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:31.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.869+0000 7fb491275640 1 --2- 172.21.15.39:0/1518741401 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fb4700763a0 0x7fb4700788b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb488009a90 tx=0x7fb488009110 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:31.935 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.870+0000 7f2feb7fe640 1 --2- 172.21.15.39:0/3593918850 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2fe40dfd70 0x7f2fe40d0f80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0032000 tx=0x7f2fe00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:31.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.870+0000 7f30a5ffb640 1 -- 172.21.15.39:0/2201398144 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f30b0118030 con 0x7f30a80e04c0 2024-05-14T14:40:31.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.870+0000 7f6c897fa640 1 --2- 172.21.15.39:0/2830972534 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f6c700763a0 0x7f6c700788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.870+0000 7f2fe8ff9640 1 -- 172.21.15.39:0/3593918850 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe0041020 con 0x7f2fe40dfd70 2024-05-14T14:40:31.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.870+0000 7f6c90864640 1 --2- 172.21.15.39:0/2830972534 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f6c700763a0 0x7f6c700788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.871+0000 7f6c897fa640 1 -- 172.21.15.39:0/2830972534 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6c8c113bf0 con 0x7f6c84052fb0 2024-05-14T14:40:31.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.872+0000 7f6c897fa640 1 --2- 172.21.15.39:0/2830972534 >> [v2:172.21.15.39:6800/4023478848,v1:172.21.15.39:6801/4023478848] conn(0x7f6c7007fb60 0x7f6c70081ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.872+0000 7f6c90864640 1 --2- 172.21.15.39:0/2830972534 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f6c700763a0 0x7f6c700788b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6c80006f40 tx=0x7f6c80009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:31.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.872+0000 7f6c897fa640 1 -- 172.21.15.39:0/2830972534 --> [v2:172.21.15.39:6800/4023478848,v1:172.21.15.39:6801/4023478848] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6c8c075680 con 0x7f6c7007fb60 2024-05-14T14:40:31.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.872+0000 7f6c897fa640 1 -- 172.21.15.39:0/2830972534 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f6c8c1182a0 con 0x7f6c84052fb0 2024-05-14T14:40:31.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.872+0000 7f6c8bfff640 1 --2- 172.21.15.39:0/2830972534 >> [v2:172.21.15.39:6800/4023478848,v1:172.21.15.39:6801/4023478848] conn(0x7f6c7007fb60 0x7f6c70081ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.873+0000 7f6c8bfff640 1 --2- 172.21.15.39:0/2830972534 >> [v2:172.21.15.39:6800/4023478848,v1:172.21.15.39:6801/4023478848] conn(0x7f6c7007fb60 0x7f6c70081ff0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:31.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.870+0000 7fb481ffb640 1 -- 172.21.15.39:0/1518741401 <== osd.2 v2:172.21.15.39:6808/610616754 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb48c0b0e80 con 0x7fb47007fae0 2024-05-14T14:40:31.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.870+0000 7f2fe8ff9640 1 -- 172.21.15.39:0/3593918850 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fe003c870 con 0x7f2fe40dfd70 2024-05-14T14:40:31.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.870+0000 7f2fe8ff9640 1 -- 172.21.15.39:0/3593918850 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe0037040 con 0x7f2fe40dfd70 2024-05-14T14:40:31.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.872+0000 7f2ff1522640 1 -- 172.21.15.39:0/3593918850 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fe40dba60 con 0x7f2fe40dfd70 2024-05-14T14:40:31.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.872+0000 7f2ff1522640 1 -- 172.21.15.39:0/3593918850 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fe40dc020 con 0x7f2fe40dfd70 2024-05-14T14:40:31.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.873+0000 7f2ff1522640 1 -- 172.21.15.39:0/3593918850 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2fe4005490 con 0x7f2fe40dfd70 2024-05-14T14:40:31.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.870+0000 7f78427fc640 1 -- 172.21.15.39:0/936534358 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f784801a070 con 0x7f784c06c6a0 2024-05-14T14:40:31.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.871+0000 7f78427fc640 1 --2- 172.21.15.39:0/936534358 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f7830076350 0x7f7830078860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.871+0000 7f7851058640 1 --2- 172.21.15.39:0/936534358 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f7830076350 0x7f7830078860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.871+0000 7f78427fc640 1 -- 172.21.15.39:0/936534358 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f78480973e0 con 0x7f784c06c6a0 2024-05-14T14:40:31.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.871+0000 7f78427fc640 1 --2- 172.21.15.39:0/936534358 >> [v2:172.21.15.62:6816/3005996101,v1:172.21.15.62:6817/3005996101] conn(0x7f783007fb20 0x7f7830081fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.871+0000 7f78427fc640 1 -- 172.21.15.39:0/936534358 --> [v2:172.21.15.62:6816/3005996101,v1:172.21.15.62:6817/3005996101] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f784800ee50 con 0x7f783007fb20 2024-05-14T14:40:31.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.871+0000 7f78427fc640 1 -- 172.21.15.39:0/936534358 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7848097790 con 0x7f784c06c6a0 2024-05-14T14:40:31.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.872+0000 7f7851058640 1 --2- 172.21.15.39:0/936534358 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f7830076350 0x7f7830078860 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7844033000 tx=0x7f7844009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:31.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.873+0000 7f785205a640 1 --2- 172.21.15.39:0/936534358 >> [v2:172.21.15.62:6816/3005996101,v1:172.21.15.62:6817/3005996101] conn(0x7f783007fb20 0x7f7830081fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.874+0000 7f6c897fa640 1 -- 172.21.15.39:0/2830972534 <== osd.0 v2:172.21.15.39:6800/4023478848 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6c8c075680 con 0x7f6c7007fb60 2024-05-14T14:40:31.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.876+0000 7f2fe8ff9640 1 -- 172.21.15.39:0/3593918850 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2fe0044020 con 0x7f2fe40dfd70 2024-05-14T14:40:31.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.876+0000 7f2fe8ff9640 1 --2- 172.21.15.39:0/3593918850 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f2fd00763d0 0x7f2fd00788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.876+0000 7f2fe8ff9640 1 -- 172.21.15.39:0/3593918850 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2fe00b92d0 con 0x7f2fe40dfd70 2024-05-14T14:40:31.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.873+0000 7f32b5ffb640 1 -- 172.21.15.39:0/2961700032 <== osd.5 v2:172.21.15.62:6800/3291934116 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f32c00b8610 con 0x7f32a407fb10 2024-05-14T14:40:31.940 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.877+0000 7f2fe8ff9640 1 --2- 172.21.15.39:0/3593918850 >> [v2:172.21.15.39:6824/1469314579,v1:172.21.15.39:6825/1469314579] conn(0x7f2fd0081d20 0x7f2fd00841b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:31.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.877+0000 7f2fe8ff9640 1 -- 172.21.15.39:0/3593918850 --> [v2:172.21.15.39:6824/1469314579,v1:172.21.15.39:6825/1469314579] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2fe0001d30 con 0x7f2fd0081d20 2024-05-14T14:40:31.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.877+0000 7f2fe8ff9640 1 -- 172.21.15.39:0/3593918850 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2fe00c0050 con 0x7f2fe40dfd70 2024-05-14T14:40:31.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.877+0000 7f2febfff640 1 --2- 172.21.15.39:0/3593918850 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f2fd00763d0 0x7f2fd00788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.877+0000 7f2ff0d21640 1 --2- 172.21.15.39:0/3593918850 >> [v2:172.21.15.39:6824/1469314579,v1:172.21.15.39:6825/1469314579] conn(0x7f2fd0081d20 0x7f2fd00841b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:31.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.878+0000 7f2febfff640 1 --2- 172.21.15.39:0/3593918850 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f2fd00763d0 0x7f2fd00788e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2fec069fa0 tx=0x7f2fec070040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:31.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.878+0000 7f2ff0d21640 1 --2- 172.21.15.39:0/3593918850 >> [v2:172.21.15.39:6824/1469314579,v1:172.21.15.39:6825/1469314579] conn(0x7f2fd0081d20 0x7f2fd00841b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:31.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.878+0000 7f785205a640 1 --2- 172.21.15.39:0/936534358 >> [v2:172.21.15.62:6816/3005996101,v1:172.21.15.62:6817/3005996101] conn(0x7f783007fb20 0x7f7830081fb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:31.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.879+0000 7f78427fc640 1 -- 172.21.15.39:0/936534358 <== osd.6 v2:172.21.15.62:6816/3005996101 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f784800ee50 con 0x7f783007fb20 2024-05-14T14:40:31.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.879+0000 7f2fe8ff9640 1 -- 172.21.15.39:0/3593918850 <== osd.3 v2:172.21.15.39:6824/1469314579 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2fe0001d30 con 0x7f2fd0081d20 2024-05-14T14:40:31.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.895+0000 7f028b231640 1 -- 172.21.15.39:0/606525198 --> [v2:172.21.15.62:6824/3481507129,v1:172.21.15.62:6825/3481507129] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f027c0d3470 con 0x7f026807fb60 2024-05-14T14:40:31.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.896+0000 7f027affd640 1 -- 172.21.15.39:0/606525198 <== osd.4 v2:172.21.15.62:6824/3481507129 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f027c0d3470 con 0x7f026807fb60 2024-05-14T14:40:31.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.896+0000 7f0278ff9640 1 -- 172.21.15.39:0/606525198 >> [v2:172.21.15.62:6824/3481507129,v1:172.21.15.62:6825/3481507129] conn(0x7f026807fb60 msgr2=0x7f0268081ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.896+0000 7f0278ff9640 1 --2- 172.21.15.39:0/606525198 >> [v2:172.21.15.62:6824/3481507129,v1:172.21.15.62:6825/3481507129] conn(0x7f026807fb60 0x7f0268081ff0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.897+0000 7f0278ff9640 1 -- 172.21.15.39:0/606525198 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f02680763a0 msgr2=0x7f02680788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.897+0000 7f0278ff9640 1 --2- 172.21.15.39:0/606525198 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f02680763a0 0x7f02680788b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0280009630 tx=0x7f028002e000 comp rx=0 tx=0).stop 2024-05-14T14:40:31.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.897+0000 7f0278ff9640 1 -- 172.21.15.39:0/606525198 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f027c0544c0 msgr2=0x7f027c04a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.897+0000 7f0278ff9640 1 --2- 172.21.15.39:0/606525198 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f027c0544c0 0x7f027c04a310 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f027400e8a0 tx=0x7f027400ed60 comp rx=0 tx=0).stop 2024-05-14T14:40:31.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.897+0000 7f028aa30640 1 -- 172.21.15.39:0/606525198 reap_dead start 2024-05-14T14:40:31.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.897+0000 7f0278ff9640 1 -- 172.21.15.39:0/606525198 shutdown_connections 2024-05-14T14:40:31.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.897+0000 7f0278ff9640 1 -- 172.21.15.39:0/606525198 >> 172.21.15.39:0/606525198 conn(0x7f027c054cf0 msgr2=0x7f027c0e02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:31.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.897+0000 7f0278ff9640 1 -- 172.21.15.39:0/606525198 shutdown_connections 2024-05-14T14:40:31.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.897+0000 7f0278ff9640 1 -- 172.21.15.39:0/606525198 wait complete. 2024-05-14T14:40:31.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.902+0000 7fb492277640 1 -- 172.21.15.39:0/1518741401 --> [v2:172.21.15.39:6808/610616754,v1:172.21.15.39:6809/610616754] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb4840e7140 con 0x7fb47007fae0 2024-05-14T14:40:31.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.903+0000 7fb481ffb640 1 -- 172.21.15.39:0/1518741401 <== osd.2 v2:172.21.15.39:6808/610616754 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb4840e7140 con 0x7fb47007fae0 2024-05-14T14:40:31.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.903+0000 7fb46f7fe640 1 -- 172.21.15.39:0/1518741401 >> [v2:172.21.15.39:6808/610616754,v1:172.21.15.39:6809/610616754] conn(0x7fb47007fae0 msgr2=0x7fb470081f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.903+0000 7fb46f7fe640 1 --2- 172.21.15.39:0/1518741401 >> [v2:172.21.15.39:6808/610616754,v1:172.21.15.39:6809/610616754] conn(0x7fb47007fae0 0x7fb470081f70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.904+0000 7ff95210d640 1 -- 172.21.15.39:0/2619783748 --> [v2:172.21.15.39:6816/926357398,v1:172.21.15.39:6817/926357398] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff94c071240 con 0x7ff930080740 2024-05-14T14:40:31.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.904+0000 7fb46f7fe640 1 -- 172.21.15.39:0/1518741401 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fb4700763a0 msgr2=0x7fb4700788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.904+0000 7fb46f7fe640 1 --2- 172.21.15.39:0/1518741401 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fb4700763a0 0x7fb4700788b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb488009a90 tx=0x7fb488009110 comp rx=0 tx=0).stop 2024-05-14T14:40:31.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.904+0000 7fb46f7fe640 1 -- 172.21.15.39:0/1518741401 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb484050350 msgr2=0x7fb484181aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.904+0000 7fb46f7fe640 1 --2- 172.21.15.39:0/1518741401 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb484050350 0x7fb484181aa0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb48c000b60 tx=0x7fb48c0696a0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.904+0000 7fb491a76640 1 -- 172.21.15.39:0/1518741401 reap_dead start 2024-05-14T14:40:31.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.904+0000 7fb46f7fe640 1 -- 172.21.15.39:0/1518741401 shutdown_connections 2024-05-14T14:40:31.946 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.904+0000 7fb46f7fe640 1 -- 172.21.15.39:0/1518741401 >> 172.21.15.39:0/1518741401 conn(0x7fb48400aa70 msgr2=0x7fb4840edb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:31.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.905+0000 7ff937fff640 1 -- 172.21.15.39:0/2619783748 <== osd.1 v2:172.21.15.39:6816/926357398 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff94c071240 con 0x7ff930080740 2024-05-14T14:40:31.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.905+0000 7fb46f7fe640 1 -- 172.21.15.39:0/1518741401 shutdown_connections 2024-05-14T14:40:31.947 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.905+0000 7f30b60eb640 1 -- 172.21.15.39:0/2201398144 --> [v2:172.21.15.62:6808/2800379225,v1:172.21.15.62:6809/2800379225] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f30a804baf0 con 0x7f309407fae0 2024-05-14T14:40:31.948 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.905+0000 7fb46f7fe640 1 -- 172.21.15.39:0/1518741401 wait complete. 2024-05-14T14:40:31.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.906+0000 7ff935ffb640 1 -- 172.21.15.39:0/2619783748 >> [v2:172.21.15.39:6816/926357398,v1:172.21.15.39:6817/926357398] conn(0x7ff930080740 msgr2=0x7ff930082c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.906+0000 7ff935ffb640 1 --2- 172.21.15.39:0/2619783748 >> [v2:172.21.15.39:6816/926357398,v1:172.21.15.39:6817/926357398] conn(0x7ff930080740 0x7ff930082c30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.906+0000 7ff935ffb640 1 -- 172.21.15.39:0/2619783748 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7ff930076320 msgr2=0x7ff930078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.906+0000 7ff935ffb640 1 --2- 172.21.15.39:0/2619783748 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7ff930076320 0x7ff930078830 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff944001310 tx=0x7ff944009040 comp rx=0 tx=0).stop 2024-05-14T14:40:31.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.906+0000 7ff935ffb640 1 -- 172.21.15.39:0/2619783748 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff94c0cf230 msgr2=0x7ff94c165b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.906+0000 7ff935ffb640 1 --2- 172.21.15.39:0/2619783748 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff94c0cf230 0x7ff94c165b80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff94000c960 tx=0x7ff94000ce20 comp rx=0 tx=0).stop 2024-05-14T14:40:31.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.906+0000 7ff94bfff640 1 -- 172.21.15.39:0/2619783748 reap_dead start 2024-05-14T14:40:31.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.906+0000 7ff935ffb640 1 -- 172.21.15.39:0/2619783748 shutdown_connections 2024-05-14T14:40:31.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.906+0000 7ff935ffb640 1 -- 172.21.15.39:0/2619783748 >> 172.21.15.39:0/2619783748 conn(0x7ff94c073200 msgr2=0x7ff94c162a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:31.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.906+0000 7f30a5ffb640 1 -- 172.21.15.39:0/2201398144 <== osd.7 v2:172.21.15.62:6808/2800379225 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f30a804baf0 con 0x7f309407fae0 2024-05-14T14:40:31.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.907+0000 7ff935ffb640 1 -- 172.21.15.39:0/2619783748 shutdown_connections 2024-05-14T14:40:31.950 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.907+0000 7ff935ffb640 1 -- 172.21.15.39:0/2619783748 wait complete. 2024-05-14T14:40:31.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.907+0000 7f30b60eb640 1 -- 172.21.15.39:0/2201398144 >> [v2:172.21.15.62:6808/2800379225,v1:172.21.15.62:6809/2800379225] conn(0x7f309407fae0 msgr2=0x7f3094081f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.907+0000 7f30b60eb640 1 --2- 172.21.15.39:0/2201398144 >> [v2:172.21.15.62:6808/2800379225,v1:172.21.15.62:6809/2800379225] conn(0x7f309407fae0 0x7f3094081f70 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.907+0000 7f32ab7fe640 1 -- 172.21.15.39:0/2961700032 --> [v2:172.21.15.62:6800/3291934116,v1:172.21.15.62:6801/3291934116] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f32b80c6360 con 0x7f32a407fb10 2024-05-14T14:40:31.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.908+0000 7f6c91866640 1 -- 172.21.15.39:0/2830972534 --> [v2:172.21.15.39:6800/4023478848,v1:172.21.15.39:6801/4023478848] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6c841726f0 con 0x7f6c7007fb60 2024-05-14T14:40:31.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.908+0000 7f30b60eb640 1 -- 172.21.15.39:0/2201398144 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f30940763a0 msgr2=0x7f30940788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.908+0000 7f30b60eb640 1 --2- 172.21.15.39:0/2201398144 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f30940763a0 0x7f30940788b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f30a0009a10 tx=0x7f30a0008040 comp rx=0 tx=0).stop 2024-05-14T14:40:31.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.908+0000 7f30b60eb640 1 -- 172.21.15.39:0/2201398144 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30a80e04c0 msgr2=0x7f30a804f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.908+0000 7f30b60eb640 1 --2- 172.21.15.39:0/2201398144 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30a80e04c0 0x7f30a804f660 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f30b00769a0 tx=0x7f30b0076db0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.908+0000 7f30b58ea640 1 -- 172.21.15.39:0/2201398144 reap_dead start 2024-05-14T14:40:31.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.908+0000 7f30b60eb640 1 -- 172.21.15.39:0/2201398144 shutdown_connections 2024-05-14T14:40:31.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.908+0000 7f30b60eb640 1 -- 172.21.15.39:0/2201398144 >> 172.21.15.39:0/2201398144 conn(0x7f30a8055df0 msgr2=0x7f30a80e3110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:31.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.908+0000 7f32b5ffb640 1 -- 172.21.15.39:0/2961700032 <== osd.5 v2:172.21.15.62:6800/3291934116 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f32b80c6360 con 0x7f32a407fb10 2024-05-14T14:40:31.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.908+0000 7f6c897fa640 1 -- 172.21.15.39:0/2830972534 <== osd.0 v2:172.21.15.39:6800/4023478848 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6c841726f0 con 0x7f6c7007fb60 2024-05-14T14:40:31.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.909+0000 7f32c644d640 1 -- 172.21.15.39:0/2961700032 >> [v2:172.21.15.62:6800/3291934116,v1:172.21.15.62:6801/3291934116] conn(0x7f32a407fb10 msgr2=0x7f32a4081fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.909+0000 7f32c644d640 1 --2- 172.21.15.39:0/2961700032 >> [v2:172.21.15.62:6800/3291934116,v1:172.21.15.62:6801/3291934116] conn(0x7f32a407fb10 0x7f32a4081fa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.908+0000 7f30b60eb640 1 -- 172.21.15.39:0/2201398144 shutdown_connections 2024-05-14T14:40:31.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.908+0000 7f30b60eb640 1 -- 172.21.15.39:0/2201398144 wait complete. 2024-05-14T14:40:31.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.909+0000 7f32c644d640 1 -- 172.21.15.39:0/2961700032 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f32a40763d0 msgr2=0x7f32a40788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.909+0000 7f32c644d640 1 --2- 172.21.15.39:0/2961700032 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f32a40763d0 0x7f32a40788e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f32b0000f60 tx=0x7f32b0009040 comp rx=0 tx=0).stop 2024-05-14T14:40:31.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.909+0000 7f32c644d640 1 -- 172.21.15.39:0/2961700032 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32b80544b0 msgr2=0x7f32b80cc1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.909+0000 7f32c644d640 1 --2- 172.21.15.39:0/2961700032 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32b80544b0 0x7f32b80cc1a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f32c0051620 tx=0x7f32c006a820 comp rx=0 tx=0).stop 2024-05-14T14:40:31.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.909+0000 7f32c5c4c640 1 -- 172.21.15.39:0/2961700032 reap_dead start 2024-05-14T14:40:31.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.909+0000 7f32c644d640 1 -- 172.21.15.39:0/2961700032 shutdown_connections 2024-05-14T14:40:31.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.909+0000 7f32c644d640 1 -- 172.21.15.39:0/2961700032 >> 172.21.15.39:0/2961700032 conn(0x7f32b8054ce0 msgr2=0x7f32b80e1860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:31.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.909+0000 7f6c91866640 1 -- 172.21.15.39:0/2830972534 >> [v2:172.21.15.39:6800/4023478848,v1:172.21.15.39:6801/4023478848] conn(0x7f6c7007fb60 msgr2=0x7f6c70081ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.909+0000 7f6c91866640 1 --2- 172.21.15.39:0/2830972534 >> [v2:172.21.15.39:6800/4023478848,v1:172.21.15.39:6801/4023478848] conn(0x7f6c7007fb60 0x7f6c70081ff0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.910+0000 7f2ff1522640 1 -- 172.21.15.39:0/3593918850 --> [v2:172.21.15.39:6824/1469314579,v1:172.21.15.39:6825/1469314579] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2fe404b930 con 0x7f2fd0081d20 2024-05-14T14:40:31.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.910+0000 7f6c91866640 1 -- 172.21.15.39:0/2830972534 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f6c700763a0 msgr2=0x7f6c700788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.910+0000 7f6c91866640 1 --2- 172.21.15.39:0/2830972534 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f6c700763a0 0x7f6c700788b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6c80006f40 tx=0x7f6c80009240 comp rx=0 tx=0).stop 2024-05-14T14:40:31.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.910+0000 7f6c91866640 1 -- 172.21.15.39:0/2830972534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6c84052fb0 msgr2=0x7f6c840d6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.910+0000 7f6c91866640 1 --2- 172.21.15.39:0/2830972534 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6c84052fb0 0x7f6c840d6c60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c051ae0 tx=0x7f6c8c08df60 comp rx=0 tx=0).stop 2024-05-14T14:40:31.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.910+0000 7f32c644d640 1 -- 172.21.15.39:0/2961700032 shutdown_connections 2024-05-14T14:40:31.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.910+0000 7f32c644d640 1 -- 172.21.15.39:0/2961700032 wait complete. 2024-05-14T14:40:31.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.910+0000 7f6c91065640 1 -- 172.21.15.39:0/2830972534 reap_dead start 2024-05-14T14:40:31.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.910+0000 7f7853abd640 1 -- 172.21.15.39:0/936534358 --> [v2:172.21.15.62:6816/3005996101,v1:172.21.15.62:6817/3005996101] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7834002d50 con 0x7f783007fb20 2024-05-14T14:40:31.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.910+0000 7f2fe8ff9640 1 -- 172.21.15.39:0/3593918850 <== osd.3 v2:172.21.15.39:6824/1469314579 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2fe404b930 con 0x7f2fd0081d20 2024-05-14T14:40:31.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.911+0000 7f6c91866640 1 -- 172.21.15.39:0/2830972534 shutdown_connections 2024-05-14T14:40:31.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.911+0000 7f6c91866640 1 -- 172.21.15.39:0/2830972534 >> 172.21.15.39:0/2830972534 conn(0x7f6c84054cf0 msgr2=0x7f6c84044df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:31.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.911+0000 7f2ff1522640 1 -- 172.21.15.39:0/3593918850 >> [v2:172.21.15.39:6824/1469314579,v1:172.21.15.39:6825/1469314579] conn(0x7f2fd0081d20 msgr2=0x7f2fd00841b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.911+0000 7f2ff1522640 1 --2- 172.21.15.39:0/3593918850 >> [v2:172.21.15.39:6824/1469314579,v1:172.21.15.39:6825/1469314579] conn(0x7f2fd0081d20 0x7f2fd00841b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.911+0000 7f6c91866640 1 -- 172.21.15.39:0/2830972534 shutdown_connections 2024-05-14T14:40:31.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.911+0000 7f78427fc640 1 -- 172.21.15.39:0/936534358 <== osd.6 v2:172.21.15.62:6816/3005996101 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7834002d50 con 0x7f783007fb20 2024-05-14T14:40:31.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.911+0000 7f6c91866640 1 -- 172.21.15.39:0/2830972534 wait complete. 2024-05-14T14:40:31.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.911+0000 7f2ff1522640 1 -- 172.21.15.39:0/3593918850 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f2fd00763d0 msgr2=0x7f2fd00788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.911+0000 7f2ff1522640 1 --2- 172.21.15.39:0/3593918850 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f2fd00763d0 0x7f2fd00788e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2fec069fa0 tx=0x7f2fec070040 comp rx=0 tx=0).stop 2024-05-14T14:40:31.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.912+0000 7f2ff1522640 1 -- 172.21.15.39:0/3593918850 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2fe40dfd70 msgr2=0x7f2fe40d0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.912+0000 7f2ff1522640 1 --2- 172.21.15.39:0/3593918850 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2fe40dfd70 0x7f2fe40d0f80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0032000 tx=0x7f2fe00046c0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.912+0000 7f2ff0d21640 1 -- 172.21.15.39:0/3593918850 reap_dead start 2024-05-14T14:40:31.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.912+0000 7f2ff1522640 1 -- 172.21.15.39:0/3593918850 shutdown_connections 2024-05-14T14:40:31.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.912+0000 7f2ff1522640 1 -- 172.21.15.39:0/3593918850 >> 172.21.15.39:0/3593918850 conn(0x7f2fe4054ce0 msgr2=0x7f2fe4005c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:31.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.912+0000 7f7853abd640 1 -- 172.21.15.39:0/936534358 >> [v2:172.21.15.62:6816/3005996101,v1:172.21.15.62:6817/3005996101] conn(0x7f783007fb20 msgr2=0x7f7830081fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.912+0000 7f7853abd640 1 --2- 172.21.15.39:0/936534358 >> [v2:172.21.15.62:6816/3005996101,v1:172.21.15.62:6817/3005996101] conn(0x7f783007fb20 0x7f7830081fb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.912+0000 7f2ff1522640 1 -- 172.21.15.39:0/3593918850 shutdown_connections 2024-05-14T14:40:31.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.912+0000 7f2ff1522640 1 -- 172.21.15.39:0/3593918850 wait complete. 2024-05-14T14:40:31.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.913+0000 7f7853abd640 1 -- 172.21.15.39:0/936534358 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f7830076350 msgr2=0x7f7830078860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.913+0000 7f7853abd640 1 --2- 172.21.15.39:0/936534358 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f7830076350 0x7f7830078860 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7844033000 tx=0x7f7844009000 comp rx=0 tx=0).stop 2024-05-14T14:40:31.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.913+0000 7f7853abd640 1 -- 172.21.15.39:0/936534358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f784c06c6a0 msgr2=0x7f784c161c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:31.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.913+0000 7f7853abd640 1 --2- 172.21.15.39:0/936534358 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f784c06c6a0 0x7f784c161c10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f784800c430 tx=0x7f784800c8f0 comp rx=0 tx=0).stop 2024-05-14T14:40:31.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.913+0000 7f785205a640 1 -- 172.21.15.39:0/936534358 reap_dead start 2024-05-14T14:40:31.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.913+0000 7f7853abd640 1 -- 172.21.15.39:0/936534358 shutdown_connections 2024-05-14T14:40:31.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.913+0000 7f7853abd640 1 -- 172.21.15.39:0/936534358 >> 172.21.15.39:0/936534358 conn(0x7f784c0d1f20 msgr2=0x7f784c0ce320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:31.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.913+0000 7f7853abd640 1 -- 172.21.15.39:0/936534358 shutdown_connections 2024-05-14T14:40:31.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:31.913+0000 7f7853abd640 1 -- 172.21.15.39:0/936534358 wait complete. 2024-05-14T14:40:31.965 INFO:teuthology.orchestra.run.smithi039.stdout:55834574857 2024-05-14T14:40:31.965 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-14T14:40:31.967 INFO:teuthology.orchestra.run.smithi039.stdout:55834574857 2024-05-14T14:40:31.967 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-14T14:40:31.968 INFO:teuthology.orchestra.run.smithi039.stdout:55834574857 2024-05-14T14:40:31.969 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-14T14:40:31.970 INFO:teuthology.orchestra.run.smithi039.stdout:55834574858 2024-05-14T14:40:31.970 INFO:teuthology.orchestra.run.smithi039.stdout:55834574858 2024-05-14T14:40:31.971 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-14T14:40:31.972 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-14T14:40:31.973 INFO:teuthology.orchestra.run.smithi039.stdout:55834574858 2024-05-14T14:40:31.974 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-14T14:40:31.975 INFO:teuthology.orchestra.run.smithi039.stdout:55834574856 2024-05-14T14:40:31.975 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-14T14:40:31.977 INFO:teuthology.orchestra.run.smithi039.stdout:55834574857 2024-05-14T14:40:31.977 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-14T14:40:32.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.253+0000 7f1b4930a640 1 Processor -- start 2024-05-14T14:40:32.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.254+0000 7f1b4930a640 1 -- start start 2024-05-14T14:40:32.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.256+0000 7f5e1e3e5640 1 Processor -- start 2024-05-14T14:40:32.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.256+0000 7f1b4930a640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1b440d09c0 0x7f1b4415fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.256+0000 7f1b4930a640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b4406c740 con 0x7f1b44160210 2024-05-14T14:40:32.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.256+0000 7f1b4930a640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b44160b90 con 0x7f1b440b46b0 2024-05-14T14:40:32.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.256+0000 7f1b4930a640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f1b44160620 con 0x7f1b440d09c0 2024-05-14T14:40:32.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.256+0000 7f5e1e3e5640 1 -- start start 2024-05-14T14:40:32.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.257+0000 7f1b48b09640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f1b44160210 0x7f1b4415c690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:56326/0 (socket says 172.21.15.39:56326) 2024-05-14T14:40:32.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.257+0000 7f1b48b09640 1 -- 172.21.15.39:0/3412464450 learned_addr learned my addr 172.21.15.39:0/3412464450 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:32.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.257+0000 7f1f39772640 1 Processor -- start 2024-05-14T14:40:32.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.257+0000 7f1f39772640 1 -- start start 2024-05-14T14:40:32.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.257+0000 7f1b437fe640 1 --2- 172.21.15.39:0/3412464450 >> v2:172.21.15.39:3300/0 conn(0x7f1b440d09c0 0x7f1b4415fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.258+0000 7f856b92d640 1 Processor -- start 2024-05-14T14:40:32.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.258+0000 7f1b437fe640 1 -- 172.21.15.39:0/3412464450 >> v1:172.21.15.62:6789/0 conn(0x7f1b440b46b0 legacy=0x7f1b440d02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.258+0000 7f1b437fe640 1 -- 172.21.15.39:0/3412464450 >> v1:172.21.15.39:6789/0 conn(0x7f1b44160210 legacy=0x7f1b4415c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.258+0000 7f1b437fe640 1 -- 172.21.15.39:0/3412464450 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b440d0e70 con 0x7f1b440d09c0 2024-05-14T14:40:32.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.258+0000 7f856b92d640 1 -- start start 2024-05-14T14:40:32.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.259+0000 7f1f39772640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1f340c5a00 0x7f1f340c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.259+0000 7f1f39772640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1f340d1850 0x7f1f340d1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.259+0000 7f1f32ffd640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f1f34164b10 0x7f1f340cf2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:56338/0 (socket says 172.21.15.39:56338) 2024-05-14T14:40:32.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.259+0000 7f5e1e3e5640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5e1815c720 0x7f5e180b7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.259+0000 7f1f32ffd640 1 -- 172.21.15.39:0/3135813010 learned_addr learned my addr 172.21.15.39:0/3135813010 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:32.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.259+0000 7f1f327fc640 1 --2- 172.21.15.39:0/3135813010 >> v2:172.21.15.62:3300/0 conn(0x7f1f340c5a00 0x7f1f340c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.259+0000 7f1f337fe640 1 --2- 172.21.15.39:0/3135813010 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1f340d1850 0x7f1f340d1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.259+0000 7f5e1e3e5640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5e1806d940 0x7f5e180b44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.259+0000 7f5e1e3e5640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5e1806c6a0 0x7f5e180b16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.259+0000 7f5e1e3e5640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f5e180b7ba0 con 0x7f5e1806d940 2024-05-14T14:40:32.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.259+0000 7f5e1e3e5640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f5e1806df00 con 0x7f5e1806c6a0 2024-05-14T14:40:32.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.259+0000 7f1f39772640 1 -- 172.21.15.39:0/3135813010 --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f340c6350 con 0x7f1f34164b10 2024-05-14T14:40:32.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.259+0000 7f1f39772640 1 -- 172.21.15.39:0/3135813010 --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f1f340d13c0 con 0x7f1f340c5a00 2024-05-14T14:40:32.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.259+0000 7f1f39772640 1 -- 172.21.15.39:0/3135813010 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f1f340cf9c0 con 0x7f1f340d1850 2024-05-14T14:40:32.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.259+0000 7f5e1e3e5640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f5e180b39c0 con 0x7f5e1815c720 2024-05-14T14:40:32.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.260+0000 7f1f327fc640 1 -- 172.21.15.39:0/3135813010 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1f340d1850 msgr2=0x7f1f340d1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:32.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.260+0000 7f1f327fc640 1 --2- 172.21.15.39:0/3135813010 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1f340d1850 0x7f1f340d1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.260+0000 7f1f327fc640 1 -- 172.21.15.39:0/3135813010 >> v1:172.21.15.39:6789/0 conn(0x7f1f34164b10 legacy=0x7f1f340cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.260+0000 7f1f327fc640 1 -- 172.21.15.39:0/3135813010 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f340cfc20 con 0x7f1f340c5a00 2024-05-14T14:40:32.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.259+0000 7f5e1d3e3640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5e1815c720 0x7f5e180b7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.260+0000 7f5e1dbe4640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5e1806c6a0 0x7f5e180b16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.260+0000 7f5e1d3e3640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5e1815c720 0x7f5e180b7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.39:41796/0 (socket says 172.21.15.39:41796) 2024-05-14T14:40:32.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.260+0000 7f5e1d3e3640 1 -- 172.21.15.39:0/3649520272 learned_addr learned my addr 172.21.15.39:0/3649520272 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:32.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.260+0000 7f5e1dbe4640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5e1806c6a0 0x7f5e180b16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.39:56868/0 (socket says 172.21.15.39:56868) 2024-05-14T14:40:32.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.260+0000 7f5e1cbe2640 1 --2- 172.21.15.39:0/3649520272 >> v2:172.21.15.39:3300/0 conn(0x7f5e1806d940 0x7f5e180b44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.260+0000 7f5e1dbe4640 1 -- 172.21.15.39:0/3649520272 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5e1815c720 msgr2=0x7f5e180b7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:32.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.260+0000 7f5e1dbe4640 1 --2- 172.21.15.39:0/3649520272 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5e1815c720 0x7f5e180b7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.260+0000 7f5e1dbe4640 1 -- 172.21.15.39:0/3649520272 >> v2:172.21.15.39:3300/0 conn(0x7f5e1806d940 msgr2=0x7f5e180b44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:32.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.260+0000 7f5e1dbe4640 1 --2- 172.21.15.39:0/3649520272 >> v2:172.21.15.39:3300/0 conn(0x7f5e1806d940 0x7f5e180b44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.249 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.260+0000 7f5e1dbe4640 1 -- 172.21.15.39:0/3649520272 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e180b3ca0 con 0x7f5e1806c6a0 2024-05-14T14:40:32.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.261+0000 7f856b92d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f855c052fa0 0x7f855c04f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.261+0000 7f856b92d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f855c034170 0x7f855c038330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.261+0000 7f5404d32640 1 Processor -- start 2024-05-14T14:40:32.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.261+0000 7f978f82b640 1 Processor -- start 2024-05-14T14:40:32.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.261+0000 7f856b92d640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f855c0e8220 con 0x7f855c007310 2024-05-14T14:40:32.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.261+0000 7f856b92d640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f855c0533b0 con 0x7f855c052fa0 2024-05-14T14:40:32.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.261+0000 7f856b92d640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f855c006270 con 0x7f855c034170 2024-05-14T14:40:32.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.261+0000 7f5404d32640 1 -- start start 2024-05-14T14:40:32.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.261+0000 7f8569eca640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f855c034170 0x7f855c038330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.261+0000 7f85696c9640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f855c052fa0 0x7f855c04f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.261+0000 7f1f327fc640 1 --2- 172.21.15.39:0/3135813010 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f340c5a00 0x7f1f340c5e10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1f280097d0 tx=0x7f1f2802a1b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0b5b57070617469 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:32.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.261+0000 7f85696c9640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f855c052fa0 0x7f855c04f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48224/0 (socket says 172.21.15.39:48224) 2024-05-14T14:40:32.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.261+0000 7f85696c9640 1 -- 172.21.15.39:0/1478071558 learned_addr learned my addr 172.21.15.39:0/1478071558 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:32.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.261+0000 7f1f31ffb640 1 -- 172.21.15.39:0/3135813010 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f28037070 con 0x7f1f340c5a00 2024-05-14T14:40:32.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.261+0000 7f5e1dbe4640 1 --2- 172.21.15.39:0/3649520272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e1806c6a0 0x7f5e180b16f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5e180cfa10 tx=0x7f5e1002a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b800cf801a6d44ee server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:32.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.261+0000 7f1f31ffb640 1 -- 172.21.15.39:0/3135813010 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f28032440 con 0x7f1f340c5a00 2024-05-14T14:40:32.254 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.261+0000 7f1f31ffb640 1 -- 172.21.15.39:0/3135813010 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f28032810 con 0x7f1f340c5a00 2024-05-14T14:40:32.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.262+0000 7f1b437fe640 1 --2- 172.21.15.39:0/3412464450 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b440d09c0 0x7f1b4415fcd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c00c150 tx=0x7f1b3c02c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc906eabaa910cb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:32.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.262+0000 7f1b42ffd640 1 -- 172.21.15.39:0/3412464450 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c039070 con 0x7f1b440d09c0 2024-05-14T14:40:32.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.262+0000 7f1b42ffd640 1 -- 172.21.15.39:0/3412464450 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b3c034470 con 0x7f1b440d09c0 2024-05-14T14:40:32.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.262+0000 7f8569eca640 1 -- 172.21.15.39:0/1478071558 >> v2:172.21.15.39:3300/0 conn(0x7f855c052fa0 msgr2=0x7f855c04f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:32.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.262+0000 7f8569eca640 1 --2- 172.21.15.39:0/1478071558 >> v2:172.21.15.39:3300/0 conn(0x7f855c052fa0 0x7f855c04f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.262+0000 7f8569eca640 1 -- 172.21.15.39:0/1478071558 >> v1:172.21.15.39:6789/0 conn(0x7f855c007310 legacy=0x7f855c033a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.262+0000 7f8569eca640 1 -- 172.21.15.39:0/1478071558 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f855c006550 con 0x7f855c034170 2024-05-14T14:40:32.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.263+0000 7efc3ffff640 1 Processor -- start 2024-05-14T14:40:32.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.263+0000 7f5e0ffff640 1 -- 172.21.15.39:0/3649520272 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e10031600 con 0x7f5e1806c6a0 2024-05-14T14:40:32.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.263+0000 7f5e0ffff640 1 -- 172.21.15.39:0/3649520272 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e100317a0 con 0x7f5e1806c6a0 2024-05-14T14:40:32.256 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.263+0000 7f5e0ffff640 1 -- 172.21.15.39:0/3649520272 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e10031b70 con 0x7f5e1806c6a0 2024-05-14T14:40:32.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.263+0000 7f8569eca640 1 --2- 172.21.15.39:0/1478071558 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f855c034170 0x7f855c038330 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8564000b60 tx=0x7f85640752c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84899b093a1ebf18 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:32.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.263+0000 7f855bfff640 1 -- 172.21.15.39:0/1478071558 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85640b4070 con 0x7f855c034170 2024-05-14T14:40:32.257 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.263+0000 7efc3ffff640 1 -- start start 2024-05-14T14:40:32.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.263+0000 7f855bfff640 1 -- 172.21.15.39:0/1478071558 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85640a7d10 con 0x7f855c034170 2024-05-14T14:40:32.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.263+0000 7f855bfff640 1 -- 172.21.15.39:0/1478071558 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85640af660 con 0x7f855c034170 2024-05-14T14:40:32.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.263+0000 7f1f39772640 1 -- 172.21.15.39:0/3135813010 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f340c5a00 msgr2=0x7f1f340c5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.258 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.263+0000 7f1f39772640 1 --2- 172.21.15.39:0/3135813010 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f340c5a00 0x7f1f340c5e10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1f280097d0 tx=0x7f1f2802a1b0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.264+0000 7f1b4930a640 1 -- 172.21.15.39:0/3412464450 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b440d09c0 msgr2=0x7f1b4415fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.264+0000 7f1b4930a640 1 --2- 172.21.15.39:0/3412464450 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b440d09c0 0x7f1b4415fcd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c00c150 tx=0x7f1b3c02c940 comp rx=0 tx=0).stop 2024-05-14T14:40:32.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.261+0000 7f978f82b640 1 -- start start 2024-05-14T14:40:32.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.264+0000 7f978f82b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f97880b0b60 0x7f9788164980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.263+0000 7f5404d32640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f540006ddc0 0x7f5400164480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.263+0000 7f5404d32640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f540009f840 0x7f54000b4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.263+0000 7f5404d32640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54000b6aa0 con 0x7f5400168c60 2024-05-14T14:40:32.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.263+0000 7f5404d32640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f54001687d0 con 0x7f540009f840 2024-05-14T14:40:32.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.264+0000 7f5404d32640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f5400168180 con 0x7f540006ddc0 2024-05-14T14:40:32.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.264+0000 7f1f39772640 1 -- 172.21.15.39:0/3135813010 shutdown_connections 2024-05-14T14:40:32.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.264+0000 7f1f39772640 1 --2- 172.21.15.39:0/3135813010 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1f340d1850 0x7f1f340d1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.264+0000 7f1f39772640 1 --2- 172.21.15.39:0/3135813010 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f340c5a00 0x7f1f340c5e10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.264+0000 7f1f39772640 1 -- 172.21.15.39:0/3135813010 >> 172.21.15.39:0/3135813010 conn(0x7f1f340b7740 msgr2=0x7f1f340b7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:32.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.264+0000 7f978f82b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f97880ae930 0x7f97880d06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.264+0000 7f978f82b640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f978806f2a0 0x7f978806f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.264+0000 7f978f82b640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f97880b13b0 con 0x7f978806f2a0 2024-05-14T14:40:32.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.264+0000 7f978f82b640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f978806fbf0 con 0x7f97880b0b60 2024-05-14T14:40:32.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.264+0000 7f978f82b640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f97880b10d0 con 0x7f97880ae930 2024-05-14T14:40:32.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.264+0000 7f978d5c7640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f97880b0b60 0x7f9788164980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.264+0000 7f5e1e3e5640 1 -- 172.21.15.39:0/3649520272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e1806c6a0 msgr2=0x7f5e180b16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.261 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.264+0000 7f5e1e3e5640 1 --2- 172.21.15.39:0/3649520272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e1806c6a0 0x7f5e180b16f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5e180cfa10 tx=0x7f5e1002a5d0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.264+0000 7f1b4930a640 1 -- 172.21.15.39:0/3412464450 shutdown_connections 2024-05-14T14:40:32.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.264+0000 7f1b4930a640 1 --2- 172.21.15.39:0/3412464450 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b440d09c0 0x7f1b4415fcd0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.264+0000 7f1b4930a640 1 -- 172.21.15.39:0/3412464450 >> 172.21.15.39:0/3412464450 conn(0x7f1b440d20a0 msgr2=0x7f1b440ce100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:32.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.264+0000 7f53feffd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f540006ddc0 0x7f5400164480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.264+0000 7f53fffff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f540009f840 0x7f54000b4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.262 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.264+0000 7f978d5c7640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f97880b0b60 0x7f9788164980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.39:56890/0 (socket says 172.21.15.39:56890) 2024-05-14T14:40:32.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.264+0000 7f978d5c7640 1 -- 172.21.15.39:0/843526443 learned_addr learned my addr 172.21.15.39:0/843526443 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:32.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.264+0000 7f5e1e3e5640 1 -- 172.21.15.39:0/3649520272 shutdown_connections 2024-05-14T14:40:32.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.264+0000 7f5e1e3e5640 1 --2- 172.21.15.39:0/3649520272 >> v2:172.21.15.39:3300/0 conn(0x7f5e1806d940 0x7f5e180b44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.264+0000 7f5e1e3e5640 1 --2- 172.21.15.39:0/3649520272 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e1806c6a0 0x7f5e180b16f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.264+0000 7f5e1e3e5640 1 --2- 172.21.15.39:0/3649520272 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5e1815c720 0x7f5e180b7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.264+0000 7f5e1e3e5640 1 -- 172.21.15.39:0/3649520272 >> 172.21.15.39:0/3649520272 conn(0x7f5e1809b5f0 msgr2=0x7f5e180b6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:32.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.264+0000 7f856b92d640 1 -- 172.21.15.39:0/1478071558 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f855c034170 msgr2=0x7f855c038330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.264+0000 7f856b92d640 1 --2- 172.21.15.39:0/1478071558 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f855c034170 0x7f855c038330 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8564000b60 tx=0x7f85640752c0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.264+0000 7f978cdc6640 1 --2- 172.21.15.39:0/843526443 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f97880ae930 0x7f97880d06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.264+0000 7f53fffff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f540009f840 0x7f54000b4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48238/0 (socket says 172.21.15.39:48238) 2024-05-14T14:40:32.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.264+0000 7f53fffff640 1 -- 172.21.15.39:0/3030329980 learned_addr learned my addr 172.21.15.39:0/3030329980 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:32.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.264+0000 7f5e1e3e5640 1 -- 172.21.15.39:0/3649520272 shutdown_connections 2024-05-14T14:40:32.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.264+0000 7f856b92d640 1 -- 172.21.15.39:0/1478071558 shutdown_connections 2024-05-14T14:40:32.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.265+0000 7f856b92d640 1 --2- 172.21.15.39:0/1478071558 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f855c034170 0x7f855c038330 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.265+0000 7f856b92d640 1 --2- 172.21.15.39:0/1478071558 >> v2:172.21.15.39:3300/0 conn(0x7f855c052fa0 0x7f855c04f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.265+0000 7f856b92d640 1 -- 172.21.15.39:0/1478071558 >> 172.21.15.39:0/1478071558 conn(0x7f855c054ce0 msgr2=0x7f855c0550f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:32.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.265+0000 7f1f39772640 1 -- 172.21.15.39:0/3135813010 shutdown_connections 2024-05-14T14:40:32.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.265+0000 7f1b4930a640 1 -- 172.21.15.39:0/3412464450 shutdown_connections 2024-05-14T14:40:32.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.264+0000 7f978ddc8640 1 --2- 172.21.15.39:0/843526443 >> v2:172.21.15.39:3300/0 conn(0x7f978806f2a0 0x7f978806f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.265+0000 7f978d5c7640 1 -- 172.21.15.39:0/843526443 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f97880ae930 msgr2=0x7f97880d06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:32.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.265+0000 7f978d5c7640 1 --2- 172.21.15.39:0/843526443 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f97880ae930 0x7f97880d06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.265+0000 7f978d5c7640 1 -- 172.21.15.39:0/843526443 >> v2:172.21.15.39:3300/0 conn(0x7f978806f2a0 msgr2=0x7f978806f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:32.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.265+0000 7f978d5c7640 1 --2- 172.21.15.39:0/843526443 >> v2:172.21.15.39:3300/0 conn(0x7f978806f2a0 0x7f978806f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.265+0000 7f978d5c7640 1 -- 172.21.15.39:0/843526443 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f978806c840 con 0x7f97880b0b60 2024-05-14T14:40:32.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.265+0000 7f856b92d640 1 -- 172.21.15.39:0/1478071558 shutdown_connections 2024-05-14T14:40:32.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.265+0000 7f856b92d640 1 -- 172.21.15.39:0/1478071558 wait complete. 2024-05-14T14:40:32.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.265+0000 7efc3ffff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc401688e0 0x7efc400d0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.265+0000 7f978ddc8640 1 --2- 172.21.15.39:0/843526443 >> v2:172.21.15.39:3300/0 conn(0x7f978806f2a0 0x7f978806f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:40:32.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.265+0000 7f53fffff640 1 -- 172.21.15.39:0/3030329980 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f540006ddc0 msgr2=0x7f5400164480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:32.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.265+0000 7f53fffff640 1 --2- 172.21.15.39:0/3030329980 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f540006ddc0 0x7f5400164480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.265+0000 7f53fffff640 1 -- 172.21.15.39:0/3030329980 >> v1:172.21.15.62:6789/0 conn(0x7f5400168c60 legacy=0x7f540006d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.268 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.265+0000 7f53fffff640 1 -- 172.21.15.39:0/3030329980 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5400168460 con 0x7f540009f840 2024-05-14T14:40:32.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.265+0000 7efc3effd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc401688e0 0x7efc400d0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.265+0000 7efc3effd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc401688e0 0x7efc400d0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.39:41820/0 (socket says 172.21.15.39:41820) 2024-05-14T14:40:32.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.265+0000 7efc3effd640 1 -- 172.21.15.39:0/1381070759 learned_addr learned my addr 172.21.15.39:0/1381070759 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:32.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.265+0000 7f1b4930a640 1 -- 172.21.15.39:0/3412464450 wait complete. 2024-05-14T14:40:32.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.265+0000 7efc3ffff640 1 --2- 172.21.15.39:0/1381070759 >> v2:172.21.15.62:3300/0 conn(0x7efc400cccd0 0x7efc400cd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.266+0000 7efc3ffff640 1 -- 172.21.15.39:0/1381070759 --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc400d0a50 con 0x7efc400d0640 2024-05-14T14:40:32.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.266+0000 7efc3ffff640 1 -- 172.21.15.39:0/1381070759 --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7efc40164a00 con 0x7efc400cccd0 2024-05-14T14:40:32.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.266+0000 7efc3ffff640 1 -- 172.21.15.39:0/1381070759 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7efc40164cc0 con 0x7efc401688e0 2024-05-14T14:40:32.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.266+0000 7f978d5c7640 1 --2- 172.21.15.39:0/843526443 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97880b0b60 0x7f9788164980 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9788072b40 tx=0x7f978002a6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c62216dcb790081 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:32.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.265+0000 7f5e1e3e5640 1 -- 172.21.15.39:0/3649520272 wait complete. 2024-05-14T14:40:32.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.266+0000 7efc3f7fe640 1 --2- 172.21.15.39:0/1381070759 >> v2:172.21.15.62:3300/0 conn(0x7efc400cccd0 0x7efc400cd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.266+0000 7f977ffff640 1 -- 172.21.15.39:0/843526443 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9780036070 con 0x7f97880b0b60 2024-05-14T14:40:32.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.266+0000 7f977ffff640 1 -- 172.21.15.39:0/843526443 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9780031600 con 0x7f97880b0b60 2024-05-14T14:40:32.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.266+0000 7f977ffff640 1 -- 172.21.15.39:0/843526443 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97800319d0 con 0x7f97880b0b60 2024-05-14T14:40:32.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.267+0000 7efc3dffb640 1 -- 172.21.15.39:0/1381070759 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2346896960 0 0) 0x7efc34001110 con 0x7efc400d0640 2024-05-14T14:40:32.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.267+0000 7efc3f7fe640 1 -- 172.21.15.39:0/1381070759 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc401688e0 msgr2=0x7efc400d0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:32.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.266+0000 7f53fffff640 1 --2- 172.21.15.39:0/3030329980 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f540009f840 0x7f54000b4a30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f53f0009ad0 tx=0x7f53f002a4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7a63b46c6659328 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:32.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.267+0000 7efc3f7fe640 1 --2- 172.21.15.39:0/1381070759 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc401688e0 0x7efc400d0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.267+0000 7f53fe7fc640 1 -- 172.21.15.39:0/3030329980 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f0036070 con 0x7f540009f840 2024-05-14T14:40:32.273 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.267+0000 7efc3f7fe640 1 -- 172.21.15.39:0/1381070759 >> v1:172.21.15.62:6789/0 conn(0x7efc400d0640 legacy=0x7efc4006ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.267+0000 7f53fe7fc640 1 -- 172.21.15.39:0/3030329980 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53f0031600 con 0x7f540009f840 2024-05-14T14:40:32.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.267+0000 7f53fe7fc640 1 -- 172.21.15.39:0/3030329980 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f00319d0 con 0x7f540009f840 2024-05-14T14:40:32.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.267+0000 7efc3f7fe640 1 -- 172.21.15.39:0/1381070759 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc40164fa0 con 0x7efc400cccd0 2024-05-14T14:40:32.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.265+0000 7fd0076d1640 1 Processor -- start 2024-05-14T14:40:32.274 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.266+0000 7fd0076d1640 1 -- start start 2024-05-14T14:40:32.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.268+0000 7f978f82b640 1 -- 172.21.15.39:0/843526443 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97880b0b60 msgr2=0x7f9788164980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.268+0000 7f978f82b640 1 --2- 172.21.15.39:0/843526443 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97880b0b60 0x7f9788164980 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9788072b40 tx=0x7f978002a6a0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.268+0000 7f1b4930a640 1 Processor -- start 2024-05-14T14:40:32.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.268+0000 7f856b92d640 1 Processor -- start 2024-05-14T14:40:32.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.268+0000 7f978f82b640 1 -- 172.21.15.39:0/843526443 shutdown_connections 2024-05-14T14:40:32.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.268+0000 7f978f82b640 1 --2- 172.21.15.39:0/843526443 >> v2:172.21.15.39:3300/0 conn(0x7f978806f2a0 0x7f978806f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.268+0000 7f978f82b640 1 --2- 172.21.15.39:0/843526443 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f97880ae930 0x7f97880d06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.268+0000 7f978f82b640 1 --2- 172.21.15.39:0/843526443 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97880b0b60 0x7f9788164980 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.265+0000 7f1f39772640 1 -- 172.21.15.39:0/3135813010 wait complete. 2024-05-14T14:40:32.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.268+0000 7f978f82b640 1 -- 172.21.15.39:0/843526443 >> 172.21.15.39:0/843526443 conn(0x7f97880ce330 msgr2=0x7f97880ce740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:32.276 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.268+0000 7f5e1e3e5640 1 Processor -- start 2024-05-14T14:40:32.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.268+0000 7f1f39772640 1 Processor -- start 2024-05-14T14:40:32.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.268+0000 7f856b92d640 1 -- start start 2024-05-14T14:40:32.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.268+0000 7f5e1e3e5640 1 -- start start 2024-05-14T14:40:32.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.268+0000 7f978f82b640 1 -- 172.21.15.39:0/843526443 shutdown_connections 2024-05-14T14:40:32.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.268+0000 7f978f82b640 1 -- 172.21.15.39:0/843526443 wait complete. 2024-05-14T14:40:32.278 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.269+0000 7fd00546d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd0000b23f0 0x7fd0001615f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.39:56982/0 (socket says 172.21.15.39:56982) 2024-05-14T14:40:32.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.269+0000 7fd00546d640 1 -- 172.21.15.39:0/2370679774 learned_addr learned my addr 172.21.15.39:0/2370679774 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:32.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.269+0000 7fd0076d1640 1 --2- 172.21.15.39:0/2370679774 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0000cff20 0x7fd00015c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.269+0000 7fd0076d1640 1 -- 172.21.15.39:0/2370679774 --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0000d2870 con 0x7fd0000d1f00 2024-05-14T14:40:32.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.269+0000 7fd0076d1640 1 -- 172.21.15.39:0/2370679774 --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0000d2310 con 0x7fd0000b23f0 2024-05-14T14:40:32.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.269+0000 7fd0076d1640 1 -- 172.21.15.39:0/2370679774 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fd0000d38d0 con 0x7fd0000cff20 2024-05-14T14:40:32.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.269+0000 7f5404d32640 1 -- 172.21.15.39:0/3030329980 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f540009f840 msgr2=0x7f54000b4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.269+0000 7f5404d32640 1 --2- 172.21.15.39:0/3030329980 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f540009f840 0x7f54000b4a30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f53f0009ad0 tx=0x7f53f002a4b0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.269+0000 7fd005c6e640 1 --2- 172.21.15.39:0/2370679774 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0000cff20 0x7fd00015c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.269+0000 7fcff7fff640 1 -- 172.21.15.39:0/2370679774 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1766634008 0 0) 0x7fd0000d2870 con 0x7fd0000d1f00 2024-05-14T14:40:32.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.269+0000 7fcff7fff640 1 -- 172.21.15.39:0/2370679774 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfec003520 con 0x7fd0000d1f00 2024-05-14T14:40:32.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.269+0000 7fcff7fff640 1 -- 172.21.15.39:0/2370679774 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3851308007 0 0) 0x7fd0000d2310 con 0x7fd0000b23f0 2024-05-14T14:40:32.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.269+0000 7fcff7fff640 1 -- 172.21.15.39:0/2370679774 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0000d2870 con 0x7fd0000b23f0 2024-05-14T14:40:32.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.270+0000 7fd005c6e640 1 -- 172.21.15.39:0/2370679774 >> v1:172.21.15.62:6789/0 conn(0x7fd0000b23f0 legacy=0x7fd0001615f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.270+0000 7fd005c6e640 1 -- 172.21.15.39:0/2370679774 >> v1:172.21.15.39:6789/0 conn(0x7fd0000d1f00 legacy=0x7fd0000cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.270+0000 7fd005c6e640 1 -- 172.21.15.39:0/2370679774 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0000d2b10 con 0x7fd0000cff20 2024-05-14T14:40:32.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.269+0000 7f1b4930a640 1 -- start start 2024-05-14T14:40:32.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.268+0000 7f1f39772640 1 -- start start 2024-05-14T14:40:32.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.270+0000 7f856b92d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f855c007310 0x7f855c0d8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.270+0000 7f856b92d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f855c052fa0 0x7f855c0e3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.270+0000 7f5404d32640 1 -- 172.21.15.39:0/3030329980 shutdown_connections 2024-05-14T14:40:32.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.270+0000 7f856b92d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f855c0dc8a0 0x7f855c0e37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.270+0000 7f856b92d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f855c006df0 con 0x7f855c052fa0 2024-05-14T14:40:32.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.270+0000 7f856b92d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f855c006b10 con 0x7f855c0dc8a0 2024-05-14T14:40:32.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.270+0000 7f856b92d640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f855c007720 con 0x7f855c007310 2024-05-14T14:40:32.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.270+0000 7f5e1e3e5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e1806c6a0 0x7f5e180c9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.270+0000 7f1f39772640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1f340c5a00 0x7f1f341fef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.270+0000 7f5e1e3e5640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5e1806d940 0x7f5e181f99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.270+0000 7f5404d32640 1 --2- 172.21.15.39:0/3030329980 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f540009f840 0x7f54000b4a30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.270+0000 7f5404d32640 1 --2- 172.21.15.39:0/3030329980 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f540006ddc0 0x7f5400164480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.270+0000 7f5404d32640 1 -- 172.21.15.39:0/3030329980 >> 172.21.15.39:0/3030329980 conn(0x7f5400073650 msgr2=0x7f5400073a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:32.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.270+0000 7f5e1e3e5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e1815c720 0x7f5e181f9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7f1f39772640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f340d1850 0x7f1f341fa7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.270+0000 7f85696c9640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f855c007310 0x7f855c0d8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7f85696c9640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f855c007310 0x7f855c0d8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.39:41838/0 (socket says 172.21.15.39:41838) 2024-05-14T14:40:32.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7f85696c9640 1 -- 172.21.15.39:0/1118124923 learned_addr learned my addr 172.21.15.39:0/1118124923 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:32.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7f8569eca640 1 --2- 172.21.15.39:0/1118124923 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f855c0dc8a0 0x7f855c0e37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7f8568ec8640 1 --2- 172.21.15.39:0/1118124923 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f855c052fa0 0x7f855c0e3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.270+0000 7f5e1e3e5640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5e180b3780 con 0x7f5e1815c720 2024-05-14T14:40:32.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.270+0000 7f5e1e3e5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5e180b3600 con 0x7f5e1806c6a0 2024-05-14T14:40:32.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.270+0000 7f5e1e3e5640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f5e1806cab0 con 0x7f5e1806d940 2024-05-14T14:40:32.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7f5e1cbe2640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5e1806d940 0x7f5e181f99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7f5e1cbe2640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5e1806d940 0x7f5e181f99a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.39:41840/0 (socket says 172.21.15.39:41840) 2024-05-14T14:40:32.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7f5e1cbe2640 1 -- 172.21.15.39:0/3634891055 learned_addr learned my addr 172.21.15.39:0/3634891055 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:32.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7f5e1d3e3640 1 --2- 172.21.15.39:0/3634891055 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e1806c6a0 0x7f5e180c9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7f5e1dbe4640 1 --2- 172.21.15.39:0/3634891055 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e1815c720 0x7f5e181f9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7f1f32ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1f340c5a00 0x7f1f341fef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7f1f32ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1f340c5a00 0x7f1f341fef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48250/0 (socket says 172.21.15.39:48250) 2024-05-14T14:40:32.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7f1f32ffd640 1 -- 172.21.15.39:0/3644629983 learned_addr learned my addr 172.21.15.39:0/3644629983 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:32.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7f1f327fc640 1 --2- 172.21.15.39:0/3644629983 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f340d1850 0x7f1f341fa7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7f1f39772640 1 --2- 172.21.15.39:0/3644629983 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1f34164b10 0x7f1f340cdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7f5404d32640 1 -- 172.21.15.39:0/3030329980 shutdown_connections 2024-05-14T14:40:32.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7f1b4930a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b440b46b0 0x7f1b441392b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7f1b4930a640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1b440d09c0 0x7f1b441f63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7f1b4930a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b44160210 0x7f1b44137f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7f1b4930a640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1b440717f0 con 0x7f1b440b46b0 2024-05-14T14:40:32.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7f1b4930a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4406cc90 con 0x7f1b44160210 2024-05-14T14:40:32.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7f85696c9640 1 -- 172.21.15.39:0/1118124923 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f855c0dc8a0 msgr2=0x7f855c0e37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7f85696c9640 1 --2- 172.21.15.39:0/1118124923 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f855c0dc8a0 0x7f855c0e37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7f85696c9640 1 -- 172.21.15.39:0/1118124923 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f855c052fa0 msgr2=0x7f855c0e3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7f1b4930a640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f1b440d1150 con 0x7f1b440d09c0 2024-05-14T14:40:32.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7f85696c9640 1 --2- 172.21.15.39:0/1118124923 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f855c052fa0 0x7f855c0e3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7f85696c9640 1 -- 172.21.15.39:0/1118124923 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f855c0e1780 con 0x7f855c007310 2024-05-14T14:40:32.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7f1b437fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1b440d09c0 0x7f1b441f63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7f5404d32640 1 -- 172.21.15.39:0/3030329980 wait complete. 2024-05-14T14:40:32.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7f1b437fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1b440d09c0 0x7f1b441f63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.39:41846/0 (socket says 172.21.15.39:41846) 2024-05-14T14:40:32.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7f1b437fe640 1 -- 172.21.15.39:0/330890699 learned_addr learned my addr 172.21.15.39:0/330890699 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:32.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7f5e1cbe2640 1 -- 172.21.15.39:0/3634891055 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e1806c6a0 msgr2=0x7f5e180c9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7f5e1cbe2640 1 --2- 172.21.15.39:0/3634891055 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e1806c6a0 0x7f5e180c9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7f5e1cbe2640 1 -- 172.21.15.39:0/3634891055 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e1815c720 msgr2=0x7f5e181f9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7f5e1cbe2640 1 --2- 172.21.15.39:0/3634891055 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e1815c720 0x7f5e181f9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7f5e1cbe2640 1 -- 172.21.15.39:0/3634891055 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e180cf510 con 0x7f5e1806d940 2024-05-14T14:40:32.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7fd005c6e640 1 --2- 172.21.15.39:0/2370679774 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0000cff20 0x7fd00015c680 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcff800bfd0 tx=0x7fcff802c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55c6b951fc47e649 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:32.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7fcff7fff640 1 -- 172.21.15.39:0/2370679774 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff8039070 con 0x7fd0000cff20 2024-05-14T14:40:32.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.270+0000 7efc3f7fe640 1 --2- 172.21.15.39:0/1381070759 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc400cccd0 0x7efc400cd0e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efc38009d90 tx=0x7efc3802a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6274baf0319d9be server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:32.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7fcff7fff640 1 -- 172.21.15.39:0/2370679774 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcff8009540 con 0x7fd0000cff20 2024-05-14T14:40:32.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7fcff7fff640 1 -- 172.21.15.39:0/2370679774 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff80098f0 con 0x7fd0000cff20 2024-05-14T14:40:32.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.272+0000 7efc3dffb640 1 -- 172.21.15.39:0/1381070759 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc38007740 con 0x7efc400cccd0 2024-05-14T14:40:32.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.272+0000 7efc3dffb640 1 -- 172.21.15.39:0/1381070759 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc380078e0 con 0x7efc400cccd0 2024-05-14T14:40:32.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.272+0000 7f5e1cbe2640 1 --2- 172.21.15.39:0/3634891055 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5e1806d940 0x7f5e181f99a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5e0800e8a0 tx=0x7f5e0800ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:32.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.272+0000 7f978f82b640 1 Processor -- start 2024-05-14T14:40:32.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.272+0000 7f85696c9640 1 --2- 172.21.15.39:0/1118124923 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f855c007310 0x7f855c0d8540 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f856000e870 tx=0x7f856000ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:32.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.272+0000 7efc3dffb640 1 -- 172.21.15.39:0/1381070759 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc38007cb0 con 0x7efc400cccd0 2024-05-14T14:40:32.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.272+0000 7f5e0dffb640 1 -- 172.21.15.39:0/3634891055 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e08017070 con 0x7f5e1806d940 2024-05-14T14:40:32.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.272+0000 7f978f82b640 1 -- start start 2024-05-14T14:40:32.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.272+0000 7f5e1e3e5640 1 -- 172.21.15.39:0/3634891055 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e180cadf0 con 0x7f5e1806d940 2024-05-14T14:40:32.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.272+0000 7f5e0dffb640 1 -- 172.21.15.39:0/3634891055 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e08009e40 con 0x7f5e1806d940 2024-05-14T14:40:32.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.272+0000 7f5e0dffb640 1 -- 172.21.15.39:0/3634891055 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e08017070 con 0x7f5e1806d940 2024-05-14T14:40:32.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.272+0000 7f5e1e3e5640 1 -- 172.21.15.39:0/3634891055 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e180ca830 con 0x7f5e1806d940 2024-05-14T14:40:32.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.273+0000 7fd0076d1640 1 -- 172.21.15.39:0/2370679774 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0000cff20 msgr2=0x7fd00015c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.273+0000 7fd0076d1640 1 --2- 172.21.15.39:0/2370679774 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0000cff20 0x7fd00015c680 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcff800bfd0 tx=0x7fcff802c860 comp rx=0 tx=0).stop 2024-05-14T14:40:32.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.273+0000 7efc3ffff640 1 -- 172.21.15.39:0/1381070759 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc400cccd0 msgr2=0x7efc400cd0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.273+0000 7fd0076d1640 1 -- 172.21.15.39:0/2370679774 shutdown_connections 2024-05-14T14:40:32.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.273+0000 7fd0076d1640 1 --2- 172.21.15.39:0/2370679774 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0000cff20 0x7fd00015c680 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.273+0000 7fd0076d1640 1 -- 172.21.15.39:0/2370679774 >> 172.21.15.39:0/2370679774 conn(0x7fd0000b7740 msgr2=0x7fd0000b7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:32.295 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.273+0000 7efc3ffff640 1 --2- 172.21.15.39:0/1381070759 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc400cccd0 0x7efc400cd0e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efc38009d90 tx=0x7efc3802a680 comp rx=0 tx=0).stop 2024-05-14T14:40:32.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.272+0000 7f8559ffb640 1 -- 172.21.15.39:0/1118124923 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8560017070 con 0x7f855c007310 2024-05-14T14:40:32.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.272+0000 7f8559ffb640 1 -- 172.21.15.39:0/1118124923 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f856000c8e0 con 0x7f855c007310 2024-05-14T14:40:32.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.272+0000 7f8559ffb640 1 -- 172.21.15.39:0/1118124923 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f856000ccd0 con 0x7f855c007310 2024-05-14T14:40:32.296 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.273+0000 7f856b92d640 1 -- 172.21.15.39:0/1118124923 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f855c0d8a80 con 0x7f855c007310 2024-05-14T14:40:32.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.272+0000 7f1b48b09640 1 --2- 172.21.15.39:0/330890699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b44160210 0x7f1b44137f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.272+0000 7f1b437fe640 1 -- 172.21.15.39:0/330890699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b44160210 msgr2=0x7f1b44137f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.274+0000 7fd0076d1640 1 -- 172.21.15.39:0/2370679774 shutdown_connections 2024-05-14T14:40:32.297 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.272+0000 7f1b437fe640 1 --2- 172.21.15.39:0/330890699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b44160210 0x7f1b44137f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.274+0000 7fd0076d1640 1 -- 172.21.15.39:0/2370679774 wait complete. 2024-05-14T14:40:32.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.274+0000 7f856b92d640 1 -- 172.21.15.39:0/1118124923 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f855c0e7450 con 0x7f855c007310 2024-05-14T14:40:32.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.272+0000 7f1b437fe640 1 -- 172.21.15.39:0/330890699 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b440b46b0 msgr2=0x7f1b441392b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.299 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.274+0000 7f5404d32640 1 Processor -- start 2024-05-14T14:40:32.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.272+0000 7f1b437fe640 1 --2- 172.21.15.39:0/330890699 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b440b46b0 0x7f1b441392b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.272+0000 7f1b437fe640 1 -- 172.21.15.39:0/330890699 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b44136e60 con 0x7f1b440d09c0 2024-05-14T14:40:32.300 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.273+0000 7f1b437fe640 1 --2- 172.21.15.39:0/330890699 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1b440d09c0 0x7f1b441f63e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c02ce60 tx=0x7f1b3c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:32.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.273+0000 7f1b40ff9640 1 -- 172.21.15.39:0/330890699 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c039040 con 0x7f1b440d09c0 2024-05-14T14:40:32.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.273+0000 7f1b40ff9640 1 -- 172.21.15.39:0/330890699 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b3c044070 con 0x7f1b440d09c0 2024-05-14T14:40:32.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.274+0000 7efc3ffff640 1 -- 172.21.15.39:0/1381070759 shutdown_connections 2024-05-14T14:40:32.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.274+0000 7f5e1e3e5640 1 -- 172.21.15.39:0/3634891055 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e18050870 con 0x7f5e1806d940 2024-05-14T14:40:32.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.274+0000 7efc3ffff640 1 --2- 172.21.15.39:0/1381070759 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc400cccd0 0x7efc400cd0e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.274+0000 7efc3ffff640 1 --2- 172.21.15.39:0/1381070759 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc401688e0 0x7efc400d0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.274+0000 7f978f82b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f978806f2a0 0x7f97881546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.274+0000 7efc3ffff640 1 -- 172.21.15.39:0/1381070759 >> 172.21.15.39:0/1381070759 conn(0x7efc400ce0f0 msgr2=0x7efc400ce500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:32.303 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.274+0000 7f5404d32640 1 -- start start 2024-05-14T14:40:32.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.274+0000 7f1b40ff9640 1 -- 172.21.15.39:0/330890699 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c009c40 con 0x7f1b440d09c0 2024-05-14T14:40:32.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.274+0000 7f1b4930a640 1 -- 172.21.15.39:0/330890699 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b44137140 con 0x7f1b440d09c0 2024-05-14T14:40:32.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.274+0000 7f1b4930a640 1 -- 172.21.15.39:0/330890699 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b44137700 con 0x7f1b440d09c0 2024-05-14T14:40:32.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.275+0000 7f978f82b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97880ae930 0x7f9788154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.275+0000 7f978d5c7640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f978806f2a0 0x7f97881546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.304 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.275+0000 7f978d5c7640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f978806f2a0 0x7f97881546a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.39:41850/0 (socket says 172.21.15.39:41850) 2024-05-14T14:40:32.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.275+0000 7efc3ffff640 1 -- 172.21.15.39:0/1381070759 shutdown_connections 2024-05-14T14:40:32.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.275+0000 7f978cdc6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97880ae930 0x7f9788154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.275+0000 7f978cdc6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97880ae930 0x7f9788154be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48268/0 (socket says 172.21.15.39:48268) 2024-05-14T14:40:32.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.275+0000 7f978d5c7640 1 -- 172.21.15.39:0/1976063231 learned_addr learned my addr 172.21.15.39:0/1976063231 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:32.305 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.276+0000 7f978f82b640 1 --2- 172.21.15.39:0/1976063231 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97880b0b60 0x7f97881fe330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.276+0000 7f856b92d640 1 -- 172.21.15.39:0/1118124923 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f855c005490 con 0x7f855c007310 2024-05-14T14:40:32.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.276+0000 7efc3ffff640 1 -- 172.21.15.39:0/1381070759 wait complete. 2024-05-14T14:40:32.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.276+0000 7f978f82b640 1 -- 172.21.15.39:0/1976063231 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f97880aed40 con 0x7f97880ae930 2024-05-14T14:40:32.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.276+0000 7f978f82b640 1 -- 172.21.15.39:0/1976063231 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f978806ce00 con 0x7f97880b0b60 2024-05-14T14:40:32.306 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.276+0000 7f978f82b640 1 -- 172.21.15.39:0/1976063231 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f97880d0be0 con 0x7f978806f2a0 2024-05-14T14:40:32.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.276+0000 7f5e0dffb640 1 -- 172.21.15.39:0/3634891055 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5e0801a070 con 0x7f5e1806d940 2024-05-14T14:40:32.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7f1f39772640 1 -- 172.21.15.39:0/3644629983 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1f340d0fe0 con 0x7f1f340c5a00 2024-05-14T14:40:32.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7f1f39772640 1 -- 172.21.15.39:0/3644629983 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1f340d01e0 con 0x7f1f340d1850 2024-05-14T14:40:32.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.271+0000 7f1f39772640 1 -- 172.21.15.39:0/3644629983 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f1f340b2000 con 0x7f1f34164b10 2024-05-14T14:40:32.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.272+0000 7f1f337fe640 1 --2- 172.21.15.39:0/3644629983 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1f34164b10 0x7f1f340cdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.272+0000 7f1f32ffd640 1 -- 172.21.15.39:0/3644629983 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1f34164b10 msgr2=0x7f1f340cdfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.272+0000 7f1f32ffd640 1 --2- 172.21.15.39:0/3644629983 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1f34164b10 0x7f1f340cdfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.272+0000 7f1f32ffd640 1 -- 172.21.15.39:0/3644629983 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f340d1850 msgr2=0x7f1f341fa7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.272+0000 7f1f32ffd640 1 --2- 172.21.15.39:0/3644629983 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f340d1850 0x7f1f341fa7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.307 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.272+0000 7f1f32ffd640 1 -- 172.21.15.39:0/3644629983 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f340b1a90 con 0x7f1f340c5a00 2024-05-14T14:40:32.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.272+0000 7f1f32ffd640 1 --2- 172.21.15.39:0/3644629983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1f340c5a00 0x7f1f341fef40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1f24007fd0 tx=0x7f1f2400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:32.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.274+0000 7f1f1b7fe640 1 -- 172.21.15.39:0/3644629983 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f24017070 con 0x7f1f340c5a00 2024-05-14T14:40:32.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.274+0000 7f1f1b7fe640 1 -- 172.21.15.39:0/3644629983 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f24005ce0 con 0x7f1f340c5a00 2024-05-14T14:40:32.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.274+0000 7f1f1b7fe640 1 -- 172.21.15.39:0/3644629983 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f240072d0 con 0x7f1f340c5a00 2024-05-14T14:40:32.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.275+0000 7f1f39772640 1 -- 172.21.15.39:0/3644629983 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f340b1d70 con 0x7f1f340c5a00 2024-05-14T14:40:32.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.275+0000 7f1f39772640 1 -- 172.21.15.39:0/3644629983 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f3406efb0 con 0x7f1f340c5a00 2024-05-14T14:40:32.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.276+0000 7f978ddc8640 1 --2- 172.21.15.39:0/1976063231 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97880b0b60 0x7f97881fe330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.308 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.277+0000 7f8559ffb640 1 -- 172.21.15.39:0/1118124923 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f856001a070 con 0x7f855c007310 2024-05-14T14:40:32.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.277+0000 7f978cdc6640 1 -- 172.21.15.39:0/1976063231 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f978806f2a0 msgr2=0x7f97881546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.277+0000 7f978cdc6640 1 --2- 172.21.15.39:0/1976063231 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f978806f2a0 0x7f97881546a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.277+0000 7f978cdc6640 1 -- 172.21.15.39:0/1976063231 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97880b0b60 msgr2=0x7f97881fe330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.277+0000 7f978cdc6640 1 --2- 172.21.15.39:0/1976063231 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97880b0b60 0x7f97881fe330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.277+0000 7f978cdc6640 1 -- 172.21.15.39:0/1976063231 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f978809d0d0 con 0x7f97880ae930 2024-05-14T14:40:32.309 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.277+0000 7f5e0dffb640 1 --2- 172.21.15.39:0/3634891055 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f5dfc076700 0x7f5dfc078c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.277+0000 7f5404d32640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f540009f840 0x7f540014d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.277+0000 7f5404d32640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5400168c60 0x7f540015aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.277+0000 7f5404d32640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f540015b3e0 0x7f54001585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.277+0000 7f5404d32640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f54000b6680 con 0x7f540015b3e0 2024-05-14T14:40:32.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.277+0000 7f5404d32640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f54000b6500 con 0x7f5400168c60 2024-05-14T14:40:32.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.277+0000 7f1b4930a640 1 -- 172.21.15.39:0/330890699 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b44050870 con 0x7f1b440d09c0 2024-05-14T14:40:32.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.277+0000 7fd0076d1640 1 Processor -- start 2024-05-14T14:40:32.310 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.277+0000 7fd0076d1640 1 -- start start 2024-05-14T14:40:32.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.277+0000 7f53ff7fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f540009f840 0x7f540014d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.278+0000 7f5404d32640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f54000b6800 con 0x7f540009f840 2024-05-14T14:40:32.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.278+0000 7f53ff7fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f540009f840 0x7f540014d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.39:41864/0 (socket says 172.21.15.39:41864) 2024-05-14T14:40:32.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.278+0000 7f53ff7fe640 1 -- 172.21.15.39:0/1349377008 learned_addr learned my addr 172.21.15.39:0/1349377008 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:32.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.278+0000 7f53fffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f540015b3e0 0x7f54001585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.277+0000 7f5e1d3e3640 1 --2- 172.21.15.39:0/3634891055 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f5dfc076700 0x7f5dfc078c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.311 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.278+0000 7f5e0dffb640 1 -- 172.21.15.39:0/3634891055 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5e0800f040 con 0x7f5e1806d940 2024-05-14T14:40:32.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.278+0000 7f8559ffb640 1 --2- 172.21.15.39:0/1118124923 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f85480763d0 0x7f85480788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.278+0000 7f978cdc6640 1 --2- 172.21.15.39:0/1976063231 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97880ae930 0x7f9788154be0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f978400c5c0 tx=0x7f978400ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:32.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.278+0000 7f53ff7fe640 1 -- 172.21.15.39:0/1349377008 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5400168c60 msgr2=0x7f540015aea0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-14T14:40:32.312 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.278+0000 7f53ff7fe640 1 --2- 172.21.15.39:0/1349377008 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5400168c60 0x7f540015aea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.278+0000 7f53ff7fe640 1 -- 172.21.15.39:0/1349377008 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f540015b3e0 msgr2=0x7f54001585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.278+0000 7f53ff7fe640 1 --2- 172.21.15.39:0/1349377008 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f540015b3e0 0x7f54001585b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.278+0000 7f53ff7fe640 1 -- 172.21.15.39:0/1349377008 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5400165400 con 0x7f540009f840 2024-05-14T14:40:32.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.278+0000 7f8559ffb640 1 -- 172.21.15.39:0/1118124923 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8560097710 con 0x7f855c007310 2024-05-14T14:40:32.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.278+0000 7f53ff7fe640 1 --2- 172.21.15.39:0/1349377008 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f540009f840 0x7f540014d880 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f53f800c7a0 tx=0x7f53f800cc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:32.313 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.279+0000 7f5e1d3e3640 1 --2- 172.21.15.39:0/3634891055 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f5dfc076700 0x7f5dfc078c10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5e14009ac0 tx=0x7f5e14008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:32.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.279+0000 7f8568ec8640 1 --2- 172.21.15.39:0/1118124923 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f85480763d0 0x7f85480788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.279+0000 7f977dffb640 1 -- 172.21.15.39:0/1976063231 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9784015070 con 0x7f97880ae930 2024-05-14T14:40:32.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.279+0000 7f977dffb640 1 -- 172.21.15.39:0/1976063231 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9784004220 con 0x7f97880ae930 2024-05-14T14:40:32.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.279+0000 7f977dffb640 1 -- 172.21.15.39:0/1976063231 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9784003610 con 0x7f97880ae930 2024-05-14T14:40:32.314 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.279+0000 7f978f82b640 1 -- 172.21.15.39:0/1976063231 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f978809d340 con 0x7f97880ae930 2024-05-14T14:40:32.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.279+0000 7fd0076d1640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0000b23f0 0x7fd000145920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.315 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.279+0000 7f978f82b640 1 -- 172.21.15.39:0/1976063231 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f978809d900 con 0x7f97880ae930 2024-05-14T14:40:32.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.279+0000 7fd0076d1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0000d1f00 0x7fd00015bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.279+0000 7fd00546d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0000b23f0 0x7fd000145920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.279+0000 7fd00546d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0000b23f0 0x7fd000145920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.39:41866/0 (socket says 172.21.15.39:41866) 2024-05-14T14:40:32.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.279+0000 7fd00546d640 1 -- 172.21.15.39:0/2454273187 learned_addr learned my addr 172.21.15.39:0/2454273187 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:32.316 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.279+0000 7f8568ec8640 1 --2- 172.21.15.39:0/1118124923 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f85480763d0 0x7f85480788e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f855c0e7b50 tx=0x7f8554009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:32.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.279+0000 7fd0076d1640 1 --2- 172.21.15.39:0/2454273187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd000070600 0x7fd000070a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.279+0000 7fd004c6c640 1 --2- 172.21.15.39:0/2454273187 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0000d1f00 0x7fd00015bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.280+0000 7fd0076d1640 1 -- 172.21.15.39:0/2454273187 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd0000d33b0 con 0x7fd000070600 2024-05-14T14:40:32.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.280+0000 7efc3ffff640 1 Processor -- start 2024-05-14T14:40:32.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.280+0000 7fd0076d1640 1 -- 172.21.15.39:0/2454273187 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd0000d30d0 con 0x7fd0000d1f00 2024-05-14T14:40:32.317 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.280+0000 7fd0076d1640 1 -- 172.21.15.39:0/2454273187 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fd0000b4e70 con 0x7fd0000b23f0 2024-05-14T14:40:32.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.280+0000 7efc3ffff640 1 -- start start 2024-05-14T14:40:32.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.279+0000 7f1f1b7fe640 1 -- 172.21.15.39:0/3644629983 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1f2401a070 con 0x7f1f340c5a00 2024-05-14T14:40:32.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.279+0000 7f1f197fa640 1 -- 172.21.15.39:0/3644629983 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f0c005290 con 0x7f1f340c5a00 2024-05-14T14:40:32.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.280+0000 7f1f1b7fe640 1 --2- 172.21.15.39:0/3644629983 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1f200763a0 0x7f1f200788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.318 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.280+0000 7f1f1b7fe640 1 -- 172.21.15.39:0/3644629983 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1f24096bf0 con 0x7f1f340c5a00 2024-05-14T14:40:32.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.280+0000 7f1f327fc640 1 --2- 172.21.15.39:0/3644629983 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1f200763a0 0x7f1f200788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.319 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.280+0000 7f978f82b640 1 -- 172.21.15.39:0/1976063231 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f978809b6d0 con 0x7f97880ae930 2024-05-14T14:40:32.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.281+0000 7fd005c6e640 1 --2- 172.21.15.39:0/2454273187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd000070600 0x7fd000070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.281+0000 7fd004c6c640 1 -- 172.21.15.39:0/2454273187 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0000b23f0 msgr2=0x7fd000145920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.281+0000 7fd004c6c640 1 --2- 172.21.15.39:0/2454273187 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0000b23f0 0x7fd000145920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.281+0000 7fd004c6c640 1 -- 172.21.15.39:0/2454273187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd000070600 msgr2=0x7fd000070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.281+0000 7fd004c6c640 1 --2- 172.21.15.39:0/2454273187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd000070600 0x7fd000070a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.281+0000 7fd004c6c640 1 -- 172.21.15.39:0/2454273187 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd000070f50 con 0x7fd0000d1f00 2024-05-14T14:40:32.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.281+0000 7fd00546d640 1 --2- 172.21.15.39:0/2454273187 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0000b23f0 0x7fd000145920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T14:40:32.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.281+0000 7fd005c6e640 1 --2- 172.21.15.39:0/2454273187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd000070600 0x7fd000070a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:40:32.320 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.281+0000 7fd004c6c640 1 --2- 172.21.15.39:0/2454273187 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0000d1f00 0x7fd00015bfa0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcffc00c3f0 tx=0x7fcffc00c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:32.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.281+0000 7f1f327fc640 1 --2- 172.21.15.39:0/3644629983 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1f200763a0 0x7f1f200788b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1f28034000 tx=0x7f1f2802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:32.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.281+0000 7f5e0dffb640 1 -- 172.21.15.39:0/3634891055 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5e08060e30 con 0x7f5e1806d940 2024-05-14T14:40:32.321 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.281+0000 7f53e7fff640 1 -- 172.21.15.39:0/1349377008 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f8003b70 con 0x7f540009f840 2024-05-14T14:40:32.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.281+0000 7fcff5ffb640 1 -- 172.21.15.39:0/2454273187 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcffc017070 con 0x7fd0000d1f00 2024-05-14T14:40:32.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.281+0000 7fcff5ffb640 1 -- 172.21.15.39:0/2454273187 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcffc0052d0 con 0x7fd0000d1f00 2024-05-14T14:40:32.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.281+0000 7fcff5ffb640 1 -- 172.21.15.39:0/2454273187 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcffc003830 con 0x7fd0000d1f00 2024-05-14T14:40:32.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.281+0000 7fd0076d1640 1 -- 172.21.15.39:0/2454273187 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd00015c980 con 0x7fd0000d1f00 2024-05-14T14:40:32.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.282+0000 7efc3ffff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc400cccd0 0x7efc400b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.322 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.282+0000 7efc3ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc400d0640 0x7efc401fab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.283+0000 7efc3effd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc400cccd0 0x7efc400b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.283+0000 7efc3effd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc400cccd0 0x7efc400b52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.39:41880/0 (socket says 172.21.15.39:41880) 2024-05-14T14:40:32.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.283+0000 7efc3e7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc400d0640 0x7efc401fab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.283+0000 7efc3e7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc400d0640 0x7efc401fab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48292/0 (socket says 172.21.15.39:48292) 2024-05-14T14:40:32.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.282+0000 7f977dffb640 1 -- 172.21.15.39:0/1976063231 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f97840037b0 con 0x7f97880ae930 2024-05-14T14:40:32.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.281+0000 7f5404d32640 1 -- 172.21.15.39:0/1349377008 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f540014ddc0 con 0x7f540009f840 2024-05-14T14:40:32.323 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.281+0000 7f5404d32640 1 -- 172.21.15.39:0/1349377008 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f54001659a0 con 0x7f540009f840 2024-05-14T14:40:32.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.282+0000 7fd0076d1640 1 -- 172.21.15.39:0/2454273187 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd00015cf40 con 0x7fd0000d1f00 2024-05-14T14:40:32.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.283+0000 7efc3effd640 1 -- 172.21.15.39:0/2828501053 learned_addr learned my addr 172.21.15.39:0/2828501053 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:32.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.283+0000 7f5404d32640 1 -- 172.21.15.39:0/1349377008 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54000b2dc0 con 0x7f540009f840 2024-05-14T14:40:32.324 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.283+0000 7efc3ffff640 1 --2- 172.21.15.39:0/2828501053 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc401688e0 0x7efc401fb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.283+0000 7efc3ffff640 1 -- 172.21.15.39:0/2828501053 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7efc40168cf0 con 0x7efc400d0640 2024-05-14T14:40:32.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.283+0000 7efc3ffff640 1 -- 172.21.15.39:0/2828501053 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7efc40165560 con 0x7efc401688e0 2024-05-14T14:40:32.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.283+0000 7efc3ffff640 1 -- 172.21.15.39:0/2828501053 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7efc40168e70 con 0x7efc400cccd0 2024-05-14T14:40:32.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.283+0000 7f977dffb640 1 --2- 172.21.15.39:0/1976063231 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f976c0762d0 0x7f976c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.325 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.283+0000 7f1b40ff9640 1 -- 172.21.15.39:0/330890699 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1b3c049460 con 0x7f1b440d09c0 2024-05-14T14:40:32.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.283+0000 7f977dffb640 1 -- 172.21.15.39:0/1976063231 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9784097630 con 0x7f97880ae930 2024-05-14T14:40:32.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.283+0000 7f978d5c7640 1 --2- 172.21.15.39:0/1976063231 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f976c0762d0 0x7f976c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.283+0000 7fcfe37fe640 1 -- 172.21.15.39:0/2454273187 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd00015c6f0 con 0x7fd0000d1f00 2024-05-14T14:40:32.326 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.284+0000 7efc3f7fe640 1 --2- 172.21.15.39:0/2828501053 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc401688e0 0x7efc401fb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.284+0000 7efc3effd640 1 -- 172.21.15.39:0/2828501053 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc401688e0 msgr2=0x7efc401fb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.284+0000 7efc3effd640 1 --2- 172.21.15.39:0/2828501053 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc401688e0 0x7efc401fb0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.284+0000 7efc3effd640 1 -- 172.21.15.39:0/2828501053 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc400d0640 msgr2=0x7efc401fab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.284+0000 7efc3effd640 1 --2- 172.21.15.39:0/2828501053 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc400d0640 0x7efc401fab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.284+0000 7efc3effd640 1 -- 172.21.15.39:0/2828501053 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc400b5cd0 con 0x7efc400cccd0 2024-05-14T14:40:32.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.284+0000 7f1b40ff9640 1 --2- 172.21.15.39:0/330890699 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1b30076320 0x7f1b30078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.327 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.284+0000 7efc3e7fc640 1 --2- 172.21.15.39:0/2828501053 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc400d0640 0x7efc401fab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T14:40:32.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.284+0000 7f1b43fff640 1 --2- 172.21.15.39:0/330890699 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1b30076320 0x7f1b30078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.284+0000 7f978d5c7640 1 --2- 172.21.15.39:0/1976063231 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f976c0762d0 0x7f976c0787e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9780009850 tx=0x7f9780009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:32.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.284+0000 7efc3effd640 1 --2- 172.21.15.39:0/2828501053 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc400cccd0 0x7efc400b52a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efc3000e870 tx=0x7efc3000ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:32.328 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.285+0000 7f1b43fff640 1 --2- 172.21.15.39:0/330890699 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1b30076320 0x7f1b30078830 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1b38001550 tx=0x7f1b38007970 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:32.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.285+0000 7fcff5ffb640 1 -- 172.21.15.39:0/2454273187 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcffc01a070 con 0x7fd0000d1f00 2024-05-14T14:40:32.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.285+0000 7fcff5ffb640 1 --2- 172.21.15.39:0/2454273187 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fcfe40762d0 0x7fcfe40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.285+0000 7fcff5ffb640 1 -- 172.21.15.39:0/2454273187 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fcffc096ee0 con 0x7fd0000d1f00 2024-05-14T14:40:32.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.285+0000 7fd00546d640 1 --2- 172.21.15.39:0/2454273187 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fcfe40762d0 0x7fcfe40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.286+0000 7fd00546d640 1 --2- 172.21.15.39:0/2454273187 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fcfe40762d0 0x7fcfe40787e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcff0005880 tx=0x7fcff0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:32.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.287+0000 7f53e7fff640 1 -- 172.21.15.39:0/1349377008 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53f8003d10 con 0x7f540009f840 2024-05-14T14:40:32.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.287+0000 7f53e7fff640 1 -- 172.21.15.39:0/1349377008 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f800a9f0 con 0x7f540009f840 2024-05-14T14:40:32.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.287+0000 7efc277fe640 1 -- 172.21.15.39:0/2828501053 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc30017070 con 0x7efc400cccd0 2024-05-14T14:40:32.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.287+0000 7efc3ffff640 1 -- 172.21.15.39:0/2828501053 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc400b5fb0 con 0x7efc400cccd0 2024-05-14T14:40:32.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.287+0000 7f1b40ff9640 1 -- 172.21.15.39:0/330890699 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1b3c034620 con 0x7f1b440d09c0 2024-05-14T14:40:32.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.287+0000 7efc3ffff640 1 -- 172.21.15.39:0/2828501053 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efc401ee220 con 0x7efc400cccd0 2024-05-14T14:40:32.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.287+0000 7f8559ffb640 1 -- 172.21.15.39:0/1118124923 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f85600606c0 con 0x7f855c007310 2024-05-14T14:40:32.331 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.288+0000 7efc3ffff640 1 -- 172.21.15.39:0/2828501053 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc40050870 con 0x7efc400cccd0 2024-05-14T14:40:32.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.290+0000 7fcff5ffb640 1 -- 172.21.15.39:0/2454273187 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcffc03a080 con 0x7fd0000d1f00 2024-05-14T14:40:32.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.290+0000 7f1f1b7fe640 1 -- 172.21.15.39:0/3644629983 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1f340c6350 con 0x7f1f340c5a00 2024-05-14T14:40:32.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.293+0000 7f1b40ff9640 1 -- 172.21.15.39:0/330890699 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1b3c030050 con 0x7f1b440d09c0 2024-05-14T14:40:32.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.293+0000 7efc277fe640 1 -- 172.21.15.39:0/2828501053 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc30005990 con 0x7efc400cccd0 2024-05-14T14:40:32.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.293+0000 7efc277fe640 1 -- 172.21.15.39:0/2828501053 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc30021060 con 0x7efc400cccd0 2024-05-14T14:40:32.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.294+0000 7f53e7fff640 1 -- 172.21.15.39:0/1349377008 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f53f800ab90 con 0x7f540009f840 2024-05-14T14:40:32.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.295+0000 7f53e7fff640 1 --2- 172.21.15.39:0/1349377008 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f53ec076300 0x7f53ec078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.295+0000 7f53feffd640 1 --2- 172.21.15.39:0/1349377008 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f53ec076300 0x7f53ec078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.295+0000 7f53e7fff640 1 -- 172.21.15.39:0/1349377008 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f53f8098420 con 0x7f540009f840 2024-05-14T14:40:32.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.296+0000 7efc277fe640 1 -- 172.21.15.39:0/2828501053 <== mon.2 v2:172.21.15.62:3301/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efc3001a070 con 0x7efc400cccd0 2024-05-14T14:40:32.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.296+0000 7f53feffd640 1 --2- 172.21.15.39:0/1349377008 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f53ec076300 0x7f53ec078810 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f540014e670 tx=0x7f53f4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:32.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.297+0000 7efc277fe640 1 --2- 172.21.15.39:0/2828501053 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7efc2c076300 0x7efc2c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:32.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.297+0000 7efc3e7fc640 1 --2- 172.21.15.39:0/2828501053 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7efc2c076300 0x7efc2c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:32.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.297+0000 7efc3e7fc640 1 --2- 172.21.15.39:0/2828501053 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7efc2c076300 0x7efc2c078810 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efc400b78b0 tx=0x7efc34009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:32.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.298+0000 7efc277fe640 1 -- 172.21.15.39:0/2828501053 <== mon.2 v2:172.21.15.62:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7efc3005d140 con 0x7efc400cccd0 2024-05-14T14:40:32.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.298+0000 7f53e7fff640 1 -- 172.21.15.39:0/1349377008 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f54000b2dc0 con 0x7f540009f840 2024-05-14T14:40:32.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.299+0000 7f977dffb640 1 -- 172.21.15.39:0/1976063231 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f97840604e0 con 0x7f97880ae930 2024-05-14T14:40:32.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.303+0000 7efc277fe640 1 -- 172.21.15.39:0/2828501053 <== mon.2 v2:172.21.15.62:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7efc30060eb0 con 0x7efc400cccd0 2024-05-14T14:40:32.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.733+0000 7f5e1e3e5640 1 -- 172.21.15.39:0/3634891055 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f5e180746a0 con 0x7f5e1806d940 2024-05-14T14:40:32.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.734+0000 7f5e0dffb640 1 -- 172.21.15.39:0/3634891055 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5e08060730 con 0x7f5e1806d940 2024-05-14T14:40:32.718 INFO:teuthology.orchestra.run.smithi039.stdout:55834574857 2024-05-14T14:40:32.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.734+0000 7f856b92d640 1 -- 172.21.15.39:0/1118124923 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f855c0e7650 con 0x7f855c007310 2024-05-14T14:40:32.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.735+0000 7f8559ffb640 1 -- 172.21.15.39:0/1118124923 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f85600649c0 con 0x7f855c007310 2024-05-14T14:40:32.719 INFO:teuthology.orchestra.run.smithi039.stdout:55834574856 2024-05-14T14:40:32.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.738+0000 7f5e1e3e5640 1 -- 172.21.15.39:0/3634891055 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f5dfc076700 msgr2=0x7f5dfc078c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.738+0000 7f5e1e3e5640 1 --2- 172.21.15.39:0/3634891055 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f5dfc076700 0x7f5dfc078c10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5e14009ac0 tx=0x7f5e14008040 comp rx=0 tx=0).stop 2024-05-14T14:40:32.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.738+0000 7f5e1e3e5640 1 -- 172.21.15.39:0/3634891055 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5e1806d940 msgr2=0x7f5e181f99a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.738+0000 7f5e1e3e5640 1 --2- 172.21.15.39:0/3634891055 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5e1806d940 0x7f5e181f99a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5e0800e8a0 tx=0x7f5e0800ed60 comp rx=0 tx=0).stop 2024-05-14T14:40:32.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.738+0000 7f5e1e3e5640 1 -- 172.21.15.39:0/3634891055 shutdown_connections 2024-05-14T14:40:32.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.738+0000 7f5e1e3e5640 1 --2- 172.21.15.39:0/3634891055 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f5dfc076700 0x7f5dfc078c10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.738+0000 7f5e1e3e5640 1 --2- 172.21.15.39:0/3634891055 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5e1815c720 0x7f5e181f9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.738+0000 7f5e1e3e5640 1 --2- 172.21.15.39:0/3634891055 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5e1806d940 0x7f5e181f99a0 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5e0800e8a0 tx=0x7f5e0800ed60 comp rx=0 tx=0).stop 2024-05-14T14:40:32.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.738+0000 7f5e1e3e5640 1 --2- 172.21.15.39:0/3634891055 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e1806c6a0 0x7f5e180c9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.738+0000 7f5e1e3e5640 1 -- 172.21.15.39:0/3634891055 >> 172.21.15.39:0/3634891055 conn(0x7f5e1809b5f0 msgr2=0x7f5e180cfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:32.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.738+0000 7f5e1e3e5640 1 -- 172.21.15.39:0/3634891055 shutdown_connections 2024-05-14T14:40:32.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.738+0000 7f5e1e3e5640 1 -- 172.21.15.39:0/3634891055 wait complete. 2024-05-14T14:40:32.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.738+0000 7f856b92d640 1 -- 172.21.15.39:0/1118124923 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f85480763d0 msgr2=0x7f85480788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.738+0000 7f856b92d640 1 --2- 172.21.15.39:0/1118124923 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f85480763d0 0x7f85480788e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f855c0e7b50 tx=0x7f8554009040 comp rx=0 tx=0).stop 2024-05-14T14:40:32.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.738+0000 7f856b92d640 1 -- 172.21.15.39:0/1118124923 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f855c007310 msgr2=0x7f855c0d8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.738+0000 7f856b92d640 1 --2- 172.21.15.39:0/1118124923 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f855c007310 0x7f855c0d8540 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f856000e870 tx=0x7f856000ed30 comp rx=0 tx=0).stop 2024-05-14T14:40:32.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.739+0000 7f856b92d640 1 -- 172.21.15.39:0/1118124923 shutdown_connections 2024-05-14T14:40:32.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.739+0000 7f856b92d640 1 --2- 172.21.15.39:0/1118124923 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f85480763d0 0x7f85480788e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.739+0000 7f856b92d640 1 --2- 172.21.15.39:0/1118124923 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f855c0dc8a0 0x7f855c0e37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.739+0000 7f856b92d640 1 --2- 172.21.15.39:0/1118124923 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f855c052fa0 0x7f855c0e3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.739+0000 7f856b92d640 1 --2- 172.21.15.39:0/1118124923 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f855c007310 0x7f855c0d8540 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.739+0000 7f856b92d640 1 -- 172.21.15.39:0/1118124923 >> 172.21.15.39:0/1118124923 conn(0x7f855c054ce0 msgr2=0x7f855c0550f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:32.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.739+0000 7f856b92d640 1 -- 172.21.15.39:0/1118124923 shutdown_connections 2024-05-14T14:40:32.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.739+0000 7f856b92d640 1 -- 172.21.15.39:0/1118124923 wait complete. 2024-05-14T14:40:32.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.742+0000 7fcfe37fe640 1 -- 172.21.15.39:0/2454273187 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fd000076aa0 con 0x7fd0000d1f00 2024-05-14T14:40:32.730 INFO:teuthology.orchestra.run.smithi039.stdout:55834574856 2024-05-14T14:40:32.730 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.743+0000 7fcff5ffb640 1 -- 172.21.15.39:0/2454273187 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd000070f50 con 0x7fd0000d1f00 2024-05-14T14:40:32.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.747+0000 7f978f82b640 1 -- 172.21.15.39:0/1976063231 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f9788076aa0 con 0x7f97880ae930 2024-05-14T14:40:32.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.747+0000 7fcfe37fe640 1 -- 172.21.15.39:0/2454273187 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fcfe40762d0 msgr2=0x7fcfe40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.747+0000 7fcfe37fe640 1 --2- 172.21.15.39:0/2454273187 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fcfe40762d0 0x7fcfe40787e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcff0005880 tx=0x7fcff0009040 comp rx=0 tx=0).stop 2024-05-14T14:40:32.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.747+0000 7fcfe37fe640 1 -- 172.21.15.39:0/2454273187 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0000d1f00 msgr2=0x7fd00015bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.747+0000 7fcfe37fe640 1 --2- 172.21.15.39:0/2454273187 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0000d1f00 0x7fd00015bfa0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcffc00c3f0 tx=0x7fcffc00c8b0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.747+0000 7f1b4930a640 1 -- 172.21.15.39:0/330890699 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f1b44071a70 con 0x7f1b440d09c0 2024-05-14T14:40:32.732 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.747+0000 7f977dffb640 1 -- 172.21.15.39:0/1976063231 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f97840647e0 con 0x7f97880ae930 2024-05-14T14:40:32.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.747+0000 7fcfe37fe640 1 -- 172.21.15.39:0/2454273187 shutdown_connections 2024-05-14T14:40:32.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.747+0000 7fcfe37fe640 1 --2- 172.21.15.39:0/2454273187 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fcfe40762d0 0x7fcfe40787e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.747+0000 7fcfe37fe640 1 --2- 172.21.15.39:0/2454273187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd000070600 0x7fd000070a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.747+0000 7fcfe37fe640 1 --2- 172.21.15.39:0/2454273187 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0000d1f00 0x7fd00015bfa0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.734 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.748+0000 7fcfe37fe640 1 --2- 172.21.15.39:0/2454273187 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd0000b23f0 0x7fd000145920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.748+0000 7fcfe37fe640 1 -- 172.21.15.39:0/2454273187 >> 172.21.15.39:0/2454273187 conn(0x7fd0000b7740 msgr2=0x7fd000071460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:32.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.748+0000 7f1b40ff9640 1 -- 172.21.15.39:0/330890699 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1b3c082a80 con 0x7f1b440d09c0 2024-05-14T14:40:32.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.748+0000 7fcfe37fe640 1 -- 172.21.15.39:0/2454273187 shutdown_connections 2024-05-14T14:40:32.736 INFO:teuthology.orchestra.run.smithi039.stdout:55834574856 2024-05-14T14:40:32.736 INFO:teuthology.orchestra.run.smithi039.stdout:55834574855 2024-05-14T14:40:32.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.748+0000 7fcfe37fe640 1 -- 172.21.15.39:0/2454273187 wait complete. 2024-05-14T14:40:32.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.749+0000 7f1f197fa640 1 -- 172.21.15.39:0/3644629983 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f1f0c005580 con 0x7f1f340c5a00 2024-05-14T14:40:32.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.749+0000 7f1f1b7fe640 1 -- 172.21.15.39:0/3644629983 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1f24060e20 con 0x7f1f340c5a00 2024-05-14T14:40:32.738 INFO:teuthology.orchestra.run.smithi039.stdout:55834574857 2024-05-14T14:40:32.738 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.751+0000 7f1b4930a640 1 -- 172.21.15.39:0/330890699 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1b30076320 msgr2=0x7f1b30078830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.751+0000 7f978f82b640 1 -- 172.21.15.39:0/1976063231 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f976c0762d0 msgr2=0x7f976c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.751+0000 7f978f82b640 1 --2- 172.21.15.39:0/1976063231 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f976c0762d0 0x7f976c0787e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9780009850 tx=0x7f9780009000 comp rx=0 tx=0).stop 2024-05-14T14:40:32.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.752+0000 7f978f82b640 1 -- 172.21.15.39:0/1976063231 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97880ae930 msgr2=0x7f9788154be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.739 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.752+0000 7f978f82b640 1 --2- 172.21.15.39:0/1976063231 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97880ae930 0x7f9788154be0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f978400c5c0 tx=0x7f978400ca80 comp rx=0 tx=0).stop 2024-05-14T14:40:32.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.752+0000 7f1b4930a640 1 --2- 172.21.15.39:0/330890699 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1b30076320 0x7f1b30078830 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1b38001550 tx=0x7f1b38007970 comp rx=0 tx=0).stop 2024-05-14T14:40:32.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.752+0000 7f1b4930a640 1 -- 172.21.15.39:0/330890699 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1b440d09c0 msgr2=0x7f1b441f63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.752+0000 7f1b4930a640 1 --2- 172.21.15.39:0/330890699 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1b440d09c0 0x7f1b441f63e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c02ce60 tx=0x7f1b3c004a40 comp rx=0 tx=0).stop 2024-05-14T14:40:32.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.752+0000 7f978f82b640 1 -- 172.21.15.39:0/1976063231 shutdown_connections 2024-05-14T14:40:32.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.752+0000 7f978f82b640 1 --2- 172.21.15.39:0/1976063231 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f976c0762d0 0x7f976c0787e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.752+0000 7f978f82b640 1 --2- 172.21.15.39:0/1976063231 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97880b0b60 0x7f97881fe330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.752+0000 7f978f82b640 1 --2- 172.21.15.39:0/1976063231 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f97880ae930 0x7f9788154be0 secure :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f978400c5c0 tx=0x7f978400ca80 comp rx=0 tx=0).stop 2024-05-14T14:40:32.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.752+0000 7f978f82b640 1 --2- 172.21.15.39:0/1976063231 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f978806f2a0 0x7f97881546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.752+0000 7f978f82b640 1 -- 172.21.15.39:0/1976063231 >> 172.21.15.39:0/1976063231 conn(0x7f97880ce330 msgr2=0x7f9788163bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:32.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.752+0000 7f1b4930a640 1 -- 172.21.15.39:0/330890699 shutdown_connections 2024-05-14T14:40:32.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.752+0000 7f1b4930a640 1 --2- 172.21.15.39:0/330890699 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1b30076320 0x7f1b30078830 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.752+0000 7f1b4930a640 1 --2- 172.21.15.39:0/330890699 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b44160210 0x7f1b44137f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.752+0000 7f1b4930a640 1 --2- 172.21.15.39:0/330890699 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1b440d09c0 0x7f1b441f63e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.752+0000 7f1b4930a640 1 --2- 172.21.15.39:0/330890699 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b440b46b0 0x7f1b441392b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.752+0000 7f1b4930a640 1 -- 172.21.15.39:0/330890699 >> 172.21.15.39:0/330890699 conn(0x7f1b440d20a0 msgr2=0x7f1b4406d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:32.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.752+0000 7f5404d32640 1 -- 172.21.15.39:0/1349377008 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f5400050870 con 0x7f540009f840 2024-05-14T14:40:32.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.752+0000 7f1b4930a640 1 -- 172.21.15.39:0/330890699 shutdown_connections 2024-05-14T14:40:32.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.752+0000 7f1b4930a640 1 -- 172.21.15.39:0/330890699 wait complete. 2024-05-14T14:40:32.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.753+0000 7f978f82b640 1 -- 172.21.15.39:0/1976063231 shutdown_connections 2024-05-14T14:40:32.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.753+0000 7f978f82b640 1 -- 172.21.15.39:0/1976063231 wait complete. 2024-05-14T14:40:32.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.753+0000 7f1f197fa640 1 -- 172.21.15.39:0/3644629983 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1f200763a0 msgr2=0x7f1f200788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.753+0000 7f1f197fa640 1 --2- 172.21.15.39:0/3644629983 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1f200763a0 0x7f1f200788b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1f28034000 tx=0x7f1f2802e000 comp rx=0 tx=0).stop 2024-05-14T14:40:32.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.754+0000 7f1f197fa640 1 -- 172.21.15.39:0/3644629983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1f340c5a00 msgr2=0x7f1f341fef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.754+0000 7f1f197fa640 1 --2- 172.21.15.39:0/3644629983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1f340c5a00 0x7f1f341fef40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1f24007fd0 tx=0x7f1f2400c890 comp rx=0 tx=0).stop 2024-05-14T14:40:32.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.754+0000 7f53e7fff640 1 -- 172.21.15.39:0/1349377008 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f53f8061910 con 0x7f540009f840 2024-05-14T14:40:32.744 INFO:teuthology.orchestra.run.smithi039.stdout:55834574857 2024-05-14T14:40:32.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.754+0000 7f1f197fa640 1 -- 172.21.15.39:0/3644629983 shutdown_connections 2024-05-14T14:40:32.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.754+0000 7f1f197fa640 1 --2- 172.21.15.39:0/3644629983 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1f200763a0 0x7f1f200788b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.754+0000 7f1f197fa640 1 --2- 172.21.15.39:0/3644629983 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1f34164b10 0x7f1f340cdfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.754+0000 7f1f197fa640 1 --2- 172.21.15.39:0/3644629983 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f340d1850 0x7f1f341fa7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.754+0000 7f1f197fa640 1 --2- 172.21.15.39:0/3644629983 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1f340c5a00 0x7f1f341fef40 secure :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1f24007fd0 tx=0x7f1f2400c890 comp rx=0 tx=0).stop 2024-05-14T14:40:32.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.754+0000 7f1f197fa640 1 -- 172.21.15.39:0/3644629983 >> 172.21.15.39:0/3644629983 conn(0x7f1f340b7740 msgr2=0x7f1f34160270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:32.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.754+0000 7f1f197fa640 1 -- 172.21.15.39:0/3644629983 shutdown_connections 2024-05-14T14:40:32.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.754+0000 7f1f197fa640 1 -- 172.21.15.39:0/3644629983 wait complete. 2024-05-14T14:40:32.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.755+0000 7efc3ffff640 1 -- 172.21.15.39:0/2828501053 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7efc400b46e0 con 0x7efc400cccd0 2024-05-14T14:40:32.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.755+0000 7efc277fe640 1 -- 172.21.15.39:0/2828501053 <== mon.2 v2:172.21.15.62:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efc300651b0 con 0x7efc400cccd0 2024-05-14T14:40:32.746 INFO:teuthology.orchestra.run.smithi039.stdout:55834574856 2024-05-14T14:40:32.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.758+0000 7f5404d32640 1 -- 172.21.15.39:0/1349377008 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f53ec076300 msgr2=0x7f53ec078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.758+0000 7f5404d32640 1 --2- 172.21.15.39:0/1349377008 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f53ec076300 0x7f53ec078810 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f540014e670 tx=0x7f53f4009190 comp rx=0 tx=0).stop 2024-05-14T14:40:32.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.758+0000 7f5404d32640 1 -- 172.21.15.39:0/1349377008 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f540009f840 msgr2=0x7f540014d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.758+0000 7f5404d32640 1 --2- 172.21.15.39:0/1349377008 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f540009f840 0x7f540014d880 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f53f800c7a0 tx=0x7f53f800cc60 comp rx=0 tx=0).stop 2024-05-14T14:40:32.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.759+0000 7f5404d32640 1 -- 172.21.15.39:0/1349377008 shutdown_connections 2024-05-14T14:40:32.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.759+0000 7f5404d32640 1 --2- 172.21.15.39:0/1349377008 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f53ec076300 0x7f53ec078810 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.759+0000 7f5404d32640 1 --2- 172.21.15.39:0/1349377008 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f540015b3e0 0x7f54001585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.759+0000 7f5404d32640 1 --2- 172.21.15.39:0/1349377008 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5400168c60 0x7f540015aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.759+0000 7f5404d32640 1 --2- 172.21.15.39:0/1349377008 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f540009f840 0x7f540014d880 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.759+0000 7f5404d32640 1 -- 172.21.15.39:0/1349377008 >> 172.21.15.39:0/1349377008 conn(0x7f5400073650 msgr2=0x7f54000affe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:32.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.759+0000 7efc3ffff640 1 -- 172.21.15.39:0/2828501053 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7efc2c076300 msgr2=0x7efc2c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.747 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.759+0000 7efc3ffff640 1 --2- 172.21.15.39:0/2828501053 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7efc2c076300 0x7efc2c078810 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efc400b78b0 tx=0x7efc34009040 comp rx=0 tx=0).stop 2024-05-14T14:40:32.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.759+0000 7efc3ffff640 1 -- 172.21.15.39:0/2828501053 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc400cccd0 msgr2=0x7efc400b52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:32.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.759+0000 7efc3ffff640 1 --2- 172.21.15.39:0/2828501053 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc400cccd0 0x7efc400b52a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efc3000e870 tx=0x7efc3000ed30 comp rx=0 tx=0).stop 2024-05-14T14:40:32.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.760+0000 7f5404d32640 1 -- 172.21.15.39:0/1349377008 shutdown_connections 2024-05-14T14:40:32.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.760+0000 7f5404d32640 1 -- 172.21.15.39:0/1349377008 wait complete. 2024-05-14T14:40:32.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.760+0000 7efc3ffff640 1 -- 172.21.15.39:0/2828501053 shutdown_connections 2024-05-14T14:40:32.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.760+0000 7efc3ffff640 1 --2- 172.21.15.39:0/2828501053 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7efc2c076300 0x7efc2c078810 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.760+0000 7efc3ffff640 1 --2- 172.21.15.39:0/2828501053 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc401688e0 0x7efc401fb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.760+0000 7efc3ffff640 1 --2- 172.21.15.39:0/2828501053 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc400d0640 0x7efc401fab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.760+0000 7efc3ffff640 1 --2- 172.21.15.39:0/2828501053 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc400cccd0 0x7efc400b52a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:32.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.760+0000 7efc3ffff640 1 -- 172.21.15.39:0/2828501053 >> 172.21.15.39:0/2828501053 conn(0x7efc400ce0f0 msgr2=0x7efc4006c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:32.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.760+0000 7efc3ffff640 1 -- 172.21.15.39:0/2828501053 shutdown_connections 2024-05-14T14:40:32.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:32.760+0000 7efc3ffff640 1 -- 172.21.15.39:0/2828501053 wait complete. 2024-05-14T14:40:32.750 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.4 2024-05-14T14:40:32.750 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.7 2024-05-14T14:40:32.754 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.3 2024-05-14T14:40:32.762 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.5 2024-05-14T14:40:32.763 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.2 2024-05-14T14:40:32.764 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.1 2024-05-14T14:40:32.765 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.6 2024-05-14T14:40:32.765 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.0 2024-05-14T14:40:33.751 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-14T14:40:33.752 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-14T14:40:33.754 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-14T14:40:33.764 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-14T14:40:33.764 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-14T14:40:33.764 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-14T14:40:33.766 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-14T14:40:33.766 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-14T14:40:33.949 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.965+0000 7f76d9aa7640 1 Processor -- start 2024-05-14T14:40:33.951 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.966+0000 7f76d9aa7640 1 -- start start 2024-05-14T14:40:33.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.967+0000 7f4459532640 1 Processor -- start 2024-05-14T14:40:33.952 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.967+0000 7f4459532640 1 -- start start 2024-05-14T14:40:33.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.969+0000 7f76d9aa7640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76cc04fa80 0x7f76cc0dfe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:33.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.969+0000 7f76d9aa7640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76cc0e0c10 con 0x7f76cc050670 2024-05-14T14:40:33.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.969+0000 7f76d9aa7640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76cc0538b0 con 0x7f76cc050a80 2024-05-14T14:40:33.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.969+0000 7f76d9aa7640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f76cc007120 con 0x7f76cc04fa80 2024-05-14T14:40:33.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.969+0000 7f76d2ffd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f76cc050a80 0x7f76cc04f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.39:56990/0 (socket says 172.21.15.39:56990) 2024-05-14T14:40:33.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.969+0000 7f76d2ffd640 1 -- 172.21.15.39:0/1822343309 learned_addr learned my addr 172.21.15.39:0/1822343309 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:33.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.969+0000 7f76d3fff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76cc04fa80 0x7f76cc0dfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:33.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.970+0000 7f76d27fc640 1 -- 172.21.15.39:0/1822343309 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 783701135 0 0) 0x7f76cc0538b0 con 0x7f76cc050a80 2024-05-14T14:40:33.954 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.970+0000 7efbfb20c640 1 Processor -- start 2024-05-14T14:40:33.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.970+0000 7f76d27fc640 1 -- 172.21.15.39:0/1822343309 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76c4003520 con 0x7f76cc050a80 2024-05-14T14:40:33.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.970+0000 7efbfb20c640 1 -- start start 2024-05-14T14:40:33.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.970+0000 7f76d27fc640 1 -- 172.21.15.39:0/1822343309 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4146227609 0 0) 0x7f76cc0e0c10 con 0x7f76cc050670 2024-05-14T14:40:33.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.970+0000 7f76d27fc640 1 -- 172.21.15.39:0/1822343309 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76c40048e0 con 0x7f76cc050670 2024-05-14T14:40:33.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.970+0000 7f76d27fc640 1 -- 172.21.15.39:0/1822343309 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3948446022 0 0) 0x7f76c40048e0 con 0x7f76cc050670 2024-05-14T14:40:33.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.970+0000 7f76d27fc640 1 -- 172.21.15.39:0/1822343309 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76cc04fa80 msgr2=0x7f76cc0dfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:33.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.970+0000 7f76d27fc640 1 --2- 172.21.15.39:0/1822343309 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76cc04fa80 0x7f76cc0dfe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:33.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.970+0000 7f76d27fc640 1 -- 172.21.15.39:0/1822343309 >> v1:172.21.15.62:6789/0 conn(0x7f76cc050a80 legacy=0x7f76cc04f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:33.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.970+0000 7f76d27fc640 1 -- 172.21.15.39:0/1822343309 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76cc053b90 con 0x7f76cc050670 2024-05-14T14:40:33.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.970+0000 7f76d27fc640 1 -- 172.21.15.39:0/1822343309 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1803005051 0 0) 0x7f76c80016d0 con 0x7f76cc050670 2024-05-14T14:40:33.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.970+0000 7f76d27fc640 1 -- 172.21.15.39:0/1822343309 >> v1:172.21.15.39:6789/0 conn(0x7f76cc050670 legacy=0x7f76cc0d9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:33.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.970+0000 7f76d27fc640 1 --2- 172.21.15.39:0/1822343309 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76c4004e60 0x7f76c40052d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:33.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.970+0000 7f76d27fc640 1 --2- 172.21.15.39:0/1822343309 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76c4003830 0x7f76c4003d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:33.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.970+0000 7f76d27fc640 1 --2- 172.21.15.39:0/1822343309 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f76c4004370 0x7f76c40147c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:33.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.970+0000 7f76d27fc640 1 -- 172.21.15.39:0/1822343309 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f76cc007120 con 0x7f76c4004370 2024-05-14T14:40:33.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.970+0000 7f76d27fc640 1 -- 172.21.15.39:0/1822343309 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f76c400bdf0 con 0x7f76c4003830 2024-05-14T14:40:33.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.970+0000 7f76d27fc640 1 -- 172.21.15.39:0/1822343309 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f76c4014d50 con 0x7f76c4004e60 2024-05-14T14:40:33.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.972+0000 7f76d37fe640 1 --2- 172.21.15.39:0/1822343309 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76c4004e60 0x7f76c40052d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:33.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.972+0000 7f76d3fff640 1 --2- 172.21.15.39:0/1822343309 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f76c4004370 0x7f76c40147c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:33.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.972+0000 7f76d2ffd640 1 --2- 172.21.15.39:0/1822343309 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76c4003830 0x7f76c4003d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:33.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.971+0000 7f4459532640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f444c054260 0x7f444c0e7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:33.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.971+0000 7f4459532640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f444c03c560 0x7f444c006400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:33.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.971+0000 7f4459532640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f444c0576e0 con 0x7f444c03c150 2024-05-14T14:40:33.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.971+0000 7f4459532640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f444c0579c0 con 0x7f444c03c560 2024-05-14T14:40:33.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.971+0000 7f4459532640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f444c057ca0 con 0x7f444c054260 2024-05-14T14:40:33.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.972+0000 7f4453fff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f444c054260 0x7f444c0e7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:33.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.972+0000 7f44537fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f444c03c150 0x7f444c0584a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.39:57000/0 (socket says 172.21.15.39:57000) 2024-05-14T14:40:33.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.972+0000 7f44537fe640 1 -- 172.21.15.39:0/3430080806 learned_addr learned my addr 172.21.15.39:0/3430080806 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:33.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.973+0000 7f4458d31640 1 --2- 172.21.15.39:0/3430080806 >> v2:172.21.15.62:3300/0 conn(0x7f444c03c560 0x7f444c006400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:33.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.973+0000 7efbfb20c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efbec050a40 0x7efbec04f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:33.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.973+0000 7efbfb20c640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7efbec04f870 0x7efbec0dfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:33.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.973+0000 7efbfb20c640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efbec04fc80 con 0x7efbec050630 2024-05-14T14:40:33.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.973+0000 7efbfaa0b640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7efbec04f870 0x7efbec0dfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:33.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.973+0000 7efbfaa0b640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7efbec04f870 0x7efbec0dfe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48310/0 (socket says 172.21.15.39:48310) 2024-05-14T14:40:33.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.974+0000 7efbfaa0b640 1 -- 172.21.15.39:0/1136977224 learned_addr learned my addr 172.21.15.39:0/1136977224 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:33.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.973+0000 7f76d37fe640 1 -- 172.21.15.39:0/1822343309 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76c4003830 msgr2=0x7f76c4003d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:33.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.974+0000 7efbfb20c640 1 -- 172.21.15.39:0/1136977224 --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7efbec0070e0 con 0x7efbec04f870 2024-05-14T14:40:33.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.974+0000 7efbfb20c640 1 -- 172.21.15.39:0/1136977224 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7efbec0e0bd0 con 0x7efbec050a40 2024-05-14T14:40:33.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.973+0000 7f76d37fe640 1 --2- 172.21.15.39:0/1822343309 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76c4003830 0x7f76c4003d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:33.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.973+0000 7f76d37fe640 1 -- 172.21.15.39:0/1822343309 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f76c4004370 msgr2=0x7f76c40147c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:33.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.973+0000 7f76d37fe640 1 --2- 172.21.15.39:0/1822343309 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f76c4004370 0x7f76c40147c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:33.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.973+0000 7f76d37fe640 1 -- 172.21.15.39:0/1822343309 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76cc053b90 con 0x7f76c4004e60 2024-05-14T14:40:33.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.973+0000 7f76d3fff640 1 --2- 172.21.15.39:0/1822343309 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f76c4004370 0x7f76c40147c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T14:40:33.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.973+0000 7f76d2ffd640 1 --2- 172.21.15.39:0/1822343309 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76c4003830 0x7f76c4003d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:40:33.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.974+0000 7f4453fff640 1 -- 172.21.15.39:0/3430080806 >> v2:172.21.15.62:3300/0 conn(0x7f444c03c560 msgr2=0x7f444c006400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:33.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.974+0000 7f4453fff640 1 --2- 172.21.15.39:0/3430080806 >> v2:172.21.15.62:3300/0 conn(0x7f444c03c560 0x7f444c006400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:33.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.974+0000 7f4453fff640 1 -- 172.21.15.39:0/3430080806 >> v1:172.21.15.62:6789/0 conn(0x7f444c03c150 legacy=0x7f444c0584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:33.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.974+0000 7f4453fff640 1 -- 172.21.15.39:0/3430080806 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f444c057f80 con 0x7f444c054260 2024-05-14T14:40:33.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.974+0000 7efbfaa0b640 1 -- 172.21.15.39:0/1136977224 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efbec050a40 msgr2=0x7efbec04f330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T14:40:33.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.974+0000 7efbfaa0b640 1 --2- 172.21.15.39:0/1136977224 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efbec050a40 0x7efbec04f330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:33.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.974+0000 7efbfaa0b640 1 -- 172.21.15.39:0/1136977224 >> v1:172.21.15.62:6789/0 conn(0x7efbec050630 legacy=0x7efbec0d98e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T14:40:33.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.974+0000 7efbfaa0b640 1 -- 172.21.15.39:0/1136977224 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbec053870 con 0x7efbec04f870 2024-05-14T14:40:33.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.975+0000 7f76d37fe640 1 --2- 172.21.15.39:0/1822343309 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76c4004e60 0x7f76c40052d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f76cc033e70 tx=0x7f76c4005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9d810f04923c96f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:33.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.975+0000 7f4458d31640 1 --2- 172.21.15.39:0/3430080806 >> v2:172.21.15.62:3300/0 conn(0x7f444c03c560 0x7f444c006400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T14:40:33.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.975+0000 7f4453fff640 1 --2- 172.21.15.39:0/3430080806 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f444c054260 0x7f444c0e7bb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f44480097a0 tx=0x7f4448029fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e7bd9557004569b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:33.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.975+0000 7f76d27fc640 1 -- 172.21.15.39:0/1822343309 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c8007c00 con 0x7f76c4004e60 2024-05-14T14:40:33.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.975+0000 7f76d27fc640 1 -- 172.21.15.39:0/1822343309 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76c802ae50 con 0x7f76c4004e60 2024-05-14T14:40:33.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.975+0000 7f76d27fc640 1 -- 172.21.15.39:0/1822343309 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c8031880 con 0x7f76c4004e60 2024-05-14T14:40:33.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.976+0000 7efbfaa0b640 1 --2- 172.21.15.39:0/1136977224 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbec04f870 0x7efbec0dfe10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7efbf406bd80 tx=0x7efbf406a690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ee17a4e0ecf0f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:33.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.976+0000 7f4452ffd640 1 -- 172.21.15.39:0/3430080806 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4448037070 con 0x7f444c054260 2024-05-14T14:40:33.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.976+0000 7f4452ffd640 1 -- 172.21.15.39:0/3430080806 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f444802ac80 con 0x7f444c054260 2024-05-14T14:40:33.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.976+0000 7f4452ffd640 1 -- 172.21.15.39:0/3430080806 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4448032660 con 0x7f444c054260 2024-05-14T14:40:33.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.976+0000 7f76d9aa7640 1 -- 172.21.15.39:0/1822343309 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76c4004e60 msgr2=0x7f76c40052d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:33.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.976+0000 7f76d9aa7640 1 --2- 172.21.15.39:0/1822343309 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76c4004e60 0x7f76c40052d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f76cc033e70 tx=0x7f76c4005830 comp rx=0 tx=0).stop 2024-05-14T14:40:33.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.976+0000 7f76d3fff640 1 -- 172.21.15.39:0/1822343309 reap_dead start 2024-05-14T14:40:33.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.977+0000 7f76d9aa7640 1 -- 172.21.15.39:0/1822343309 shutdown_connections 2024-05-14T14:40:33.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.977+0000 7f76d9aa7640 1 -- 172.21.15.39:0/1822343309 >> 172.21.15.39:0/1822343309 conn(0x7f76cc054d20 msgr2=0x7f76cc055130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:33.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.977+0000 7f76d9aa7640 1 -- 172.21.15.39:0/1822343309 shutdown_connections 2024-05-14T14:40:33.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.977+0000 7f76d9aa7640 1 -- 172.21.15.39:0/1822343309 wait complete. 2024-05-14T14:40:33.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.977+0000 7f4459532640 1 -- 172.21.15.39:0/3430080806 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f444c054260 msgr2=0x7f444c0e7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:33.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.976+0000 7efbf9208640 1 -- 172.21.15.39:0/1136977224 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf40b4070 con 0x7efbec04f870 2024-05-14T14:40:33.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.976+0000 7efbf9208640 1 -- 172.21.15.39:0/1136977224 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbf40a7d50 con 0x7efbec04f870 2024-05-14T14:40:33.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.976+0000 7efbf9208640 1 -- 172.21.15.39:0/1136977224 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf40af640 con 0x7efbec04f870 2024-05-14T14:40:33.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.977+0000 7efbfb20c640 1 -- 172.21.15.39:0/1136977224 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbec04f870 msgr2=0x7efbec0dfe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:33.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.977+0000 7efbfb20c640 1 --2- 172.21.15.39:0/1136977224 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbec04f870 0x7efbec0dfe10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7efbf406bd80 tx=0x7efbf406a690 comp rx=0 tx=0).stop 2024-05-14T14:40:33.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.977+0000 7f4459532640 1 --2- 172.21.15.39:0/3430080806 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f444c054260 0x7f444c0e7bb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f44480097a0 tx=0x7f4448029fb0 comp rx=0 tx=0).stop 2024-05-14T14:40:33.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.978+0000 7efbfb20c640 1 -- 172.21.15.39:0/1136977224 shutdown_connections 2024-05-14T14:40:33.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.978+0000 7efbfb20c640 1 --2- 172.21.15.39:0/1136977224 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbec04f870 0x7efbec0dfe10 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:33.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.978+0000 7efbfb20c640 1 --2- 172.21.15.39:0/1136977224 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efbec050a40 0x7efbec04f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:33.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.978+0000 7efbfb20c640 1 -- 172.21.15.39:0/1136977224 >> 172.21.15.39:0/1136977224 conn(0x7efbec054ce0 msgr2=0x7efbec0550f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:33.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.978+0000 7f4459532640 1 -- 172.21.15.39:0/3430080806 shutdown_connections 2024-05-14T14:40:33.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.978+0000 7efbfb20c640 1 -- 172.21.15.39:0/1136977224 shutdown_connections 2024-05-14T14:40:33.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.978+0000 7f4459532640 1 --2- 172.21.15.39:0/3430080806 >> v2:172.21.15.62:3300/0 conn(0x7f444c03c560 0x7f444c006400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:33.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.979+0000 7efbfb20c640 1 -- 172.21.15.39:0/1136977224 wait complete. 2024-05-14T14:40:33.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.978+0000 7f4459532640 1 --2- 172.21.15.39:0/3430080806 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f444c054260 0x7f444c0e7bb0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:33.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.978+0000 7f4459532640 1 -- 172.21.15.39:0/3430080806 >> 172.21.15.39:0/3430080806 conn(0x7f444c0563f0 msgr2=0x7f444c059200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:33.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.979+0000 7f4459532640 1 -- 172.21.15.39:0/3430080806 shutdown_connections 2024-05-14T14:40:33.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.981+0000 7f76d9aa7640 1 Processor -- start 2024-05-14T14:40:33.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.981+0000 7f76d9aa7640 1 -- start start 2024-05-14T14:40:33.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.982+0000 7efbfb20c640 1 Processor -- start 2024-05-14T14:40:33.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.979+0000 7f4459532640 1 -- 172.21.15.39:0/3430080806 wait complete. 2024-05-14T14:40:33.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.982+0000 7f4459532640 1 Processor -- start 2024-05-14T14:40:33.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.982+0000 7efbfb20c640 1 -- start start 2024-05-14T14:40:33.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.984+0000 7f76d9aa7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f76c4004e60 0x7f76cc0c60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:33.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.984+0000 7f76d37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f76c4004e60 0x7f76cc0c60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:33.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.984+0000 7f76d37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f76c4004e60 0x7f76cc0c60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48318/0 (socket says 172.21.15.39:48318) 2024-05-14T14:40:33.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.984+0000 7f76d37fe640 1 -- 172.21.15.39:0/2482228323 learned_addr learned my addr 172.21.15.39:0/2482228323 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:33.974 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.982+0000 7f4459532640 1 -- start start 2024-05-14T14:40:33.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.985+0000 7f4459532640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f444c03c150 0x7f444c0e0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:33.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.985+0000 7efbfb20c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbec04f870 0x7efbec0d1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:33.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.985+0000 7f4459532640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f444c03c560 0x7f444c03daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:33.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.985+0000 7f4453fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f444c03c150 0x7f444c0e0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:33.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.985+0000 7f4459532640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f444c054260 0x7f444c03e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:33.975 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.985+0000 7f4453fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f444c03c150 0x7f444c0e0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48330/0 (socket says 172.21.15.39:48330) 2024-05-14T14:40:33.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.985+0000 7f4459532640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f444c057110 con 0x7f444c03c150 2024-05-14T14:40:33.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.985+0000 7f4453fff640 1 -- 172.21.15.39:0/2756063353 learned_addr learned my addr 172.21.15.39:0/2756063353 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:33.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.985+0000 7f4459532640 1 -- 172.21.15.39:0/2756063353 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f444c056f90 con 0x7f444c054260 2024-05-14T14:40:33.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.985+0000 7f4459532640 1 -- 172.21.15.39:0/2756063353 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f444c058bb0 con 0x7f444c03c560 2024-05-14T14:40:33.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.985+0000 7f76d9aa7640 1 --2- 172.21.15.39:0/2482228323 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76cc0c7be0 0x7f76cc0dc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:33.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.985+0000 7f76d9aa7640 1 --2- 172.21.15.39:0/2482228323 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76cc0e2500 0x7f76cc0e2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:33.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.985+0000 7efbfa20a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbec04f870 0x7efbec0d1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:33.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.985+0000 7efbfa20a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbec04f870 0x7efbec0d1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48346/0 (socket says 172.21.15.39:48346) 2024-05-14T14:40:33.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.986+0000 7efbfa20a640 1 -- 172.21.15.39:0/2914727852 learned_addr learned my addr 172.21.15.39:0/2914727852 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:33.977 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.985+0000 7f4458d31640 1 --2- 172.21.15.39:0/2756063353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f444c054260 0x7f444c03e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:33.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.986+0000 7efbfb20c640 1 --2- 172.21.15.39:0/2914727852 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efbec050630 0x7efbec0d2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:33.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.986+0000 7f4458d31640 1 -- 172.21.15.39:0/2756063353 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f444c03c560 msgr2=0x7f444c03daf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-14T14:40:33.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.986+0000 7f4458d31640 1 --2- 172.21.15.39:0/2756063353 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f444c03c560 0x7f444c03daf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:33.978 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.986+0000 7f4458d31640 1 -- 172.21.15.39:0/2756063353 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f444c03c150 msgr2=0x7f444c0e0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:33.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.986+0000 7efbfb20c640 1 --2- 172.21.15.39:0/2914727852 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efbec0d26c0 0x7efbec0d65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:33.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.986+0000 7f4458d31640 1 --2- 172.21.15.39:0/2756063353 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f444c03c150 0x7f444c0e0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:33.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.986+0000 7f4458d31640 1 -- 172.21.15.39:0/2756063353 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f444c0eb320 con 0x7f444c054260 2024-05-14T14:40:33.979 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.986+0000 7f4453fff640 1 --2- 172.21.15.39:0/2756063353 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f444c03c150 0x7f444c0e0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T14:40:33.980 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.986+0000 7efbf9a09640 1 --2- 172.21.15.39:0/2914727852 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efbec050630 0x7efbec0d2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:33.980 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.986+0000 7f76d2ffd640 1 --2- 172.21.15.39:0/2482228323 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76cc0c7be0 0x7f76cc0dc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:33.980 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.986+0000 7f76d9aa7640 1 -- 172.21.15.39:0/2482228323 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f76cc054670 con 0x7f76c4004e60 2024-05-14T14:40:33.980 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.986+0000 7f76d9aa7640 1 -- 172.21.15.39:0/2482228323 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f76cc054150 con 0x7f76cc0c7be0 2024-05-14T14:40:33.980 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.986+0000 7f76d9aa7640 1 -- 172.21.15.39:0/2482228323 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f76cc0daea0 con 0x7f76cc0e2500 2024-05-14T14:40:33.980 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.986+0000 7efbfaa0b640 1 --2- 172.21.15.39:0/2914727852 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efbec0d26c0 0x7efbec0d65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:33.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.986+0000 7f4458d31640 1 --2- 172.21.15.39:0/2756063353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f444c054260 0x7f444c03e030 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4440009fd0 tx=0x7f444000ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:33.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.986+0000 7efbfb20c640 1 -- 172.21.15.39:0/2914727852 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7efbec054110 con 0x7efbec04f870 2024-05-14T14:40:33.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.987+0000 7efbfb20c640 1 -- 172.21.15.39:0/2914727852 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7efbec053e30 con 0x7efbec050630 2024-05-14T14:40:33.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.987+0000 7efbfb20c640 1 -- 172.21.15.39:0/2914727852 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7efbec054630 con 0x7efbec0d26c0 2024-05-14T14:40:33.981 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.987+0000 7efbf9a09640 1 -- 172.21.15.39:0/2914727852 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efbec0d26c0 msgr2=0x7efbec0d65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:33.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.987+0000 7f4450ff9640 1 -- 172.21.15.39:0/2756063353 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4440017070 con 0x7f444c054260 2024-05-14T14:40:33.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.987+0000 7f76d37fe640 1 -- 172.21.15.39:0/2482228323 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76cc0e2500 msgr2=0x7f76cc0e2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:33.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.987+0000 7f76d37fe640 1 --2- 172.21.15.39:0/2482228323 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76cc0e2500 0x7f76cc0e2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:33.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.987+0000 7f76d37fe640 1 -- 172.21.15.39:0/2482228323 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76cc0c7be0 msgr2=0x7f76cc0dc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:33.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.987+0000 7f76d37fe640 1 --2- 172.21.15.39:0/2482228323 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76cc0c7be0 0x7f76cc0dc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:33.982 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.987+0000 7f76d37fe640 1 -- 172.21.15.39:0/2482228323 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76cc0e2e50 con 0x7f76c4004e60 2024-05-14T14:40:33.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.987+0000 7efbf9a09640 1 --2- 172.21.15.39:0/2914727852 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efbec0d26c0 0x7efbec0d65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:33.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.987+0000 7efbf9a09640 1 -- 172.21.15.39:0/2914727852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbec04f870 msgr2=0x7efbec0d1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:33.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.987+0000 7efbf9a09640 1 --2- 172.21.15.39:0/2914727852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbec04f870 0x7efbec0d1c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:33.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.987+0000 7efbf9a09640 1 -- 172.21.15.39:0/2914727852 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbec039cc0 con 0x7efbec050630 2024-05-14T14:40:33.983 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.988+0000 7f4450ff9640 1 -- 172.21.15.39:0/2756063353 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f444000c940 con 0x7f444c054260 2024-05-14T14:40:33.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.988+0000 7f76d37fe640 1 --2- 172.21.15.39:0/2482228323 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f76c4004e60 0x7f76cc0c60f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f76c802ac60 tx=0x7f76c802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:33.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.988+0000 7f4459532640 1 -- 172.21.15.39:0/2756063353 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f444c00a0b0 con 0x7f444c054260 2024-05-14T14:40:33.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.988+0000 7efbf9a09640 1 --2- 172.21.15.39:0/2914727852 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efbec050630 0x7efbec0d2180 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efbf000b440 tx=0x7efbf000b900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:33.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.988+0000 7f4459532640 1 -- 172.21.15.39:0/2756063353 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f444c00bc10 con 0x7f444c054260 2024-05-14T14:40:33.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.988+0000 7f4450ff9640 1 -- 172.21.15.39:0/2756063353 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f444000eea0 con 0x7f444c054260 2024-05-14T14:40:33.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.989+0000 7efbeaffd640 1 -- 172.21.15.39:0/2914727852 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf0015020 con 0x7efbec050630 2024-05-14T14:40:33.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.989+0000 7efbeaffd640 1 -- 172.21.15.39:0/2914727852 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efbf0011850 con 0x7efbec050630 2024-05-14T14:40:33.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.989+0000 7f76bffff640 1 -- 172.21.15.39:0/2482228323 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c80016d0 con 0x7f76c4004e60 2024-05-14T14:40:33.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.989+0000 7f76bffff640 1 -- 172.21.15.39:0/2482228323 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76c8007be0 con 0x7f76c4004e60 2024-05-14T14:40:33.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.990+0000 7efbeaffd640 1 -- 172.21.15.39:0/2914727852 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efbf0011c40 con 0x7efbec050630 2024-05-14T14:40:33.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.991+0000 7f76bffff640 1 -- 172.21.15.39:0/2482228323 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c8005290 con 0x7f76c4004e60 2024-05-14T14:40:33.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.991+0000 7f76d9aa7640 1 -- 172.21.15.39:0/2482228323 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76cc0c6630 con 0x7f76c4004e60 2024-05-14T14:40:33.986 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.991+0000 7f76d9aa7640 1 -- 172.21.15.39:0/2482228323 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76cc0c6e20 con 0x7f76c4004e60 2024-05-14T14:40:33.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.991+0000 7efbfb20c640 1 -- 172.21.15.39:0/2914727852 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efbec033b70 con 0x7efbec050630 2024-05-14T14:40:33.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.991+0000 7efbfb20c640 1 -- 172.21.15.39:0/2914727852 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efbec0ded50 con 0x7efbec050630 2024-05-14T14:40:33.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.991+0000 7f4459532640 1 -- 172.21.15.39:0/2756063353 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4434005290 con 0x7f444c054260 2024-05-14T14:40:33.987 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.993+0000 7efbe8ff9640 1 -- 172.21.15.39:0/2914727852 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efbec005490 con 0x7efbec050630 2024-05-14T14:40:33.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.993+0000 7f76bdffb640 1 -- 172.21.15.39:0/2482228323 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76ac005290 con 0x7f76c4004e60 2024-05-14T14:40:33.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.994+0000 7f76bffff640 1 -- 172.21.15.39:0/2482228323 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f76c80035f0 con 0x7f76c4004e60 2024-05-14T14:40:33.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.995+0000 7f76bffff640 1 --2- 172.21.15.39:0/2482228323 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f76b80763a0 0x7f76b80788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:33.988 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.995+0000 7f76d2ffd640 1 --2- 172.21.15.39:0/2482228323 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f76b80763a0 0x7f76b80788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:33.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.996+0000 7f76d2ffd640 1 --2- 172.21.15.39:0/2482228323 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f76b80763a0 0x7f76b80788b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f76c0004840 tx=0x7f76c0007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:33.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.997+0000 7f76bffff640 1 -- 172.21.15.39:0/2482228323 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f76c80b8340 con 0x7f76c4004e60 2024-05-14T14:40:33.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.994+0000 7f4450ff9640 1 -- 172.21.15.39:0/2756063353 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f444001a070 con 0x7f444c054260 2024-05-14T14:40:33.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.997+0000 7efbeaffd640 1 -- 172.21.15.39:0/2914727852 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efbf0018020 con 0x7efbec050630 2024-05-14T14:40:33.989 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.998+0000 7f4450ff9640 1 --2- 172.21.15.39:0/2756063353 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f44380763a0 0x7f44380788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:33.990 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.998+0000 7efbeaffd640 1 --2- 172.21.15.39:0/2914727852 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7efbd80763d0 0x7efbd80788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:33.990 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.998+0000 7efbeaffd640 1 -- 172.21.15.39:0/2914727852 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7efbf0097bb0 con 0x7efbec050630 2024-05-14T14:40:33.990 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.998+0000 7f4450ff9640 1 -- 172.21.15.39:0/2756063353 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f44400975e0 con 0x7f444c054260 2024-05-14T14:40:33.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.999+0000 7efbfa20a640 1 --2- 172.21.15.39:0/2914727852 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7efbd80763d0 0x7efbd80788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:33.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.000+0000 7efbeaffd640 1 -- 172.21.15.39:0/2914727852 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7efbf001f020 con 0x7efbec050630 2024-05-14T14:40:33.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:33.999+0000 7f4453fff640 1 --2- 172.21.15.39:0/2756063353 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f44380763a0 0x7f44380788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:33.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.000+0000 7f4453fff640 1 --2- 172.21.15.39:0/2756063353 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f44380763a0 0x7f44380788b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4448009560 tx=0x7f444802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:33.991 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.000+0000 7efbfa20a640 1 --2- 172.21.15.39:0/2914727852 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7efbd80763d0 0x7efbd80788e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efbe4009960 tx=0x7efbe40090e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:33.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.005+0000 7f4450ff9640 1 -- 172.21.15.39:0/2756063353 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4440060590 con 0x7f444c054260 2024-05-14T14:40:33.992 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.004+0000 7f76bffff640 1 -- 172.21.15.39:0/2482228323 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f76cc0e2e50 con 0x7f76c4004e60 2024-05-14T14:40:34.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.028+0000 7f5b5297d640 1 Processor -- start 2024-05-14T14:40:34.012 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.028+0000 7f5b5297d640 1 -- start start 2024-05-14T14:40:34.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.030+0000 7f8ffc376640 1 Processor -- start 2024-05-14T14:40:34.015 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.030+0000 7f8ffc376640 1 -- start start 2024-05-14T14:40:34.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.032+0000 7f5b5297d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5b4c06c6a0 0x7f5b4c0d12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.032+0000 7f5b5297d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5b4c0d1820 0x7f5b4c0b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.016 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.032+0000 7f5b5297d640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b4c0b3450 con 0x7f5b4c0b76b0 2024-05-14T14:40:34.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.032+0000 7f5b5297d640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f5b4c160800 con 0x7f5b4c0d1820 2024-05-14T14:40:34.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.032+0000 7f5b5297d640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f5b4c0b39f0 con 0x7f5b4c06c6a0 2024-05-14T14:40:34.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.033+0000 7f5b4bfff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f5b4c0b76b0 0x7f5b4c0d2a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.39:57024/0 (socket says 172.21.15.39:57024) 2024-05-14T14:40:34.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.030+0000 7f2be2a84640 1 Processor -- start 2024-05-14T14:40:34.017 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.031+0000 7f2be2a84640 1 -- start start 2024-05-14T14:40:34.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.033+0000 7f5b4bfff640 1 -- 172.21.15.39:0/1546719004 learned_addr learned my addr 172.21.15.39:0/1546719004 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:34.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.033+0000 7f5b50f1a640 1 --2- 172.21.15.39:0/1546719004 >> v2:172.21.15.62:3300/0 conn(0x7f5b4c0d1820 0x7f5b4c0b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:34.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.033+0000 7f8ffc376640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8ff40b23f0 0x7f8ff40d1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.033+0000 7f8ffc376640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8ff41615f0 0x7f8ff40cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.033+0000 7f8ffc376640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f8ff40cfd50 0x7f8ff415c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.018 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.033+0000 7f8ffc376640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f8ff40d38d0 con 0x7f8ff40cfd50 2024-05-14T14:40:34.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.033+0000 7f8ffc376640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f8ff40d0160 con 0x7f8ff40b23f0 2024-05-14T14:40:34.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.033+0000 7f8ffc376640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f8ff40d2870 con 0x7f8ff41615f0 2024-05-14T14:40:34.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.033+0000 7f8ffa913640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f8ff40cfd50 0x7f8ff415c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:34.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.033+0000 7f8ffa913640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f8ff40cfd50 0x7f8ff415c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48360/0 (socket says 172.21.15.39:48360) 2024-05-14T14:40:34.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.033+0000 7f8ffa913640 1 -- 172.21.15.39:0/2573667787 learned_addr learned my addr 172.21.15.39:0/2573667787 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:34.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.033+0000 7f8ffa112640 1 --2- 172.21.15.39:0/2573667787 >> v2:172.21.15.62:3300/0 conn(0x7f8ff40b23f0 0x7f8ff40d1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:34.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.033+0000 7f8ff9911640 1 --2- 172.21.15.39:0/2573667787 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8ff41615f0 0x7f8ff40cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:34.019 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.033+0000 7f2be2a84640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f2bdc0b23f0 0x7f2bdc0d1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.034+0000 7f5b4b7fe640 1 --2- 172.21.15.39:0/1546719004 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5b4c06c6a0 0x7f5b4c0d12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:34.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.033+0000 7f2be2a84640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bdc0d2870 con 0x7f2bdc0cff20 2024-05-14T14:40:34.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.033+0000 7f2be2a84640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bdc0d2b10 con 0x7f2bdc1615f0 2024-05-14T14:40:34.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.033+0000 7f2be2a84640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f2bdc0d38d0 con 0x7f2bdc0b23f0 2024-05-14T14:40:34.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.033+0000 7f2be1021640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f2bdc0cff20 0x7f2bdc15c680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:56370/0 (socket says 172.21.15.39:56370) 2024-05-14T14:40:34.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.034+0000 7f8ffa112640 1 -- 172.21.15.39:0/2573667787 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8ff41615f0 msgr2=0x7f8ff40cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:34.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.034+0000 7f8ffa112640 1 --2- 172.21.15.39:0/2573667787 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8ff41615f0 0x7f8ff40cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.034+0000 7f8ffa112640 1 -- 172.21.15.39:0/2573667787 >> v2:172.21.15.39:3300/0 conn(0x7f8ff40cfd50 msgr2=0x7f8ff415c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:34.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.034+0000 7f8ffa112640 1 --2- 172.21.15.39:0/2573667787 >> v2:172.21.15.39:3300/0 conn(0x7f8ff40cfd50 0x7f8ff415c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.034+0000 7f8ffa112640 1 -- 172.21.15.39:0/2573667787 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff40d2b10 con 0x7f8ff40b23f0 2024-05-14T14:40:34.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.033+0000 7f2be1021640 1 -- 172.21.15.39:0/973698343 learned_addr learned my addr 172.21.15.39:0/973698343 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:34.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.034+0000 7f5b50f1a640 1 -- 172.21.15.39:0/1546719004 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5b4c06c6a0 msgr2=0x7f5b4c0d12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:34.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.034+0000 7f5b50f1a640 1 --2- 172.21.15.39:0/1546719004 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5b4c06c6a0 0x7f5b4c0d12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.034+0000 7f5b50f1a640 1 -- 172.21.15.39:0/1546719004 >> v1:172.21.15.62:6789/0 conn(0x7f5b4c0b76b0 legacy=0x7f5b4c0d2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:34.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.034+0000 7f2be0820640 1 --2- 172.21.15.39:0/973698343 >> v2:172.21.15.39:3300/0 conn(0x7f2bdc0b23f0 0x7f2bdc0d1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:34.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.035+0000 7f2bdb7fe640 1 -- 172.21.15.39:0/973698343 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4264789059 0 0) 0x7f2bdc0d2b10 con 0x7f2bdc1615f0 2024-05-14T14:40:34.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.035+0000 7f2bdb7fe640 1 -- 172.21.15.39:0/973698343 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bc4003520 con 0x7f2bdc1615f0 2024-05-14T14:40:34.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.035+0000 7f2bdb7fe640 1 -- 172.21.15.39:0/973698343 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2367592913 0 0) 0x7f2bdc0d2870 con 0x7f2bdc0cff20 2024-05-14T14:40:34.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.035+0000 7f2bdb7fe640 1 -- 172.21.15.39:0/973698343 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bdc0d2b10 con 0x7f2bdc0cff20 2024-05-14T14:40:34.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.034+0000 7f5b50f1a640 1 -- 172.21.15.39:0/1546719004 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b4c06cab0 con 0x7f5b4c0d1820 2024-05-14T14:40:34.023 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.035+0000 7f8ffa112640 1 --2- 172.21.15.39:0/2573667787 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ff40b23f0 0x7f8ff40d1f00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4075610 tx=0x7f8ff002e490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a573ffde2f82827 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:34.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.035+0000 7f2be0820640 1 -- 172.21.15.39:0/973698343 >> v1:172.21.15.62:6789/0 conn(0x7f2bdc1615f0 legacy=0x7f2bdc0cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:34.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.035+0000 7f2be0820640 1 -- 172.21.15.39:0/973698343 >> v1:172.21.15.39:6789/0 conn(0x7f2bdc0cff20 legacy=0x7f2bdc15c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:34.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.035+0000 7f5b50f1a640 1 --2- 172.21.15.39:0/1546719004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b4c0d1820 0x7f5b4c0b1d70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5b44009d90 tx=0x7f5b4402a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=704b77a3140ab98c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:34.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.035+0000 7f2be0820640 1 -- 172.21.15.39:0/973698343 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bdc0d2df0 con 0x7f2bdc0b23f0 2024-05-14T14:40:34.024 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.035+0000 7f8ff9110640 1 -- 172.21.15.39:0/2573667787 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff003a070 con 0x7f8ff40b23f0 2024-05-14T14:40:34.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.035+0000 7fe091bee640 1 Processor -- start 2024-05-14T14:40:34.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.035+0000 7f8ff9110640 1 -- 172.21.15.39:0/2573667787 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ff0033710 con 0x7f8ff40b23f0 2024-05-14T14:40:34.025 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.035+0000 7f5b4affd640 1 -- 172.21.15.39:0/1546719004 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b44031600 con 0x7f5b4c0d1820 2024-05-14T14:40:34.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.035+0000 7f8ff9110640 1 -- 172.21.15.39:0/2573667787 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff0033ae0 con 0x7f8ff40b23f0 2024-05-14T14:40:34.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.037+0000 7f2be0820640 1 --2- 172.21.15.39:0/973698343 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2bdc0b23f0 0x7f2bdc0d1f00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2bd00097a0 tx=0x7f2bd002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8d3df14587d482 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:34.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.036+0000 7fc3eaacb640 1 Processor -- start 2024-05-14T14:40:34.026 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.036+0000 7fc3eaacb640 1 -- start start 2024-05-14T14:40:34.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.036+0000 7f5b4affd640 1 -- 172.21.15.39:0/1546719004 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b440317a0 con 0x7f5b4c0d1820 2024-05-14T14:40:34.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.037+0000 7f5b5297d640 1 -- 172.21.15.39:0/1546719004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b4c0d1820 msgr2=0x7f5b4c0b1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:34.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.037+0000 7f5b5297d640 1 --2- 172.21.15.39:0/1546719004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b4c0d1820 0x7f5b4c0b1d70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5b44009d90 tx=0x7f5b4402a5d0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.036+0000 7fe091bee640 1 -- start start 2024-05-14T14:40:34.027 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.037+0000 7f8ffc376640 1 -- 172.21.15.39:0/2573667787 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ff40b23f0 msgr2=0x7f8ff40d1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:34.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.037+0000 7f5b5297d640 1 -- 172.21.15.39:0/1546719004 shutdown_connections 2024-05-14T14:40:34.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.037+0000 7f5b5297d640 1 --2- 172.21.15.39:0/1546719004 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b4c0d1820 0x7f5b4c0b1d70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.037+0000 7f5b5297d640 1 --2- 172.21.15.39:0/1546719004 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5b4c06c6a0 0x7f5b4c0d12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.037+0000 7f5b5297d640 1 -- 172.21.15.39:0/1546719004 >> 172.21.15.39:0/1546719004 conn(0x7f5b4c09b5f0 msgr2=0x7f5b4c0b6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:34.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.037+0000 7f2bdb7fe640 1 -- 172.21.15.39:0/973698343 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd0037070 con 0x7f2bdc0b23f0 2024-05-14T14:40:34.028 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.037+0000 7f8ffc376640 1 --2- 172.21.15.39:0/2573667787 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ff40b23f0 0x7f8ff40d1f00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4075610 tx=0x7f8ff002e490 comp rx=0 tx=0).stop 2024-05-14T14:40:34.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.037+0000 7f2bdb7fe640 1 -- 172.21.15.39:0/973698343 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bd002ae50 con 0x7f2bdc0b23f0 2024-05-14T14:40:34.029 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.037+0000 7f2bdb7fe640 1 -- 172.21.15.39:0/973698343 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd0032660 con 0x7f2bdc0b23f0 2024-05-14T14:40:34.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.038+0000 7f8ffc376640 1 -- 172.21.15.39:0/2573667787 shutdown_connections 2024-05-14T14:40:34.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.038+0000 7f8ffc376640 1 --2- 172.21.15.39:0/2573667787 >> v2:172.21.15.39:3300/0 conn(0x7f8ff40cfd50 0x7f8ff415c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.038+0000 7f8ffc376640 1 --2- 172.21.15.39:0/2573667787 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8ff41615f0 0x7f8ff40cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.038+0000 7f8ffc376640 1 --2- 172.21.15.39:0/2573667787 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ff40b23f0 0x7f8ff40d1f00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.038+0000 7f8ffc376640 1 -- 172.21.15.39:0/2573667787 >> 172.21.15.39:0/2573667787 conn(0x7f8ff40b7740 msgr2=0x7f8ff40b7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:34.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.038+0000 7f5b5297d640 1 -- 172.21.15.39:0/1546719004 shutdown_connections 2024-05-14T14:40:34.030 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.038+0000 7f5b5297d640 1 -- 172.21.15.39:0/1546719004 wait complete. 2024-05-14T14:40:34.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.038+0000 7f8ffc376640 1 -- 172.21.15.39:0/2573667787 shutdown_connections 2024-05-14T14:40:34.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.038+0000 7fe08b7fe640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fe08c0d2a00 0x7fe08c0d19f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:56384/0 (socket says 172.21.15.39:56384) 2024-05-14T14:40:34.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.039+0000 7fc3eaacb640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fc3e413f170 0x7fc3e415d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.039+0000 7fc3eaacb640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3e413f580 con 0x7fc3e4070d40 2024-05-14T14:40:34.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.038+0000 7fe08b7fe640 1 -- 172.21.15.39:0/3984631602 learned_addr learned my addr 172.21.15.39:0/3984631602 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:34.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.039+0000 7f2be2a84640 1 -- 172.21.15.39:0/973698343 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2bdc0b23f0 msgr2=0x7f2bdc0d1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:34.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.039+0000 7f2be2a84640 1 --2- 172.21.15.39:0/973698343 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2bdc0b23f0 0x7f2bdc0d1f00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2bd00097a0 tx=0x7f2bd002a100 comp rx=0 tx=0).stop 2024-05-14T14:40:34.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.039+0000 7fc3eaacb640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3e4160190 con 0x7fc3e415fc90 2024-05-14T14:40:34.032 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.039+0000 7fe091bee640 1 --2- 172.21.15.39:0/3984631602 >> v2:172.21.15.62:3300/0 conn(0x7fe08c0d2100 0x7fe08c160010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.039+0000 7fc3eaacb640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fc3e40d0950 con 0x7fc3e413f170 2024-05-14T14:40:34.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.039+0000 7fe091bee640 1 -- 172.21.15.39:0/3984631602 --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe08c0d3d80 con 0x7fe08c0d2a00 2024-05-14T14:40:34.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.039+0000 7f2be2a84640 1 -- 172.21.15.39:0/973698343 shutdown_connections 2024-05-14T14:40:34.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.039+0000 7f2be2a84640 1 --2- 172.21.15.39:0/973698343 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2bdc0b23f0 0x7f2bdc0d1f00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.039+0000 7f2be2a84640 1 -- 172.21.15.39:0/973698343 >> 172.21.15.39:0/973698343 conn(0x7f2bdc0b7740 msgr2=0x7f2bdc0b7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:34.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.039+0000 7f2be2a84640 1 -- 172.21.15.39:0/973698343 shutdown_connections 2024-05-14T14:40:34.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.039+0000 7fe08a7fc640 1 -- 172.21.15.39:0/3984631602 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3622048153 0 0) 0x7fe08c0d3d80 con 0x7fe08c0d2a00 2024-05-14T14:40:34.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.039+0000 7fe091bee640 1 -- 172.21.15.39:0/3984631602 --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe08c0b9b60 con 0x7fe08c0d52d0 2024-05-14T14:40:34.034 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.039+0000 7fe091bee640 1 -- 172.21.15.39:0/3984631602 --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fe08c160550 con 0x7fe08c0d2100 2024-05-14T14:40:34.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.039+0000 7fc3e92c8640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fc3e4070d40 0x7fc3e40cf690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:56398/0 (socket says 172.21.15.39:56398) 2024-05-14T14:40:34.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.039+0000 7fc3e92c8640 1 -- 172.21.15.39:0/1209703274 learned_addr learned my addr 172.21.15.39:0/1209703274 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:34.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.040+0000 7fe08a7fc640 1 -- 172.21.15.39:0/3984631602 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe07c003520 con 0x7fe08c0d2a00 2024-05-14T14:40:34.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.040+0000 7fe08affd640 1 --2- 172.21.15.39:0/3984631602 >> v2:172.21.15.62:3300/0 conn(0x7fe08c0d2100 0x7fe08c160010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:34.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.041+0000 7fc3ea2ca640 1 --2- 172.21.15.39:0/1209703274 >> v2:172.21.15.39:3300/0 conn(0x7fc3e413f170 0x7fc3e415d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:34.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.041+0000 7fc3e8ac7640 1 -- 172.21.15.39:0/1209703274 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1466928582 0 0) 0x7fc3e4160190 con 0x7fc3e415fc90 2024-05-14T14:40:34.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.041+0000 7fc3e8ac7640 1 -- 172.21.15.39:0/1209703274 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3d0003520 con 0x7fc3e415fc90 2024-05-14T14:40:34.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.040+0000 7fe08a7fc640 1 -- 172.21.15.39:0/3984631602 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3946883786 0 0) 0x7fe07c003520 con 0x7fe08c0d2a00 2024-05-14T14:40:34.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.040+0000 7fe08a7fc640 1 -- 172.21.15.39:0/3984631602 >> v2:172.21.15.62:3300/0 conn(0x7fe08c0d2100 msgr2=0x7fe08c160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:34.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.040+0000 7fe08a7fc640 1 --2- 172.21.15.39:0/3984631602 >> v2:172.21.15.62:3300/0 conn(0x7fe08c0d2100 0x7fe08c160010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.040+0000 7fe08a7fc640 1 -- 172.21.15.39:0/3984631602 >> v1:172.21.15.62:6789/0 conn(0x7fe08c0d52d0 legacy=0x7fe08c06c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:34.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.040+0000 7fe08a7fc640 1 -- 172.21.15.39:0/3984631602 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe08c0b9e40 con 0x7fe08c0d2a00 2024-05-14T14:40:34.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.040+0000 7fe08a7fc640 1 -- 172.21.15.39:0/3984631602 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1803005051 0 0) 0x7fe0800016f0 con 0x7fe08c0d2a00 2024-05-14T14:40:34.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.040+0000 7fe08a7fc640 1 -- 172.21.15.39:0/3984631602 >> v1:172.21.15.39:6789/0 conn(0x7fe08c0d2a00 legacy=0x7fe08c0d19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:34.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.040+0000 7fe08a7fc640 1 --2- 172.21.15.39:0/3984631602 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe07c003ac0 0x7fe07c003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.040+0000 7fe08a7fc640 1 --2- 172.21.15.39:0/3984631602 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe07c004800 0x7fe07c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.040+0000 7fe08a7fc640 1 --2- 172.21.15.39:0/3984631602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe07c0053f0 0x7fe07c00ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.040+0000 7fe08a7fc640 1 -- 172.21.15.39:0/3984631602 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe08c160550 con 0x7fe07c003ac0 2024-05-14T14:40:34.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.040+0000 7fe08a7fc640 1 -- 172.21.15.39:0/3984631602 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe07c00c360 con 0x7fe07c0053f0 2024-05-14T14:40:34.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.040+0000 7fe08a7fc640 1 -- 172.21.15.39:0/3984631602 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe07c00c560 con 0x7fe07c004800 2024-05-14T14:40:34.037 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.041+0000 7fe08bfff640 1 --2- 172.21.15.39:0/3984631602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe07c0053f0 0x7fe07c00ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:34.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.041+0000 7fc3e8ac7640 1 -- 172.21.15.39:0/1209703274 <== mon.1 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3080674186 0 0) 0x7fc3d0003520 con 0x7fc3e415fc90 2024-05-14T14:40:34.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.041+0000 7fc3e8ac7640 1 -- 172.21.15.39:0/1209703274 >> v2:172.21.15.39:3300/0 conn(0x7fc3e413f170 msgr2=0x7fc3e415d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:34.038 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.041+0000 7fc3e8ac7640 1 --2- 172.21.15.39:0/1209703274 >> v2:172.21.15.39:3300/0 conn(0x7fc3e413f170 0x7fc3e415d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.041+0000 7fe08b7fe640 1 --2- 172.21.15.39:0/3984631602 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe07c003ac0 0x7fe07c003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:34.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.041+0000 7fc3e8ac7640 1 -- 172.21.15.39:0/1209703274 >> v1:172.21.15.39:6789/0 conn(0x7fc3e4070d40 legacy=0x7fc3e40cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:34.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.039+0000 7f2be2a84640 1 -- 172.21.15.39:0/973698343 wait complete. 2024-05-14T14:40:34.039 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.042+0000 7fe08bfff640 1 -- 172.21.15.39:0/3984631602 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe07c004800 msgr2=0x7fe07c004c10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T14:40:34.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.042+0000 7f2be2a84640 1 Processor -- start 2024-05-14T14:40:34.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.042+0000 7fe08bfff640 1 --2- 172.21.15.39:0/3984631602 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe07c004800 0x7fe07c004c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.042+0000 7fe08bfff640 1 -- 172.21.15.39:0/3984631602 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe07c003ac0 msgr2=0x7fe07c003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:34.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.042+0000 7fe08bfff640 1 --2- 172.21.15.39:0/3984631602 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe07c003ac0 0x7fe07c003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.042+0000 7fe08bfff640 1 -- 172.21.15.39:0/3984631602 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe08c0b9e40 con 0x7fe07c0053f0 2024-05-14T14:40:34.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.043+0000 7fc3e8ac7640 1 -- 172.21.15.39:0/1209703274 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3e4160470 con 0x7fc3e415fc90 2024-05-14T14:40:34.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.042+0000 7fe08b7fe640 1 --2- 172.21.15.39:0/3984631602 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe07c003ac0 0x7fe07c003f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:40:34.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.043+0000 7fe08bfff640 1 -- 172.21.15.39:0/3984631602 reap_dead start 2024-05-14T14:40:34.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.043+0000 7fc3e8ac7640 1 -- 172.21.15.39:0/1209703274 <== mon.1 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1803005051 0 0) 0x7fc3e00016f0 con 0x7fc3e415fc90 2024-05-14T14:40:34.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.043+0000 7fc3e8ac7640 1 -- 172.21.15.39:0/1209703274 >> v1:172.21.15.62:6789/0 conn(0x7fc3e415fc90 legacy=0x7fc3e4070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:34.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.043+0000 7fe08bfff640 1 --2- 172.21.15.39:0/3984631602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe07c0053f0 0x7fe07c00ba80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe078001760 tx=0x7fe07c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d9b09fb84ef12e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:34.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.043+0000 7fe08a7fc640 1 -- 172.21.15.39:0/3984631602 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0780013b0 con 0x7fe07c0053f0 2024-05-14T14:40:34.042 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.043+0000 7fe08a7fc640 1 -- 172.21.15.39:0/3984631602 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0780052d0 con 0x7fe07c0053f0 2024-05-14T14:40:34.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.044+0000 7fc3e8ac7640 1 --2- 172.21.15.39:0/1209703274 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3d0003a70 0x7fc3d0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.043 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.041+0000 7f5b5297d640 1 Processor -- start 2024-05-14T14:40:34.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.038+0000 7f8ffc376640 1 -- 172.21.15.39:0/2573667787 wait complete. 2024-05-14T14:40:34.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.041+0000 7f8ffc376640 1 Processor -- start 2024-05-14T14:40:34.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.041+0000 7f8ffc376640 1 -- start start 2024-05-14T14:40:34.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.043+0000 7f8ffc376640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ff40b23f0 0x7f8ff40897b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.044+0000 7f8ffc376640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8ff40cfd50 0x7f8ff414e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.044+0000 7f8ffc376640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8ff41615f0 0x7f8ff414e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.044+0000 7f8ffc376640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff40d33b0 con 0x7f8ff41615f0 2024-05-14T14:40:34.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.044+0000 7f8ffc376640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff40d30d0 con 0x7f8ff40b23f0 2024-05-14T14:40:34.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.041+0000 7f5b5297d640 1 -- start start 2024-05-14T14:40:34.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.044+0000 7f8ffc376640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f8ff4161a00 con 0x7f8ff40cfd50 2024-05-14T14:40:34.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.044+0000 7f8ffa913640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8ff41615f0 0x7f8ff414e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:34.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.044+0000 7f8ffa913640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8ff41615f0 0x7f8ff414e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48394/0 (socket says 172.21.15.39:48394) 2024-05-14T14:40:34.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.044+0000 7f8ffa913640 1 -- 172.21.15.39:0/278906370 learned_addr learned my addr 172.21.15.39:0/278906370 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:34.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.043+0000 7f5b5297d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b4c06c6a0 0x7f5b4c153da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.043+0000 7fe08a7fc640 1 -- 172.21.15.39:0/3984631602 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07802aaa0 con 0x7fe07c0053f0 2024-05-14T14:40:34.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.043+0000 7f5b5297d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5b4c0b76b0 0x7f5b4c154a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.043+0000 7f5b5297d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b4c0d1820 0x7f5b4c0ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.043+0000 7f5b5297d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5b4c0d1c30 con 0x7f5b4c06c6a0 2024-05-14T14:40:34.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.044+0000 7f5b5297d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5b4c0b1570 con 0x7f5b4c0d1820 2024-05-14T14:40:34.046 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.044+0000 7f5b5297d640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f5b4c0b22b0 con 0x7f5b4c0b76b0 2024-05-14T14:40:34.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.044+0000 7fc3e8ac7640 1 --2- 172.21.15.39:0/1209703274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3d0004800 0x7fc3d0004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.044+0000 7f5b4b7fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5b4c0b76b0 0x7f5b4c154a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:34.047 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.044+0000 7fc3e9ac9640 1 --2- 172.21.15.39:0/1209703274 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3d0003a70 0x7fc3d0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:34.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.044+0000 7f5b4b7fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5b4c0b76b0 0x7f5b4c154a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.39:41970/0 (socket says 172.21.15.39:41970) 2024-05-14T14:40:34.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.045+0000 7fc3e8ac7640 1 --2- 172.21.15.39:0/1209703274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3d0005350 0x7fc3d000cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.045+0000 7fc3e92c8640 1 --2- 172.21.15.39:0/1209703274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3d0004800 0x7fc3d0004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:34.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.044+0000 7f5b4b7fe640 1 -- 172.21.15.39:0/3975830278 learned_addr learned my addr 172.21.15.39:0/3975830278 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:34.048 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.044+0000 7f5b4bfff640 1 --2- 172.21.15.39:0/3975830278 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b4c06c6a0 0x7f5b4c153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:34.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.045+0000 7fc3e8ac7640 1 -- 172.21.15.39:0/1209703274 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d000d330 con 0x7fc3d0005350 2024-05-14T14:40:34.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.045+0000 7fc3e8ac7640 1 -- 172.21.15.39:0/1209703274 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d000d4e0 con 0x7fc3d0004800 2024-05-14T14:40:34.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.045+0000 7fe091bee640 1 -- 172.21.15.39:0/3984631602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe07c0053f0 msgr2=0x7fe07c00ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:34.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.045+0000 7fe091bee640 1 --2- 172.21.15.39:0/3984631602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe07c0053f0 0x7fe07c00ba80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe078001760 tx=0x7fe07c005830 comp rx=0 tx=0).stop 2024-05-14T14:40:34.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.045+0000 7fe091bee640 1 -- 172.21.15.39:0/3984631602 shutdown_connections 2024-05-14T14:40:34.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.045+0000 7fe091bee640 1 --2- 172.21.15.39:0/3984631602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe07c0053f0 0x7fe07c00ba80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.045+0000 7fe091bee640 1 -- 172.21.15.39:0/3984631602 >> 172.21.15.39:0/3984631602 conn(0x7fe08c0d5b50 msgr2=0x7fe08c0d5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:34.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.042+0000 7f2be2a84640 1 -- start start 2024-05-14T14:40:34.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.045+0000 7f5b4bfff640 1 -- 172.21.15.39:0/3975830278 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5b4c0b76b0 msgr2=0x7f5b4c154a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:34.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.045+0000 7f5b4bfff640 1 --2- 172.21.15.39:0/3975830278 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5b4c0b76b0 0x7f5b4c154a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.045+0000 7f5b4bfff640 1 -- 172.21.15.39:0/3975830278 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b4c0d1820 msgr2=0x7f5b4c0ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:34.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.045+0000 7f5b4bfff640 1 --2- 172.21.15.39:0/3975830278 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b4c0d1820 0x7f5b4c0ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.045+0000 7f5b4bfff640 1 -- 172.21.15.39:0/3975830278 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b4c1526b0 con 0x7f5b4c06c6a0 2024-05-14T14:40:34.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.045+0000 7f2be2a84640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2bdc0b23f0 0x7f2bdc203bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.045+0000 7f2be2a84640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2bdc1615f0 0x7f2bdc0afef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.045+0000 7fc3e8ac7640 1 -- 172.21.15.39:0/1209703274 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc3d000d6e0 con 0x7fc3d0003a70 2024-05-14T14:40:34.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.045+0000 7fc3ea2ca640 1 --2- 172.21.15.39:0/1209703274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3d0005350 0x7fc3d000cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:34.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.045+0000 7fe091bee640 1 -- 172.21.15.39:0/3984631602 shutdown_connections 2024-05-14T14:40:34.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.045+0000 7fe091bee640 1 -- 172.21.15.39:0/3984631602 wait complete. 2024-05-14T14:40:34.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.045+0000 7f2be2a84640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2bdc202d20 0x7f2bdc0b0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.045+0000 7f2bdbfff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2bdc1615f0 0x7f2bdc0afef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:34.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.045+0000 7f2bdbfff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2bdc1615f0 0x7f2bdc0afef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.39:42008/0 (socket says 172.21.15.39:42008) 2024-05-14T14:40:34.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.045+0000 7f5b4bfff640 1 --2- 172.21.15.39:0/3975830278 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b4c06c6a0 0x7f5b4c153da0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5b4000b410 tx=0x7f5b4000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:34.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.045+0000 7f8ffa913640 1 -- 172.21.15.39:0/278906370 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8ff40cfd50 msgr2=0x7f8ff414e2c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-14T14:40:34.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.045+0000 7f8ffa913640 1 --2- 172.21.15.39:0/278906370 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8ff40cfd50 0x7f8ff414e2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.045+0000 7f8ffa913640 1 -- 172.21.15.39:0/278906370 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ff40b23f0 msgr2=0x7f8ff40897b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-14T14:40:34.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.045+0000 7f8ffa913640 1 --2- 172.21.15.39:0/278906370 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ff40b23f0 0x7f8ff40897b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.045+0000 7f8ffa913640 1 -- 172.21.15.39:0/278906370 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff414f060 con 0x7f8ff41615f0 2024-05-14T14:40:34.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.046+0000 7f2bdbfff640 1 -- 172.21.15.39:0/3542602944 learned_addr learned my addr 172.21.15.39:0/3542602944 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:34.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.046+0000 7f2be2a84640 1 -- 172.21.15.39:0/3542602944 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2bdc161a00 con 0x7f2bdc202d20 2024-05-14T14:40:34.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.046+0000 7f2be2a84640 1 -- 172.21.15.39:0/3542602944 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2bdc0d33b0 con 0x7f2bdc0b23f0 2024-05-14T14:40:34.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.046+0000 7f2be2a84640 1 -- 172.21.15.39:0/3542602944 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f2bdc161b80 con 0x7f2bdc1615f0 2024-05-14T14:40:34.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.046+0000 7f2be1021640 1 --2- 172.21.15.39:0/3542602944 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2bdc202d20 0x7f2bdc0b0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:34.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.046+0000 7f5b48ff9640 1 -- 172.21.15.39:0/3975830278 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b40015020 con 0x7f5b4c06c6a0 2024-05-14T14:40:34.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.046+0000 7f5b48ff9640 1 -- 172.21.15.39:0/3975830278 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b40011850 con 0x7f5b4c06c6a0 2024-05-14T14:40:34.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.046+0000 7f5b48ff9640 1 -- 172.21.15.39:0/3975830278 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b40011c80 con 0x7f5b4c06c6a0 2024-05-14T14:40:34.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.046+0000 7fc3e9ac9640 1 -- 172.21.15.39:0/1209703274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3d0004800 msgr2=0x7fc3d0004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:34.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.046+0000 7fc3e9ac9640 1 --2- 172.21.15.39:0/1209703274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3d0004800 0x7fc3d0004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.046+0000 7fc3e9ac9640 1 -- 172.21.15.39:0/1209703274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3d0005350 msgr2=0x7fc3d000cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:34.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.046+0000 7fc3e9ac9640 1 --2- 172.21.15.39:0/1209703274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3d0005350 0x7fc3d000cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.046+0000 7fc3e9ac9640 1 -- 172.21.15.39:0/1209703274 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d0003520 con 0x7fc3d0003a70 2024-05-14T14:40:34.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.046+0000 7fc3ea2ca640 1 --2- 172.21.15.39:0/1209703274 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3d0005350 0x7fc3d000cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:40:34.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.046+0000 7fc3ea2ca640 1 -- 172.21.15.39:0/1209703274 reap_dead start 2024-05-14T14:40:34.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.047+0000 7f5b5297d640 1 -- 172.21.15.39:0/3975830278 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b4c152990 con 0x7f5b4c06c6a0 2024-05-14T14:40:34.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.047+0000 7f5b5297d640 1 -- 172.21.15.39:0/3975830278 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b4c152f50 con 0x7f5b4c06c6a0 2024-05-14T14:40:34.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.047+0000 7f8ffa913640 1 --2- 172.21.15.39:0/278906370 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8ff41615f0 0x7f8ff414e800 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8fec00eaf0 tx=0x7f8fec00b0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:34.057 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.047+0000 7fc3e9ac9640 1 --2- 172.21.15.39:0/1209703274 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3d0003a70 0x7fc3d0003ea0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc3e40d1640 tx=0x7fc3d0005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7cddcf77998565d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:34.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.047+0000 7f2be1021640 1 -- 172.21.15.39:0/3542602944 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2bdc1615f0 msgr2=0x7f2bdc0afef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:34.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.047+0000 7f2be1021640 1 --2- 172.21.15.39:0/3542602944 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2bdc1615f0 0x7f2bdc0afef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.047+0000 7f2be1021640 1 -- 172.21.15.39:0/3542602944 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2bdc0b23f0 msgr2=0x7f2bdc203bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:34.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.047+0000 7f2be1021640 1 --2- 172.21.15.39:0/3542602944 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2bdc0b23f0 0x7f2bdc203bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.047+0000 7f2be1021640 1 -- 172.21.15.39:0/3542602944 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bdc0c9ae0 con 0x7f2bdc202d20 2024-05-14T14:40:34.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.047+0000 7f2be1021640 1 --2- 172.21.15.39:0/3542602944 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2bdc202d20 0x7f2bdc0b0430 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc0d05b0 tx=0x7f2bd400cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:34.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.047+0000 7fc3e8ac7640 1 -- 172.21.15.39:0/1209703274 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e0003910 con 0x7fc3d0003a70 2024-05-14T14:40:34.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.048+0000 7fc3e8ac7640 1 -- 172.21.15.39:0/1209703274 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3e002f070 con 0x7fc3d0003a70 2024-05-14T14:40:34.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.049+0000 7fe091bee640 1 Processor -- start 2024-05-14T14:40:34.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.048+0000 7fc3e8ac7640 1 -- 172.21.15.39:0/1209703274 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e0004640 con 0x7fc3d0003a70 2024-05-14T14:40:34.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.049+0000 7fc3eaacb640 1 -- 172.21.15.39:0/1209703274 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3d0003a70 msgr2=0x7fc3d0003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:34.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.049+0000 7fc3eaacb640 1 --2- 172.21.15.39:0/1209703274 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3d0003a70 0x7fc3d0003ea0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc3e40d1640 tx=0x7fc3d0005830 comp rx=0 tx=0).stop 2024-05-14T14:40:34.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.049+0000 7fc3eaacb640 1 -- 172.21.15.39:0/1209703274 shutdown_connections 2024-05-14T14:40:34.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.048+0000 7f8feaffd640 1 -- 172.21.15.39:0/278906370 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fec01a070 con 0x7f8ff41615f0 2024-05-14T14:40:34.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.048+0000 7f8ffc376640 1 -- 172.21.15.39:0/278906370 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ff41556a0 con 0x7f8ff41615f0 2024-05-14T14:40:34.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.049+0000 7fc3eaacb640 1 --2- 172.21.15.39:0/1209703274 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3d0003a70 0x7fc3d0003ea0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.049+0000 7fc3eaacb640 1 -- 172.21.15.39:0/1209703274 >> 172.21.15.39:0/1209703274 conn(0x7fc3e40ce0f0 msgr2=0x7fc3e40ce500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:34.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.049+0000 7fe091bee640 1 -- start start 2024-05-14T14:40:34.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.049+0000 7f8feaffd640 1 -- 172.21.15.39:0/278906370 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fec003b90 con 0x7f8ff41615f0 2024-05-14T14:40:34.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.049+0000 7f8ffc376640 1 -- 172.21.15.39:0/278906370 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ff4155c60 con 0x7f8ff41615f0 2024-05-14T14:40:34.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.050+0000 7f8feaffd640 1 -- 172.21.15.39:0/278906370 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fec00b860 con 0x7f8ff41615f0 2024-05-14T14:40:34.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.048+0000 7f2bd97fa640 1 -- 172.21.15.39:0/3542602944 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd400aba0 con 0x7f2bdc202d20 2024-05-14T14:40:34.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.048+0000 7f2bd97fa640 1 -- 172.21.15.39:0/3542602944 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bd400ad40 con 0x7f2bdc202d20 2024-05-14T14:40:34.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.050+0000 7f2bd97fa640 1 -- 172.21.15.39:0/3542602944 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd4012600 con 0x7f2bdc202d20 2024-05-14T14:40:34.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.050+0000 7f5b48ff9640 1 -- 172.21.15.39:0/3975830278 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5b40018020 con 0x7f5b4c06c6a0 2024-05-14T14:40:34.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.051+0000 7f5b48ff9640 1 --2- 172.21.15.39:0/3975830278 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f5b380763a0 0x7f5b380788b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.051+0000 7f2be2a84640 1 -- 172.21.15.39:0/3542602944 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bdc204110 con 0x7f2bdc202d20 2024-05-14T14:40:34.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.051+0000 7f2be2a84640 1 -- 172.21.15.39:0/3542602944 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bdc204a80 con 0x7f2bdc202d20 2024-05-14T14:40:34.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.051+0000 7f5b5297d640 1 -- 172.21.15.39:0/3975830278 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b4c076aa0 con 0x7f5b4c06c6a0 2024-05-14T14:40:34.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.051+0000 7f8feaffd640 1 -- 172.21.15.39:0/278906370 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f8fec01d070 con 0x7f8ff41615f0 2024-05-14T14:40:34.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.051+0000 7f8ffc376640 1 -- 172.21.15.39:0/278906370 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fdc005290 con 0x7f8ff41615f0 2024-05-14T14:40:34.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.052+0000 7fe091bee640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe08c0cda50 0x7fe08c1f5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.052+0000 7fe091bee640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe08c1f92b0 0x7fe08c1f96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.052+0000 7fe091bee640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe08c0cbba0 0x7fe08c0cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.052+0000 7f8feaffd640 1 --2- 172.21.15.39:0/278906370 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f8fd80763d0 0x7f8fd80788e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.052+0000 7fc3eaacb640 1 -- 172.21.15.39:0/1209703274 shutdown_connections 2024-05-14T14:40:34.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.053+0000 7fe08affd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe08c1f92b0 0x7fe08c1f96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:34.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.053+0000 7fe08affd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe08c1f92b0 0x7fe08c1f96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.39:42020/0 (socket says 172.21.15.39:42020) 2024-05-14T14:40:34.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.053+0000 7fe08bfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe08c0cbba0 0x7fe08c0cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:34.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.053+0000 7fe08bfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe08c0cbba0 0x7fe08c0cbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.39:57112/0 (socket says 172.21.15.39:57112) 2024-05-14T14:40:34.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.053+0000 7fe08bfff640 1 -- 172.21.15.39:0/2757421766 learned_addr learned my addr 172.21.15.39:0/2757421766 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:34.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.053+0000 7fe091bee640 1 -- 172.21.15.39:0/2757421766 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe08c0ba6e0 con 0x7fe08c0cda50 2024-05-14T14:40:34.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.053+0000 7fe091bee640 1 -- 172.21.15.39:0/2757421766 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe08c0ba400 con 0x7fe08c0cbba0 2024-05-14T14:40:34.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.052+0000 7f5b4b7fe640 1 --2- 172.21.15.39:0/3975830278 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f5b380763a0 0x7f5b380788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:34.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.053+0000 7f5b48ff9640 1 -- 172.21.15.39:0/3975830278 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5b40097820 con 0x7f5b4c06c6a0 2024-05-14T14:40:34.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.053+0000 7fe091bee640 1 -- 172.21.15.39:0/2757421766 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe08c0bac00 con 0x7fe08c1f92b0 2024-05-14T14:40:34.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.053+0000 7f8ffa112640 1 --2- 172.21.15.39:0/278906370 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f8fd80763d0 0x7f8fd80788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:34.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.054+0000 7f5b4b7fe640 1 --2- 172.21.15.39:0/3975830278 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f5b380763a0 0x7f5b380788b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c1556c0 tx=0x7f5b3c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:34.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.054+0000 7f8feaffd640 1 -- 172.21.15.39:0/278906370 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8fec0975b0 con 0x7f8ff41615f0 2024-05-14T14:40:34.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.054+0000 7f8ffa112640 1 --2- 172.21.15.39:0/278906370 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f8fd80763d0 0x7f8fd80788e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0037000 tx=0x7f8ff0008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:34.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.053+0000 7fc3eaacb640 1 -- 172.21.15.39:0/1209703274 wait complete. 2024-05-14T14:40:34.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.054+0000 7fe08bfff640 1 -- 172.21.15.39:0/2757421766 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe08c1f92b0 msgr2=0x7fe08c1f96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:34.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.054+0000 7fe08bfff640 1 --2- 172.21.15.39:0/2757421766 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe08c1f92b0 0x7fe08c1f96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.054+0000 7fe08bfff640 1 -- 172.21.15.39:0/2757421766 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe08c0cda50 msgr2=0x7fe08c1f5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:34.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.054+0000 7fe08bfff640 1 --2- 172.21.15.39:0/2757421766 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe08c0cda50 0x7fe08c1f5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.068 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.054+0000 7fe08bfff640 1 -- 172.21.15.39:0/2757421766 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe08c0cde60 con 0x7fe08c0cbba0 2024-05-14T14:40:34.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.054+0000 7fe08bfff640 1 --2- 172.21.15.39:0/2757421766 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe08c0cbba0 0x7fe08c0cbfb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe078001880 tx=0x7fe078001120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:34.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.052+0000 7f2be2a84640 1 -- 172.21.15.39:0/3542602944 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bdc076aa0 con 0x7f2bdc202d20 2024-05-14T14:40:34.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.055+0000 7fe077fff640 1 -- 172.21.15.39:0/2757421766 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe078005480 con 0x7fe08c0cbba0 2024-05-14T14:40:34.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.055+0000 7fe091bee640 1 -- 172.21.15.39:0/2757421766 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe08c1f9c00 con 0x7fe08c0cbba0 2024-05-14T14:40:34.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.055+0000 7fe091bee640 1 -- 172.21.15.39:0/2757421766 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe08c0d0580 con 0x7fe08c0cbba0 2024-05-14T14:40:34.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.055+0000 7fe077fff640 1 -- 172.21.15.39:0/2757421766 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0780050d0 con 0x7fe08c0cbba0 2024-05-14T14:40:34.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.055+0000 7fe077fff640 1 -- 172.21.15.39:0/2757421766 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe078004cc0 con 0x7fe08c0cbba0 2024-05-14T14:40:34.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.056+0000 7fc3eaacb640 1 Processor -- start 2024-05-14T14:40:34.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.056+0000 7fc3eaacb640 1 -- start start 2024-05-14T14:40:34.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.056+0000 7fe091bee640 1 -- 172.21.15.39:0/2757421766 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe06c005290 con 0x7fe08c0cbba0 2024-05-14T14:40:34.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.057+0000 7fc3eaacb640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3d0003a70 0x7fc3e4137a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.057+0000 7fe077fff640 1 -- 172.21.15.39:0/2757421766 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe0780067d0 con 0x7fe08c0cbba0 2024-05-14T14:40:34.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.058+0000 7fc3eaacb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3e41f5520 0x7fc3e41579e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.058+0000 7fc3eaacb640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3e4157f20 0x7fc3e415d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.058+0000 7fc3e9ac9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3d0003a70 0x7fc3e4137a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:34.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.058+0000 7fc3e9ac9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3d0003a70 0x7fc3e4137a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.39:57116/0 (socket says 172.21.15.39:57116) 2024-05-14T14:40:34.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.058+0000 7fc3e92c8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3e41f5520 0x7fc3e41579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:34.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.058+0000 7fc3e92c8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3e41f5520 0x7fc3e41579e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48440/0 (socket says 172.21.15.39:48440) 2024-05-14T14:40:34.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.058+0000 7fc3e9ac9640 1 -- 172.21.15.39:0/1192075347 learned_addr learned my addr 172.21.15.39:0/1192075347 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:34.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.058+0000 7fc3eaacb640 1 -- 172.21.15.39:0/1192075347 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e40712f0 con 0x7fc3e41f5520 2024-05-14T14:40:34.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.058+0000 7fc3eaacb640 1 -- 172.21.15.39:0/1192075347 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e4160a30 con 0x7fc3d0003a70 2024-05-14T14:40:34.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.058+0000 7fc3eaacb640 1 -- 172.21.15.39:0/1192075347 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fc3e4071470 con 0x7fc3e4157f20 2024-05-14T14:40:34.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.058+0000 7fc3ea2ca640 1 --2- 172.21.15.39:0/1192075347 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3e4157f20 0x7fc3e415d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:34.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.058+0000 7fc3e9ac9640 1 -- 172.21.15.39:0/1192075347 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3e4157f20 msgr2=0x7fc3e415d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:34.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.058+0000 7fc3e9ac9640 1 --2- 172.21.15.39:0/1192075347 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3e4157f20 0x7fc3e415d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.058+0000 7fe077fff640 1 --2- 172.21.15.39:0/2757421766 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe0700762d0 0x7fe0700787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.058+0000 7fc3e9ac9640 1 -- 172.21.15.39:0/1192075347 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3e41f5520 msgr2=0x7fc3e41579e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:34.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.058+0000 7fc3e9ac9640 1 --2- 172.21.15.39:0/1192075347 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3e41f5520 0x7fc3e41579e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.074 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.058+0000 7fc3e9ac9640 1 -- 172.21.15.39:0/1192075347 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3e4137f70 con 0x7fc3d0003a70 2024-05-14T14:40:34.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.059+0000 7fe077fff640 1 -- 172.21.15.39:0/2757421766 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe0780b6cb0 con 0x7fe08c0cbba0 2024-05-14T14:40:34.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.059+0000 7fc3e9ac9640 1 --2- 172.21.15.39:0/1192075347 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3d0003a70 0x7fc3e4137a30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc3e0003d30 tx=0x7fc3e0001890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:34.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.059+0000 7fe08b7fe640 1 --2- 172.21.15.39:0/2757421766 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe0700762d0 0x7fe0700787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:34.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.060+0000 7fe08b7fe640 1 --2- 172.21.15.39:0/2757421766 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe0700762d0 0x7fe0700787e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe080001860 tx=0x7fe080009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:34.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.063+0000 7fc3da7fc640 1 -- 172.21.15.39:0/1192075347 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e0044070 con 0x7fc3d0003a70 2024-05-14T14:40:34.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.063+0000 7f5b48ff9640 1 -- 172.21.15.39:0/3975830278 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5b4001f020 con 0x7f5b4c06c6a0 2024-05-14T14:40:34.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.063+0000 7fc3da7fc640 1 -- 172.21.15.39:0/1192075347 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3e0004820 con 0x7fc3d0003a70 2024-05-14T14:40:34.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.063+0000 7fe077fff640 1 -- 172.21.15.39:0/2757421766 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe08c1f9c00 con 0x7fe08c0cbba0 2024-05-14T14:40:34.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.065+0000 7fc3da7fc640 1 -- 172.21.15.39:0/1192075347 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e0003910 con 0x7fc3d0003a70 2024-05-14T14:40:34.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.065+0000 7fc3eaacb640 1 -- 172.21.15.39:0/1192075347 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3e415e530 con 0x7fc3d0003a70 2024-05-14T14:40:34.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.065+0000 7fc3eaacb640 1 -- 172.21.15.39:0/1192075347 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3e4156f00 con 0x7fc3d0003a70 2024-05-14T14:40:34.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.067+0000 7fc3eaacb640 1 -- 172.21.15.39:0/1192075347 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3e4050870 con 0x7fc3d0003a70 2024-05-14T14:40:34.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.066+0000 7f2bd97fa640 1 -- 172.21.15.39:0/3542602944 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2bd40127a0 con 0x7f2bdc202d20 2024-05-14T14:40:34.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.067+0000 7f2bd97fa640 1 --2- 172.21.15.39:0/3542602944 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f2bc8076300 0x7f2bc8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.067+0000 7f2be0820640 1 --2- 172.21.15.39:0/3542602944 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f2bc8076300 0x7f2bc8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:34.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.068+0000 7f2be0820640 1 --2- 172.21.15.39:0/3542602944 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f2bc8076300 0x7f2bc8078810 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0034000 tx=0x7f2bd002c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:34.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.068+0000 7fc3da7fc640 1 -- 172.21.15.39:0/1192075347 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc3e002b5c0 con 0x7fc3d0003a70 2024-05-14T14:40:34.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.069+0000 7fc3da7fc640 1 --2- 172.21.15.39:0/1192075347 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fc3c80762d0 0x7fc3c80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.069+0000 7fc3da7fc640 1 -- 172.21.15.39:0/1192075347 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fc3e00b7900 con 0x7fc3d0003a70 2024-05-14T14:40:34.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.070+0000 7fc3e92c8640 1 --2- 172.21.15.39:0/1192075347 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fc3c80762d0 0x7fc3c80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:34.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.070+0000 7fc3e92c8640 1 --2- 172.21.15.39:0/1192075347 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fc3c80762d0 0x7fc3c80787e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc004c90 tx=0x7fc3dc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:34.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.074+0000 7f8feaffd640 1 -- 172.21.15.39:0/278906370 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f8fec060580 con 0x7f8ff41615f0 2024-05-14T14:40:34.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.075+0000 7f2bd97fa640 1 -- 172.21.15.39:0/3542602944 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2bd40079f0 con 0x7f2bdc202d20 2024-05-14T14:40:34.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.075+0000 7fc3da7fc640 1 -- 172.21.15.39:0/1192075347 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc3e00808d0 con 0x7fc3d0003a70 2024-05-14T14:40:34.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.085+0000 7f2bd97fa640 1 -- 172.21.15.39:0/3542602944 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2bd4061db0 con 0x7f2bdc202d20 2024-05-14T14:40:34.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.423+0000 7efbe8ff9640 1 -- 172.21.15.39:0/2914727852 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7efbec053650 con 0x7efbec050630 2024-05-14T14:40:34.407 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.424+0000 7efbeaffd640 1 -- 172.21.15.39:0/2914727852 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efbf0060bf0 con 0x7efbec050630 2024-05-14T14:40:34.408 INFO:teuthology.orchestra.run.smithi039.stdout:55834574858 2024-05-14T14:40:34.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.427+0000 7efbfb20c640 1 -- 172.21.15.39:0/2914727852 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7efbd80763d0 msgr2=0x7efbd80788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:34.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.427+0000 7efbfb20c640 1 --2- 172.21.15.39:0/2914727852 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7efbd80763d0 0x7efbd80788e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7efbe4009960 tx=0x7efbe40090e0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.428+0000 7efbfb20c640 1 -- 172.21.15.39:0/2914727852 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efbec050630 msgr2=0x7efbec0d2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:34.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.428+0000 7efbfb20c640 1 --2- 172.21.15.39:0/2914727852 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efbec050630 0x7efbec0d2180 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efbf000b440 tx=0x7efbf000b900 comp rx=0 tx=0).stop 2024-05-14T14:40:34.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.428+0000 7efbfb20c640 1 -- 172.21.15.39:0/2914727852 shutdown_connections 2024-05-14T14:40:34.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.428+0000 7efbfb20c640 1 --2- 172.21.15.39:0/2914727852 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7efbd80763d0 0x7efbd80788e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.428+0000 7efbfb20c640 1 --2- 172.21.15.39:0/2914727852 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efbec0d26c0 0x7efbec0d65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.428+0000 7efbfb20c640 1 --2- 172.21.15.39:0/2914727852 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efbec050630 0x7efbec0d2180 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.428+0000 7efbfb20c640 1 --2- 172.21.15.39:0/2914727852 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efbec04f870 0x7efbec0d1c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.428+0000 7efbfb20c640 1 -- 172.21.15.39:0/2914727852 >> 172.21.15.39:0/2914727852 conn(0x7efbec054ce0 msgr2=0x7efbec0058b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:34.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.428+0000 7efbfb20c640 1 -- 172.21.15.39:0/2914727852 shutdown_connections 2024-05-14T14:40:34.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.429+0000 7efbfb20c640 1 -- 172.21.15.39:0/2914727852 wait complete. 2024-05-14T14:40:34.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.437+0000 7f4459532640 1 -- 172.21.15.39:0/2756063353 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f4434005580 con 0x7f444c054260 2024-05-14T14:40:34.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.438+0000 7f4450ff9640 1 -- 172.21.15.39:0/2756063353 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4440064890 con 0x7f444c054260 2024-05-14T14:40:34.422 INFO:teuthology.orchestra.run.smithi039.stdout:55834574857 2024-05-14T14:40:34.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.442+0000 7f443e7fc640 1 -- 172.21.15.39:0/2756063353 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f44380763a0 msgr2=0x7f44380788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:34.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.442+0000 7f443e7fc640 1 --2- 172.21.15.39:0/2756063353 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f44380763a0 0x7f44380788b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4448009560 tx=0x7f444802e000 comp rx=0 tx=0).stop 2024-05-14T14:40:34.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.442+0000 7f443e7fc640 1 -- 172.21.15.39:0/2756063353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f444c054260 msgr2=0x7f444c03e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:34.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.442+0000 7f443e7fc640 1 --2- 172.21.15.39:0/2756063353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f444c054260 0x7f444c03e030 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4440009fd0 tx=0x7f444000ec50 comp rx=0 tx=0).stop 2024-05-14T14:40:34.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.442+0000 7f443e7fc640 1 -- 172.21.15.39:0/2756063353 shutdown_connections 2024-05-14T14:40:34.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.442+0000 7f443e7fc640 1 --2- 172.21.15.39:0/2756063353 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f44380763a0 0x7f44380788b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.426 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.442+0000 7f443e7fc640 1 --2- 172.21.15.39:0/2756063353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f444c054260 0x7f444c03e030 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.442+0000 7f76bdffb640 1 -- 172.21.15.39:0/2482228323 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f76ac005580 con 0x7f76c4004e60 2024-05-14T14:40:34.427 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.442+0000 7f443e7fc640 1 --2- 172.21.15.39:0/2756063353 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f444c03c560 0x7f444c03daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.442+0000 7f443e7fc640 1 --2- 172.21.15.39:0/2756063353 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f444c03c150 0x7f444c0e0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.443+0000 7f443e7fc640 1 -- 172.21.15.39:0/2756063353 >> 172.21.15.39:0/2756063353 conn(0x7f444c0563f0 msgr2=0x7f444c006370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:34.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.443+0000 7f443e7fc640 1 -- 172.21.15.39:0/2756063353 shutdown_connections 2024-05-14T14:40:34.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.443+0000 7f443e7fc640 1 -- 172.21.15.39:0/2756063353 wait complete. 2024-05-14T14:40:34.428 INFO:teuthology.orchestra.run.smithi039.stdout:55834574857 2024-05-14T14:40:34.428 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.443+0000 7f76bffff640 1 -- 172.21.15.39:0/2482228323 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f76c803f030 con 0x7f76c4004e60 2024-05-14T14:40:34.430 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2024-05-14T14:40:34.430 DEBUG:teuthology.parallel:result is None 2024-05-14T14:40:34.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.447+0000 7f76bdffb640 1 -- 172.21.15.39:0/2482228323 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f76b80763a0 msgr2=0x7f76b80788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:34.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.447+0000 7f76bdffb640 1 --2- 172.21.15.39:0/2482228323 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f76b80763a0 0x7f76b80788b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f76c0004840 tx=0x7f76c0007040 comp rx=0 tx=0).stop 2024-05-14T14:40:34.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.447+0000 7f76bdffb640 1 -- 172.21.15.39:0/2482228323 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f76c4004e60 msgr2=0x7f76cc0c60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:34.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.447+0000 7f76bdffb640 1 --2- 172.21.15.39:0/2482228323 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f76c4004e60 0x7f76cc0c60f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f76c802ac60 tx=0x7f76c802c000 comp rx=0 tx=0).stop 2024-05-14T14:40:34.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.447+0000 7f76bdffb640 1 -- 172.21.15.39:0/2482228323 shutdown_connections 2024-05-14T14:40:34.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.447+0000 7f76bdffb640 1 --2- 172.21.15.39:0/2482228323 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f76b80763a0 0x7f76b80788b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.447+0000 7f76bdffb640 1 --2- 172.21.15.39:0/2482228323 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f76cc0e2500 0x7f76cc0e2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.431 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.447+0000 7f76bdffb640 1 --2- 172.21.15.39:0/2482228323 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76cc0c7be0 0x7f76cc0dc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.447+0000 7f76bdffb640 1 --2- 172.21.15.39:0/2482228323 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f76c4004e60 0x7f76cc0c60f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.447+0000 7f76bdffb640 1 -- 172.21.15.39:0/2482228323 >> 172.21.15.39:0/2482228323 conn(0x7f76cc054d20 msgr2=0x7f76cc0de5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:34.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.448+0000 7f76bdffb640 1 -- 172.21.15.39:0/2482228323 shutdown_connections 2024-05-14T14:40:34.432 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.448+0000 7f76bdffb640 1 -- 172.21.15.39:0/2482228323 wait complete. 2024-05-14T14:40:34.446 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.4 2024-05-14T14:40:34.446 DEBUG:teuthology.parallel:result is None 2024-05-14T14:40:34.449 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.3 2024-05-14T14:40:34.450 DEBUG:teuthology.parallel:result is None 2024-05-14T14:40:34.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.475+0000 7fe091bee640 1 -- 172.21.15.39:0/2757421766 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fe06c005850 con 0x7fe08c0cbba0 2024-05-14T14:40:34.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.476+0000 7fe077fff640 1 -- 172.21.15.39:0/2757421766 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe078043060 con 0x7fe08c0cbba0 2024-05-14T14:40:34.460 INFO:teuthology.orchestra.run.smithi039.stdout:55834574856 2024-05-14T14:40:34.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.478+0000 7fe091bee640 1 -- 172.21.15.39:0/2757421766 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe0700762d0 msgr2=0x7fe0700787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:34.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.478+0000 7fe091bee640 1 --2- 172.21.15.39:0/2757421766 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe0700762d0 0x7fe0700787e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe080001860 tx=0x7fe080009040 comp rx=0 tx=0).stop 2024-05-14T14:40:34.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.478+0000 7fe091bee640 1 -- 172.21.15.39:0/2757421766 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe08c0cbba0 msgr2=0x7fe08c0cbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:34.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.478+0000 7fe091bee640 1 --2- 172.21.15.39:0/2757421766 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe08c0cbba0 0x7fe08c0cbfb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe078001880 tx=0x7fe078001120 comp rx=0 tx=0).stop 2024-05-14T14:40:34.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.478+0000 7fe091bee640 1 -- 172.21.15.39:0/2757421766 shutdown_connections 2024-05-14T14:40:34.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.478+0000 7fe091bee640 1 --2- 172.21.15.39:0/2757421766 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe0700762d0 0x7fe0700787e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.478+0000 7fe091bee640 1 --2- 172.21.15.39:0/2757421766 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe08c0cbba0 0x7fe08c0cbfb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.478+0000 7fe091bee640 1 --2- 172.21.15.39:0/2757421766 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe08c1f92b0 0x7fe08c1f96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.478+0000 7fe091bee640 1 --2- 172.21.15.39:0/2757421766 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe08c0cda50 0x7fe08c1f5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.478+0000 7fe091bee640 1 -- 172.21.15.39:0/2757421766 >> 172.21.15.39:0/2757421766 conn(0x7fe08c0d5b50 msgr2=0x7fe08c15f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:34.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.478+0000 7fe091bee640 1 -- 172.21.15.39:0/2757421766 shutdown_connections 2024-05-14T14:40:34.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.478+0000 7fe091bee640 1 -- 172.21.15.39:0/2757421766 wait complete. 2024-05-14T14:40:34.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.482+0000 7f5b5297d640 1 -- 172.21.15.39:0/3975830278 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f5b4c0d20c0 con 0x7f5b4c06c6a0 2024-05-14T14:40:34.467 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.483+0000 7f5b48ff9640 1 -- 172.21.15.39:0/3975830278 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5b40011e20 con 0x7f5b4c06c6a0 2024-05-14T14:40:34.467 INFO:teuthology.orchestra.run.smithi039.stdout:55834574857 2024-05-14T14:40:34.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.486+0000 7f5b5297d640 1 -- 172.21.15.39:0/3975830278 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f5b380763a0 msgr2=0x7f5b380788b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:34.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.486+0000 7f5b5297d640 1 --2- 172.21.15.39:0/3975830278 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f5b380763a0 0x7f5b380788b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c1556c0 tx=0x7f5b3c008040 comp rx=0 tx=0).stop 2024-05-14T14:40:34.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.486+0000 7f5b5297d640 1 -- 172.21.15.39:0/3975830278 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b4c06c6a0 msgr2=0x7f5b4c153da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:34.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.486+0000 7f5b5297d640 1 --2- 172.21.15.39:0/3975830278 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b4c06c6a0 0x7f5b4c153da0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5b4000b410 tx=0x7f5b4000b8d0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.486+0000 7f5b5297d640 1 -- 172.21.15.39:0/3975830278 shutdown_connections 2024-05-14T14:40:34.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.486+0000 7f5b5297d640 1 --2- 172.21.15.39:0/3975830278 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f5b380763a0 0x7f5b380788b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.486+0000 7f5b5297d640 1 --2- 172.21.15.39:0/3975830278 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b4c0d1820 0x7f5b4c0ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.486+0000 7f5b5297d640 1 --2- 172.21.15.39:0/3975830278 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5b4c0b76b0 0x7f5b4c154a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.486+0000 7f5b5297d640 1 --2- 172.21.15.39:0/3975830278 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5b4c06c6a0 0x7f5b4c153da0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.486+0000 7f5b5297d640 1 -- 172.21.15.39:0/3975830278 >> 172.21.15.39:0/3975830278 conn(0x7f5b4c09b5f0 msgr2=0x7f5b4c06fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:34.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.486+0000 7f5b5297d640 1 -- 172.21.15.39:0/3975830278 shutdown_connections 2024-05-14T14:40:34.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.486+0000 7f5b5297d640 1 -- 172.21.15.39:0/3975830278 wait complete. 2024-05-14T14:40:34.475 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.6 2024-05-14T14:40:34.475 DEBUG:teuthology.parallel:result is None 2024-05-14T14:40:34.476 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.493+0000 7f2be2a84640 1 -- 172.21.15.39:0/3542602944 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f2bdc161240 con 0x7f2bdc202d20 2024-05-14T14:40:34.477 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.493+0000 7f2bd97fa640 1 -- 172.21.15.39:0/3542602944 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2bd40616b0 con 0x7f2bdc202d20 2024-05-14T14:40:34.477 INFO:teuthology.orchestra.run.smithi039.stdout:55834574858 2024-05-14T14:40:34.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.497+0000 7f2be2a84640 1 -- 172.21.15.39:0/3542602944 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f2bc8076300 msgr2=0x7f2bc8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:34.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.497+0000 7f2be2a84640 1 --2- 172.21.15.39:0/3542602944 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f2bc8076300 0x7f2bc8078810 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0034000 tx=0x7f2bd002c000 comp rx=0 tx=0).stop 2024-05-14T14:40:34.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.497+0000 7f2be2a84640 1 -- 172.21.15.39:0/3542602944 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2bdc202d20 msgr2=0x7f2bdc0b0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:34.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.497+0000 7f2be2a84640 1 --2- 172.21.15.39:0/3542602944 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2bdc202d20 0x7f2bdc0b0430 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc0d05b0 tx=0x7f2bd400cf00 comp rx=0 tx=0).stop 2024-05-14T14:40:34.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.497+0000 7f2be2a84640 1 -- 172.21.15.39:0/3542602944 shutdown_connections 2024-05-14T14:40:34.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.497+0000 7f2be2a84640 1 --2- 172.21.15.39:0/3542602944 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f2bc8076300 0x7f2bc8078810 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.497+0000 7f2be2a84640 1 --2- 172.21.15.39:0/3542602944 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2bdc202d20 0x7f2bdc0b0430 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.497+0000 7f2be2a84640 1 --2- 172.21.15.39:0/3542602944 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2bdc1615f0 0x7f2bdc0afef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.497+0000 7f2be2a84640 1 --2- 172.21.15.39:0/3542602944 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2bdc0b23f0 0x7f2bdc203bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.497+0000 7f2be2a84640 1 -- 172.21.15.39:0/3542602944 >> 172.21.15.39:0/3542602944 conn(0x7f2bdc0b7740 msgr2=0x7f2bdc06ef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:34.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.497+0000 7f2be2a84640 1 -- 172.21.15.39:0/3542602944 shutdown_connections 2024-05-14T14:40:34.482 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.497+0000 7f2be2a84640 1 -- 172.21.15.39:0/3542602944 wait complete. 2024-05-14T14:40:34.487 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.2 2024-05-14T14:40:34.487 DEBUG:teuthology.parallel:result is None 2024-05-14T14:40:34.493 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.0 2024-05-14T14:40:34.493 DEBUG:teuthology.parallel:result is None 2024-05-14T14:40:34.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.526+0000 7f8ffc376640 1 -- 172.21.15.39:0/278906370 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f8fdc005580 con 0x7f8ff41615f0 2024-05-14T14:40:34.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.526+0000 7f8feaffd640 1 -- 172.21.15.39:0/278906370 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8fec064880 con 0x7f8ff41615f0 2024-05-14T14:40:34.510 INFO:teuthology.orchestra.run.smithi039.stdout:55834574858 2024-05-14T14:40:34.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.527+0000 7fc3eaacb640 1 -- 172.21.15.39:0/1192075347 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fc3e406d2e0 con 0x7fc3d0003a70 2024-05-14T14:40:34.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.528+0000 7fc3da7fc640 1 -- 172.21.15.39:0/1192075347 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc3e0084bd0 con 0x7fc3d0003a70 2024-05-14T14:40:34.512 INFO:teuthology.orchestra.run.smithi039.stdout:55834574857 2024-05-14T14:40:34.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.528+0000 7f8ffc376640 1 -- 172.21.15.39:0/278906370 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f8fd80763d0 msgr2=0x7f8fd80788e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:34.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.528+0000 7f8ffc376640 1 --2- 172.21.15.39:0/278906370 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f8fd80763d0 0x7f8fd80788e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8ff0037000 tx=0x7f8ff0008030 comp rx=0 tx=0).stop 2024-05-14T14:40:34.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.528+0000 7f8ffc376640 1 -- 172.21.15.39:0/278906370 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8ff41615f0 msgr2=0x7f8ff414e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:34.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.528+0000 7f8ffc376640 1 --2- 172.21.15.39:0/278906370 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8ff41615f0 0x7f8ff414e800 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8fec00eaf0 tx=0x7f8fec00b0b0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.528+0000 7f8ffc376640 1 -- 172.21.15.39:0/278906370 shutdown_connections 2024-05-14T14:40:34.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.528+0000 7f8ffc376640 1 --2- 172.21.15.39:0/278906370 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f8fd80763d0 0x7f8fd80788e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.528+0000 7f8ffc376640 1 --2- 172.21.15.39:0/278906370 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f8ff41615f0 0x7f8ff414e800 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.528+0000 7f8ffc376640 1 --2- 172.21.15.39:0/278906370 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f8ff40cfd50 0x7f8ff414e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.528+0000 7f8ffc376640 1 --2- 172.21.15.39:0/278906370 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8ff40b23f0 0x7f8ff40897b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.528+0000 7f8ffc376640 1 -- 172.21.15.39:0/278906370 >> 172.21.15.39:0/278906370 conn(0x7f8ff40b7740 msgr2=0x7f8ff40b0520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:34.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.528+0000 7f8ffc376640 1 -- 172.21.15.39:0/278906370 shutdown_connections 2024-05-14T14:40:34.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.528+0000 7f8ffc376640 1 -- 172.21.15.39:0/278906370 wait complete. 2024-05-14T14:40:34.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.530+0000 7fc3eaacb640 1 -- 172.21.15.39:0/1192075347 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fc3c80762d0 msgr2=0x7fc3c80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:34.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.530+0000 7fc3eaacb640 1 --2- 172.21.15.39:0/1192075347 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fc3c80762d0 0x7fc3c80787e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc004c90 tx=0x7fc3dc009040 comp rx=0 tx=0).stop 2024-05-14T14:40:34.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.530+0000 7fc3eaacb640 1 -- 172.21.15.39:0/1192075347 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3d0003a70 msgr2=0x7fc3e4137a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:34.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.530+0000 7fc3eaacb640 1 --2- 172.21.15.39:0/1192075347 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3d0003a70 0x7fc3e4137a30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc3e0003d30 tx=0x7fc3e0001890 comp rx=0 tx=0).stop 2024-05-14T14:40:34.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.530+0000 7fc3eaacb640 1 -- 172.21.15.39:0/1192075347 shutdown_connections 2024-05-14T14:40:34.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.530+0000 7fc3eaacb640 1 --2- 172.21.15.39:0/1192075347 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fc3c80762d0 0x7fc3c80787e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.530+0000 7fc3eaacb640 1 --2- 172.21.15.39:0/1192075347 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fc3e4157f20 0x7fc3e415d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.530+0000 7fc3eaacb640 1 --2- 172.21.15.39:0/1192075347 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fc3e41f5520 0x7fc3e41579e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.530+0000 7fc3eaacb640 1 --2- 172.21.15.39:0/1192075347 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3d0003a70 0x7fc3e4137a30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.530+0000 7fc3eaacb640 1 -- 172.21.15.39:0/1192075347 >> 172.21.15.39:0/1192075347 conn(0x7fc3e40ce0f0 msgr2=0x7fc3e41599e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:34.517 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.530+0000 7fc3eaacb640 1 -- 172.21.15.39:0/1192075347 shutdown_connections 2024-05-14T14:40:34.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.530+0000 7fc3eaacb640 1 -- 172.21.15.39:0/1192075347 wait complete. 2024-05-14T14:40:34.524 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.1 2024-05-14T14:40:34.524 DEBUG:teuthology.parallel:result is None 2024-05-14T14:40:34.525 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.5 2024-05-14T14:40:34.525 DEBUG:teuthology.parallel:result is None 2024-05-14T14:40:34.525 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-14T14:40:34.525 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T14:40:34.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.697+0000 7f37fa52d640 1 Processor -- start 2024-05-14T14:40:34.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.697+0000 7f37fa52d640 1 -- start start 2024-05-14T14:40:34.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.698+0000 7f37fa52d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f37f4160420 0x7f37f40d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.698+0000 7f37fa52d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f37f406d7c0 0x7f37f40ba070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.698+0000 7f37fa52d640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37f40b9310 con 0x7f37f40d1140 2024-05-14T14:40:34.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.698+0000 7f37fa52d640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f37f40d1550 con 0x7f37f4160420 2024-05-14T14:40:34.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.698+0000 7f37fa52d640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f37f406dd70 con 0x7f37f406d7c0 2024-05-14T14:40:34.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.699+0000 7f37f37fe640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f37f40d1140 0x7f37f406d0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:56400/0 (socket says 172.21.15.39:56400) 2024-05-14T14:40:34.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.699+0000 7f37f37fe640 1 -- 172.21.15.39:0/2900698863 learned_addr learned my addr 172.21.15.39:0/2900698863 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:34.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.699+0000 7f37f8aca640 1 --2- 172.21.15.39:0/2900698863 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f37f406d7c0 0x7f37f40ba070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:34.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.699+0000 7f37f3fff640 1 --2- 172.21.15.39:0/2900698863 >> v2:172.21.15.62:3300/0 conn(0x7f37f4160420 0x7f37f40d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:34.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.699+0000 7f37f2ffd640 1 -- 172.21.15.39:0/2900698863 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 293380230 0 0) 0x7f37e8001110 con 0x7f37f40d1140 2024-05-14T14:40:34.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.699+0000 7f37f2ffd640 1 -- 172.21.15.39:0/2900698863 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37dc003520 con 0x7f37f40d1140 2024-05-14T14:40:34.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.699+0000 7f37f2ffd640 1 -- 172.21.15.39:0/2900698863 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1930195504 0 0) 0x7f37dc003520 con 0x7f37f40d1140 2024-05-14T14:40:34.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.699+0000 7f37f2ffd640 1 -- 172.21.15.39:0/2900698863 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f37f406d7c0 msgr2=0x7f37f40ba070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:34.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.699+0000 7f37f2ffd640 1 --2- 172.21.15.39:0/2900698863 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f37f406d7c0 0x7f37f40ba070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.699+0000 7f37f2ffd640 1 -- 172.21.15.39:0/2900698863 >> v2:172.21.15.62:3300/0 conn(0x7f37f4160420 msgr2=0x7f37f40d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:34.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.699+0000 7f37f2ffd640 1 --2- 172.21.15.39:0/2900698863 >> v2:172.21.15.62:3300/0 conn(0x7f37f4160420 0x7f37f40d0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.699+0000 7f37f2ffd640 1 -- 172.21.15.39:0/2900698863 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37f40b9590 con 0x7f37f40d1140 2024-05-14T14:40:34.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.699+0000 7f37f2ffd640 1 -- 172.21.15.39:0/2900698863 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1803005051 0 0) 0x7f37e80018c0 con 0x7f37f40d1140 2024-05-14T14:40:34.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.699+0000 7f37f2ffd640 1 -- 172.21.15.39:0/2900698863 >> v1:172.21.15.39:6789/0 conn(0x7f37f40d1140 legacy=0x7f37f406d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:34.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.699+0000 7f37f2ffd640 1 --2- 172.21.15.39:0/2900698863 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37dc003a00 0x7f37dc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.699+0000 7f37f2ffd640 1 --2- 172.21.15.39:0/2900698863 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f37f406d7c0 0x7f37dc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.699+0000 7f37f2ffd640 1 --2- 172.21.15.39:0/2900698863 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37dc004d40 0x7f37dc005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.699+0000 7f37f2ffd640 1 -- 172.21.15.39:0/2900698863 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f37f40d1550 con 0x7f37dc003a00 2024-05-14T14:40:34.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.699+0000 7f37f2ffd640 1 -- 172.21.15.39:0/2900698863 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f37f406dd70 con 0x7f37dc004d40 2024-05-14T14:40:34.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.699+0000 7f37f2ffd640 1 -- 172.21.15.39:0/2900698863 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f37dc00baa0 con 0x7f37f406d7c0 2024-05-14T14:40:34.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.699+0000 7f37f3fff640 1 --2- 172.21.15.39:0/2900698863 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37dc003a00 0x7f37dc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:34.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.699+0000 7f37f37fe640 1 --2- 172.21.15.39:0/2900698863 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f37f406d7c0 0x7f37dc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:34.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.699+0000 7f37f8aca640 1 --2- 172.21.15.39:0/2900698863 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37dc004d40 0x7f37dc005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:34.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.700+0000 7f37f3fff640 1 -- 172.21.15.39:0/2900698863 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f37f406d7c0 msgr2=0x7f37dc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:34.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.700+0000 7f37f3fff640 1 --2- 172.21.15.39:0/2900698863 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f37f406d7c0 0x7f37dc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.700+0000 7f37f3fff640 1 -- 172.21.15.39:0/2900698863 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37dc004d40 msgr2=0x7f37dc005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:34.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.700+0000 7f37f3fff640 1 --2- 172.21.15.39:0/2900698863 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37dc004d40 0x7f37dc005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.700+0000 7f37f3fff640 1 -- 172.21.15.39:0/2900698863 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37dc003520 con 0x7f37dc003a00 2024-05-14T14:40:34.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.700+0000 7f37f3fff640 1 --2- 172.21.15.39:0/2900698863 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37dc003a00 0x7f37dc003e70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f37e4009ac0 tx=0x7f37dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a70406f156bc9db server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:34.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.700+0000 7f37f2ffd640 1 -- 172.21.15.39:0/2900698863 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e4036070 con 0x7f37dc003a00 2024-05-14T14:40:34.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.701+0000 7f37f2ffd640 1 -- 172.21.15.39:0/2900698863 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37e4031400 con 0x7f37dc003a00 2024-05-14T14:40:34.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.701+0000 7f37f2ffd640 1 -- 172.21.15.39:0/2900698863 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e4009690 con 0x7f37dc003a00 2024-05-14T14:40:34.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.701+0000 7f37fa52d640 1 -- 172.21.15.39:0/2900698863 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37dc003a00 msgr2=0x7f37dc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:34.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.701+0000 7f37fa52d640 1 --2- 172.21.15.39:0/2900698863 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37dc003a00 0x7f37dc003e70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f37e4009ac0 tx=0x7f37dc005830 comp rx=0 tx=0).stop 2024-05-14T14:40:34.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.701+0000 7f37f8aca640 1 -- 172.21.15.39:0/2900698863 reap_dead start 2024-05-14T14:40:34.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.701+0000 7f37fa52d640 1 -- 172.21.15.39:0/2900698863 shutdown_connections 2024-05-14T14:40:34.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.701+0000 7f37fa52d640 1 -- 172.21.15.39:0/2900698863 >> 172.21.15.39:0/2900698863 conn(0x7f37f40d27d0 msgr2=0x7f37f40d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:34.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.701+0000 7f37fa52d640 1 -- 172.21.15.39:0/2900698863 shutdown_connections 2024-05-14T14:40:34.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.701+0000 7f37fa52d640 1 -- 172.21.15.39:0/2900698863 wait complete. 2024-05-14T14:40:34.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.703+0000 7f37fa52d640 1 Processor -- start 2024-05-14T14:40:34.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.703+0000 7f37fa52d640 1 -- start start 2024-05-14T14:40:34.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.705+0000 7f37fa52d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f37dc003a00 0x7f37f41fe760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.705+0000 7f37fa52d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37f41f9f00 0x7f37f4160b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.705+0000 7f37fa52d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37f41fa310 0x7f37f41610d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.705+0000 7f37fa52d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f37f4160830 con 0x7f37f41f9f00 2024-05-14T14:40:34.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.705+0000 7f37fa52d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f37f40b9b50 con 0x7f37f41fa310 2024-05-14T14:40:34.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.705+0000 7f37fa52d640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f37f40ba070 con 0x7f37dc003a00 2024-05-14T14:40:34.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.705+0000 7f37f37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37f41f9f00 0x7f37f4160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:34.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.705+0000 7f37f37fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37f41f9f00 0x7f37f4160b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48454/0 (socket says 172.21.15.39:48454) 2024-05-14T14:40:34.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.705+0000 7f37f37fe640 1 -- 172.21.15.39:0/3080027597 learned_addr learned my addr 172.21.15.39:0/3080027597 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:34.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.705+0000 7f37f3fff640 1 --2- 172.21.15.39:0/3080027597 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f37dc003a00 0x7f37f41fe760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:34.691 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.705+0000 7f37f8aca640 1 --2- 172.21.15.39:0/3080027597 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37f41fa310 0x7f37f41610d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:34.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.705+0000 7f37f37fe640 1 -- 172.21.15.39:0/3080027597 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f37dc003a00 msgr2=0x7f37f41fe760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:34.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.705+0000 7f37f37fe640 1 --2- 172.21.15.39:0/3080027597 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f37dc003a00 0x7f37f41fe760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.705+0000 7f37f37fe640 1 -- 172.21.15.39:0/3080027597 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37f41fa310 msgr2=0x7f37f41610d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:34.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.705+0000 7f37f37fe640 1 --2- 172.21.15.39:0/3080027597 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37f41fa310 0x7f37f41610d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.705+0000 7f37f37fe640 1 -- 172.21.15.39:0/3080027597 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37f41feca0 con 0x7f37f41f9f00 2024-05-14T14:40:34.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.705+0000 7f37f37fe640 1 --2- 172.21.15.39:0/3080027597 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37f41f9f00 0x7f37f4160b90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f37e8001a30 tx=0x7f37e8007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:34.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.706+0000 7f37f0ff9640 1 -- 172.21.15.39:0/3080027597 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e800f9c0 con 0x7f37f41f9f00 2024-05-14T14:40:34.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.706+0000 7f37f0ff9640 1 -- 172.21.15.39:0/3080027597 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37e8018070 con 0x7f37f41f9f00 2024-05-14T14:40:34.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.706+0000 7f37fa52d640 1 -- 172.21.15.39:0/3080027597 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37f4157fe0 con 0x7f37f41f9f00 2024-05-14T14:40:34.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.706+0000 7f37f0ff9640 1 -- 172.21.15.39:0/3080027597 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e800fda0 con 0x7f37f41f9f00 2024-05-14T14:40:34.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.706+0000 7f37fa52d640 1 -- 172.21.15.39:0/3080027597 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37f4161fb0 con 0x7f37f41f9f00 2024-05-14T14:40:34.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.707+0000 7f37fa52d640 1 -- 172.21.15.39:0/3080027597 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37f4076aa0 con 0x7f37f41f9f00 2024-05-14T14:40:34.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.707+0000 7f37f0ff9640 1 -- 172.21.15.39:0/3080027597 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f37e801d460 con 0x7f37f41f9f00 2024-05-14T14:40:34.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.708+0000 7f37f0ff9640 1 --2- 172.21.15.39:0/3080027597 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f37e00762d0 0x7f37e00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:34.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.708+0000 7f37f3fff640 1 --2- 172.21.15.39:0/3080027597 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f37e00762d0 0x7f37e00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:34.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.708+0000 7f37f0ff9640 1 -- 172.21.15.39:0/3080027597 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f37e8097a50 con 0x7f37f41f9f00 2024-05-14T14:40:34.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.709+0000 7f37f3fff640 1 --2- 172.21.15.39:0/3080027597 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f37e00762d0 0x7f37e00787e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f37e4033000 tx=0x7f37e4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:34.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.713+0000 7f37f0ff9640 1 -- 172.21.15.39:0/3080027597 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f37f41feca0 con 0x7f37f41f9f00 2024-05-14T14:40:34.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.899+0000 7f37fa52d640 1 -- 172.21.15.39:0/3080027597 --> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f37f4157d70 con 0x7f37e00762d0 2024-05-14T14:40:34.891 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.907+0000 7f37f0ff9640 1 -- 172.21.15.39:0/3080027597 <== mgr.4105 v2:172.21.15.39:6832/498853008 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332523 (secure 0 0 0) 0x7f37f4157d70 con 0x7f37e00762d0 2024-05-14T14:40:34.895 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:40:34.897 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-05-14T14:40:34.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.911+0000 7f37fa52d640 1 -- 172.21.15.39:0/3080027597 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f37e00762d0 msgr2=0x7f37e00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:34.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.911+0000 7f37fa52d640 1 --2- 172.21.15.39:0/3080027597 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f37e00762d0 0x7f37e00787e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f37e4033000 tx=0x7f37e4008030 comp rx=0 tx=0).stop 2024-05-14T14:40:34.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.911+0000 7f37fa52d640 1 -- 172.21.15.39:0/3080027597 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37f41f9f00 msgr2=0x7f37f4160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:34.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.911+0000 7f37fa52d640 1 --2- 172.21.15.39:0/3080027597 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37f41f9f00 0x7f37f4160b90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f37e8001a30 tx=0x7f37e8007720 comp rx=0 tx=0).stop 2024-05-14T14:40:34.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.911+0000 7f37fa52d640 1 -- 172.21.15.39:0/3080027597 shutdown_connections 2024-05-14T14:40:34.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.911+0000 7f37fa52d640 1 --2- 172.21.15.39:0/3080027597 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f37e00762d0 0x7f37e00787e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.911+0000 7f37fa52d640 1 --2- 172.21.15.39:0/3080027597 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f37f41fa310 0x7f37f41610d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.911+0000 7f37fa52d640 1 --2- 172.21.15.39:0/3080027597 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f37f41f9f00 0x7f37f4160b90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.911+0000 7f37fa52d640 1 --2- 172.21.15.39:0/3080027597 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f37dc003a00 0x7f37f41fe760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:34.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.911+0000 7f37fa52d640 1 -- 172.21.15.39:0/3080027597 >> 172.21.15.39:0/3080027597 conn(0x7f37f40d27d0 msgr2=0x7f37f40b6870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:34.899 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.911+0000 7f37fa52d640 1 -- 172.21.15.39:0/3080027597 shutdown_connections 2024-05-14T14:40:34.900 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:34.911+0000 7f37fa52d640 1 -- 172.21.15.39:0/3080027597 wait complete. 2024-05-14T14:40:34.907 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-05-14T14:40:34.680828+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231864,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742856,"statfs":{"total":773094113280,"available":772856684544,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":234016308},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002915"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353941+0000","last_change":"2024-05-14T14:40:14.954342+0000","last_active":"2024-05-14T14:40:21.353941+0000","last_peered":"2024-05-14T14:40:21.353941+0000","last_clean":"2024-05-14T14:40:21.353941+0000","last_became_active":"2024-05-14T14:40:14.954008+0000","last_became_peered":"2024-05-14T14:40:14.954008+0000","last_unstale":"2024-05-14T14:40:21.353941+0000","last_undegraded":"2024-05-14T14:40:21.353941+0000","last_fullsized":"2024-05-14T14:40:21.353941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:48:44.948315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351459+0000","last_change":"2024-05-14T14:40:15.977901+0000","last_active":"2024-05-14T14:40:21.351459+0000","last_peered":"2024-05-14T14:40:21.351459+0000","last_clean":"2024-05-14T14:40:21.351459+0000","last_became_active":"2024-05-14T14:40:15.977572+0000","last_became_peered":"2024-05-14T14:40:15.977572+0000","last_unstale":"2024-05-14T14:40:21.351459+0000","last_undegraded":"2024-05-14T14:40:21.351459+0000","last_fullsized":"2024-05-14T14:40:21.351459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:53.130907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351078+0000","last_change":"2024-05-14T14:40:20.380801+0000","last_active":"2024-05-14T14:40:21.351078+0000","last_peered":"2024-05-14T14:40:21.351078+0000","last_clean":"2024-05-14T14:40:21.351078+0000","last_became_active":"2024-05-14T14:40:20.379931+0000","last_became_peered":"2024-05-14T14:40:20.379931+0000","last_unstale":"2024-05-14T14:40:21.351078+0000","last_undegraded":"2024-05-14T14:40:21.351078+0000","last_fullsized":"2024-05-14T14:40:21.351078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:06:08.604105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351767+0000","last_change":"2024-05-14T14:40:14.951857+0000","last_active":"2024-05-14T14:40:21.351767+0000","last_peered":"2024-05-14T14:40:21.351767+0000","last_clean":"2024-05-14T14:40:21.351767+0000","last_became_active":"2024-05-14T14:40:14.951514+0000","last_became_peered":"2024-05-14T14:40:14.951514+0000","last_unstale":"2024-05-14T14:40:21.351767+0000","last_undegraded":"2024-05-14T14:40:21.351767+0000","last_fullsized":"2024-05-14T14:40:21.351767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:04:43.508873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353664+0000","last_change":"2024-05-14T14:40:15.954769+0000","last_active":"2024-05-14T14:40:21.353664+0000","last_peered":"2024-05-14T14:40:21.353664+0000","last_clean":"2024-05-14T14:40:21.353664+0000","last_became_active":"2024-05-14T14:40:15.954410+0000","last_became_peered":"2024-05-14T14:40:15.954410+0000","last_unstale":"2024-05-14T14:40:21.353664+0000","last_undegraded":"2024-05-14T14:40:21.353664+0000","last_fullsized":"2024-05-14T14:40:21.353664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:06:01.598712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351319+0000","last_change":"2024-05-14T14:40:20.012885+0000","last_active":"2024-05-14T14:40:21.351319+0000","last_peered":"2024-05-14T14:40:21.351319+0000","last_clean":"2024-05-14T14:40:21.351319+0000","last_became_active":"2024-05-14T14:40:20.012401+0000","last_became_peered":"2024-05-14T14:40:20.012401+0000","last_unstale":"2024-05-14T14:40:21.351319+0000","last_undegraded":"2024-05-14T14:40:21.351319+0000","last_fullsized":"2024-05-14T14:40:21.351319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:24:22.540721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353214+0000","last_change":"2024-05-14T14:40:14.952296+0000","last_active":"2024-05-14T14:40:21.353214+0000","last_peered":"2024-05-14T14:40:21.353214+0000","last_clean":"2024-05-14T14:40:21.353214+0000","last_became_active":"2024-05-14T14:40:14.951962+0000","last_became_peered":"2024-05-14T14:40:14.951962+0000","last_unstale":"2024-05-14T14:40:21.353214+0000","last_undegraded":"2024-05-14T14:40:21.353214+0000","last_fullsized":"2024-05-14T14:40:21.353214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:36:37.730760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006947+0000","last_change":"2024-05-14T14:40:15.952430+0000","last_active":"2024-05-14T14:40:21.006947+0000","last_peered":"2024-05-14T14:40:21.006947+0000","last_clean":"2024-05-14T14:40:21.006947+0000","last_became_active":"2024-05-14T14:40:15.952073+0000","last_became_peered":"2024-05-14T14:40:15.952073+0000","last_unstale":"2024-05-14T14:40:21.006947+0000","last_undegraded":"2024-05-14T14:40:21.006947+0000","last_fullsized":"2024-05-14T14:40:21.006947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:41:42.097310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351837+0000","last_change":"2024-05-14T14:40:20.020148+0000","last_active":"2024-05-14T14:40:21.351837+0000","last_peered":"2024-05-14T14:40:21.351837+0000","last_clean":"2024-05-14T14:40:21.351837+0000","last_became_active":"2024-05-14T14:40:20.019445+0000","last_became_peered":"2024-05-14T14:40:20.019445+0000","last_unstale":"2024-05-14T14:40:21.351837+0000","last_undegraded":"2024-05-14T14:40:21.351837+0000","last_fullsized":"2024-05-14T14:40:21.351837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:41:46.149184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352471+0000","last_change":"2024-05-14T14:40:14.952153+0000","last_active":"2024-05-14T14:40:21.352471+0000","last_peered":"2024-05-14T14:40:21.352471+0000","last_clean":"2024-05-14T14:40:21.352471+0000","last_became_active":"2024-05-14T14:40:14.951611+0000","last_became_peered":"2024-05-14T14:40:14.951611+0000","last_unstale":"2024-05-14T14:40:21.352471+0000","last_undegraded":"2024-05-14T14:40:21.352471+0000","last_fullsized":"2024-05-14T14:40:21.352471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:17:11.948081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.007527+0000","last_change":"2024-05-14T14:40:15.952403+0000","last_active":"2024-05-14T14:40:21.007527+0000","last_peered":"2024-05-14T14:40:21.007527+0000","last_clean":"2024-05-14T14:40:21.007527+0000","last_became_active":"2024-05-14T14:40:15.951977+0000","last_became_peered":"2024-05-14T14:40:15.951977+0000","last_unstale":"2024-05-14T14:40:21.007527+0000","last_undegraded":"2024-05-14T14:40:21.007527+0000","last_fullsized":"2024-05-14T14:40:21.007527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:28:34.783112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351495+0000","last_change":"2024-05-14T14:40:20.014394+0000","last_active":"2024-05-14T14:40:21.351495+0000","last_peered":"2024-05-14T14:40:21.351495+0000","last_clean":"2024-05-14T14:40:21.351495+0000","last_became_active":"2024-05-14T14:40:20.013530+0000","last_became_peered":"2024-05-14T14:40:20.013530+0000","last_unstale":"2024-05-14T14:40:21.351495+0000","last_undegraded":"2024-05-14T14:40:21.351495+0000","last_fullsized":"2024-05-14T14:40:21.351495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:43:19.242522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006074+0000","last_change":"2024-05-14T14:40:15.961488+0000","last_active":"2024-05-14T14:40:21.006074+0000","last_peered":"2024-05-14T14:40:21.006074+0000","last_clean":"2024-05-14T14:40:21.006074+0000","last_became_active":"2024-05-14T14:40:15.960660+0000","last_became_peered":"2024-05-14T14:40:15.960660+0000","last_unstale":"2024-05-14T14:40:21.006074+0000","last_undegraded":"2024-05-14T14:40:21.006074+0000","last_fullsized":"2024-05-14T14:40:21.006074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:54:04.167075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352322+0000","last_change":"2024-05-14T14:40:14.951723+0000","last_active":"2024-05-14T14:40:21.352322+0000","last_peered":"2024-05-14T14:40:21.352322+0000","last_clean":"2024-05-14T14:40:21.352322+0000","last_became_active":"2024-05-14T14:40:14.951352+0000","last_became_peered":"2024-05-14T14:40:14.951352+0000","last_unstale":"2024-05-14T14:40:21.352322+0000","last_undegraded":"2024-05-14T14:40:21.352322+0000","last_fullsized":"2024-05-14T14:40:21.352322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:07:48.920558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352736+0000","last_change":"2024-05-14T14:40:20.014226+0000","last_active":"2024-05-14T14:40:21.352736+0000","last_peered":"2024-05-14T14:40:21.352736+0000","last_clean":"2024-05-14T14:40:21.352736+0000","last_became_active":"2024-05-14T14:40:20.013489+0000","last_became_peered":"2024-05-14T14:40:20.013489+0000","last_unstale":"2024-05-14T14:40:21.352736+0000","last_undegraded":"2024-05-14T14:40:21.352736+0000","last_fullsized":"2024-05-14T14:40:21.352736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:28:38.834985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352716+0000","last_change":"2024-05-14T14:40:15.971905+0000","last_active":"2024-05-14T14:40:21.352716+0000","last_peered":"2024-05-14T14:40:21.352716+0000","last_clean":"2024-05-14T14:40:21.352716+0000","last_became_active":"2024-05-14T14:40:15.971131+0000","last_became_peered":"2024-05-14T14:40:15.971131+0000","last_unstale":"2024-05-14T14:40:21.352716+0000","last_undegraded":"2024-05-14T14:40:21.352716+0000","last_fullsized":"2024-05-14T14:40:21.352716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:43:15.190648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353431+0000","last_change":"2024-05-14T14:40:14.948435+0000","last_active":"2024-05-14T14:40:21.353431+0000","last_peered":"2024-05-14T14:40:21.353431+0000","last_clean":"2024-05-14T14:40:21.353431+0000","last_became_active":"2024-05-14T14:40:14.948096+0000","last_became_peered":"2024-05-14T14:40:14.948096+0000","last_unstale":"2024-05-14T14:40:21.353431+0000","last_undegraded":"2024-05-14T14:40:21.353431+0000","last_fullsized":"2024-05-14T14:40:21.353431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:30:28.647287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351533+0000","last_change":"2024-05-14T14:40:20.019546+0000","last_active":"2024-05-14T14:40:21.351533+0000","last_peered":"2024-05-14T14:40:21.351533+0000","last_clean":"2024-05-14T14:40:21.351533+0000","last_became_active":"2024-05-14T14:40:20.019087+0000","last_became_peered":"2024-05-14T14:40:20.019087+0000","last_unstale":"2024-05-14T14:40:21.351533+0000","last_undegraded":"2024-05-14T14:40:21.351533+0000","last_fullsized":"2024-05-14T14:40:21.351533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:32:25.672575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351856+0000","last_change":"2024-05-14T14:40:15.966369+0000","last_active":"2024-05-14T14:40:21.351856+0000","last_peered":"2024-05-14T14:40:21.351856+0000","last_clean":"2024-05-14T14:40:21.351856+0000","last_became_active":"2024-05-14T14:40:15.965662+0000","last_became_peered":"2024-05-14T14:40:15.965662+0000","last_unstale":"2024-05-14T14:40:21.351856+0000","last_undegraded":"2024-05-14T14:40:21.351856+0000","last_fullsized":"2024-05-14T14:40:21.351856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:23:34.578655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351349+0000","last_change":"2024-05-14T14:40:14.954350+0000","last_active":"2024-05-14T14:40:21.351349+0000","last_peered":"2024-05-14T14:40:21.351349+0000","last_clean":"2024-05-14T14:40:21.351349+0000","last_became_active":"2024-05-14T14:40:14.954046+0000","last_became_peered":"2024-05-14T14:40:14.954046+0000","last_unstale":"2024-05-14T14:40:21.351349+0000","last_undegraded":"2024-05-14T14:40:21.351349+0000","last_fullsized":"2024-05-14T14:40:21.351349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:17:11.948081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353677+0000","last_change":"2024-05-14T14:40:20.379814+0000","last_active":"2024-05-14T14:40:21.353677+0000","last_peered":"2024-05-14T14:40:21.353677+0000","last_clean":"2024-05-14T14:40:21.353677+0000","last_became_active":"2024-05-14T14:40:20.378729+0000","last_became_peered":"2024-05-14T14:40:20.378729+0000","last_unstale":"2024-05-14T14:40:21.353677+0000","last_undegraded":"2024-05-14T14:40:21.353677+0000","last_fullsized":"2024-05-14T14:40:21.353677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:36:41.517853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352411+0000","last_change":"2024-05-14T14:40:15.961572+0000","last_active":"2024-05-14T14:40:21.352411+0000","last_peered":"2024-05-14T14:40:21.352411+0000","last_clean":"2024-05-14T14:40:21.352411+0000","last_became_active":"2024-05-14T14:40:15.961236+0000","last_became_peered":"2024-05-14T14:40:15.961236+0000","last_unstale":"2024-05-14T14:40:21.352411+0000","last_undegraded":"2024-05-14T14:40:21.352411+0000","last_fullsized":"2024-05-14T14:40:21.352411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:30:29.652957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351393+0000","last_change":"2024-05-14T14:40:14.952977+0000","last_active":"2024-05-14T14:40:21.351393+0000","last_peered":"2024-05-14T14:40:21.351393+0000","last_clean":"2024-05-14T14:40:21.351393+0000","last_became_active":"2024-05-14T14:40:14.952638+0000","last_became_peered":"2024-05-14T14:40:14.952638+0000","last_unstale":"2024-05-14T14:40:21.351393+0000","last_undegraded":"2024-05-14T14:40:21.351393+0000","last_fullsized":"2024-05-14T14:40:21.351393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:30:28.647287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353054+0000","last_change":"2024-05-14T14:40:20.019116+0000","last_active":"2024-05-14T14:40:21.353054+0000","last_peered":"2024-05-14T14:40:21.353054+0000","last_clean":"2024-05-14T14:40:21.353054+0000","last_became_active":"2024-05-14T14:40:20.018572+0000","last_became_peered":"2024-05-14T14:40:20.018572+0000","last_unstale":"2024-05-14T14:40:21.353054+0000","last_undegraded":"2024-05-14T14:40:21.353054+0000","last_fullsized":"2024-05-14T14:40:21.353054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:01:01.849694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353666+0000","last_change":"2024-05-14T14:40:15.968343+0000","last_active":"2024-05-14T14:40:21.353666+0000","last_peered":"2024-05-14T14:40:21.353666+0000","last_clean":"2024-05-14T14:40:21.353666+0000","last_became_active":"2024-05-14T14:40:15.967789+0000","last_became_peered":"2024-05-14T14:40:15.967789+0000","last_unstale":"2024-05-14T14:40:21.353666+0000","last_undegraded":"2024-05-14T14:40:21.353666+0000","last_fullsized":"2024-05-14T14:40:21.353666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:53.130907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.007066+0000","last_change":"2024-05-14T14:40:14.949732+0000","last_active":"2024-05-14T14:40:21.007066+0000","last_peered":"2024-05-14T14:40:21.007066+0000","last_clean":"2024-05-14T14:40:21.007066+0000","last_became_active":"2024-05-14T14:40:14.949224+0000","last_became_peered":"2024-05-14T14:40:14.949224+0000","last_unstale":"2024-05-14T14:40:21.007066+0000","last_undegraded":"2024-05-14T14:40:21.007066+0000","last_fullsized":"2024-05-14T14:40:21.007066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:30:28.647287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351359+0000","last_change":"2024-05-14T14:40:20.374754+0000","last_active":"2024-05-14T14:40:21.351359+0000","last_peered":"2024-05-14T14:40:21.351359+0000","last_clean":"2024-05-14T14:40:21.351359+0000","last_became_active":"2024-05-14T14:40:20.373425+0000","last_became_peered":"2024-05-14T14:40:20.373425+0000","last_unstale":"2024-05-14T14:40:21.351359+0000","last_undegraded":"2024-05-14T14:40:21.351359+0000","last_fullsized":"2024-05-14T14:40:21.351359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:59:59.076038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352304+0000","last_change":"2024-05-14T14:40:15.971052+0000","last_active":"2024-05-14T14:40:21.352304+0000","last_peered":"2024-05-14T14:40:21.352304+0000","last_clean":"2024-05-14T14:40:21.352304+0000","last_became_active":"2024-05-14T14:40:15.970626+0000","last_became_peered":"2024-05-14T14:40:15.970626+0000","last_unstale":"2024-05-14T14:40:21.352304+0000","last_undegraded":"2024-05-14T14:40:21.352304+0000","last_fullsized":"2024-05-14T14:40:21.352304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:24:18.488847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353001+0000","last_change":"2024-05-14T14:40:14.945387+0000","last_active":"2024-05-14T14:40:21.353001+0000","last_peered":"2024-05-14T14:40:21.353001+0000","last_clean":"2024-05-14T14:40:21.353001+0000","last_became_active":"2024-05-14T14:40:14.945047+0000","last_became_peered":"2024-05-14T14:40:14.945047+0000","last_unstale":"2024-05-14T14:40:21.353001+0000","last_undegraded":"2024-05-14T14:40:21.353001+0000","last_fullsized":"2024-05-14T14:40:21.353001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:03:50.412968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351995+0000","last_change":"2024-05-14T14:40:20.378427+0000","last_active":"2024-05-14T14:40:21.351995+0000","last_peered":"2024-05-14T14:40:21.351995+0000","last_clean":"2024-05-14T14:40:21.351995+0000","last_became_active":"2024-05-14T14:40:20.377986+0000","last_became_peered":"2024-05-14T14:40:20.377986+0000","last_unstale":"2024-05-14T14:40:21.351995+0000","last_undegraded":"2024-05-14T14:40:21.351995+0000","last_fullsized":"2024-05-14T14:40:21.351995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:43:06.799558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353676+0000","last_change":"2024-05-14T14:40:15.961279+0000","last_active":"2024-05-14T14:40:21.353676+0000","last_peered":"2024-05-14T14:40:21.353676+0000","last_clean":"2024-05-14T14:40:21.353676+0000","last_became_active":"2024-05-14T14:40:15.960895+0000","last_became_peered":"2024-05-14T14:40:15.960895+0000","last_unstale":"2024-05-14T14:40:21.353676+0000","last_undegraded":"2024-05-14T14:40:21.353676+0000","last_fullsized":"2024-05-14T14:40:21.353676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:59:55.024165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353350+0000","last_change":"2024-05-14T14:40:14.952912+0000","last_active":"2024-05-14T14:40:21.353350+0000","last_peered":"2024-05-14T14:40:21.353350+0000","last_clean":"2024-05-14T14:40:21.353350+0000","last_became_active":"2024-05-14T14:40:14.952548+0000","last_became_peered":"2024-05-14T14:40:14.952548+0000","last_unstale":"2024-05-14T14:40:21.353350+0000","last_undegraded":"2024-05-14T14:40:21.353350+0000","last_fullsized":"2024-05-14T14:40:21.353350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:50:00.234669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352297+0000","last_change":"2024-05-14T14:40:20.372845+0000","last_active":"2024-05-14T14:40:21.352297+0000","last_peered":"2024-05-14T14:40:21.352297+0000","last_clean":"2024-05-14T14:40:21.352297+0000","last_became_active":"2024-05-14T14:40:20.372340+0000","last_became_peered":"2024-05-14T14:40:20.372340+0000","last_unstale":"2024-05-14T14:40:21.352297+0000","last_undegraded":"2024-05-14T14:40:21.352297+0000","last_fullsized":"2024-05-14T14:40:21.352297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:28:38.834985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.007718+0000","last_change":"2024-05-14T14:40:15.976323+0000","last_active":"2024-05-14T14:40:21.007718+0000","last_peered":"2024-05-14T14:40:21.007718+0000","last_clean":"2024-05-14T14:40:21.007718+0000","last_became_active":"2024-05-14T14:40:15.975931+0000","last_became_peered":"2024-05-14T14:40:15.975931+0000","last_unstale":"2024-05-14T14:40:21.007718+0000","last_undegraded":"2024-05-14T14:40:21.007718+0000","last_fullsized":"2024-05-14T14:40:21.007718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:00:58.953906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353806+0000","last_change":"2024-05-14T14:40:14.954043+0000","last_active":"2024-05-14T14:40:21.353806+0000","last_peered":"2024-05-14T14:40:21.353806+0000","last_clean":"2024-05-14T14:40:21.353806+0000","last_became_active":"2024-05-14T14:40:14.953734+0000","last_became_peered":"2024-05-14T14:40:14.953734+0000","last_unstale":"2024-05-14T14:40:21.353806+0000","last_undegraded":"2024-05-14T14:40:21.353806+0000","last_fullsized":"2024-05-14T14:40:21.353806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:42:43.352565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351130+0000","last_change":"2024-05-14T14:40:20.015959+0000","last_active":"2024-05-14T14:40:21.351130+0000","last_peered":"2024-05-14T14:40:21.351130+0000","last_clean":"2024-05-14T14:40:21.351130+0000","last_became_active":"2024-05-14T14:40:20.015515+0000","last_became_peered":"2024-05-14T14:40:20.015515+0000","last_unstale":"2024-05-14T14:40:21.351130+0000","last_undegraded":"2024-05-14T14:40:21.351130+0000","last_fullsized":"2024-05-14T14:40:21.351130+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:01:01.849694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352393+0000","last_change":"2024-05-14T14:40:15.950703+0000","last_active":"2024-05-14T14:40:21.352393+0000","last_peered":"2024-05-14T14:40:21.352393+0000","last_clean":"2024-05-14T14:40:21.352393+0000","last_became_active":"2024-05-14T14:40:15.950367+0000","last_became_peered":"2024-05-14T14:40:15.950367+0000","last_unstale":"2024-05-14T14:40:21.352393+0000","last_undegraded":"2024-05-14T14:40:21.352393+0000","last_fullsized":"2024-05-14T14:40:21.352393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:22:55.057837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006627+0000","last_change":"2024-05-14T14:40:14.942269+0000","last_active":"2024-05-14T14:40:21.006627+0000","last_peered":"2024-05-14T14:40:21.006627+0000","last_clean":"2024-05-14T14:40:21.006627+0000","last_became_active":"2024-05-14T14:40:14.941907+0000","last_became_peered":"2024-05-14T14:40:14.941907+0000","last_unstale":"2024-05-14T14:40:21.006627+0000","last_undegraded":"2024-05-14T14:40:21.006627+0000","last_fullsized":"2024-05-14T14:40:21.006627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:22:54.052167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353476+0000","last_change":"2024-05-14T14:40:20.021170+0000","last_active":"2024-05-14T14:40:21.353476+0000","last_peered":"2024-05-14T14:40:21.353476+0000","last_clean":"2024-05-14T14:40:21.353476+0000","last_became_active":"2024-05-14T14:40:20.019417+0000","last_became_peered":"2024-05-14T14:40:20.019417+0000","last_unstale":"2024-05-14T14:40:21.353476+0000","last_undegraded":"2024-05-14T14:40:21.353476+0000","last_fullsized":"2024-05-14T14:40:21.353476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:55:00.709986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351519+0000","last_change":"2024-05-14T14:40:15.962249+0000","last_active":"2024-05-14T14:40:21.351519+0000","last_peered":"2024-05-14T14:40:21.351519+0000","last_clean":"2024-05-14T14:40:21.351519+0000","last_became_active":"2024-05-14T14:40:15.961914+0000","last_became_peered":"2024-05-14T14:40:15.961914+0000","last_unstale":"2024-05-14T14:40:21.351519+0000","last_undegraded":"2024-05-14T14:40:21.351519+0000","last_fullsized":"2024-05-14T14:40:21.351519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:16:59.783346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.004576+0000","last_change":"2024-05-14T14:40:14.945511+0000","last_active":"2024-05-14T14:40:21.004576+0000","last_peered":"2024-05-14T14:40:21.004576+0000","last_clean":"2024-05-14T14:40:21.004576+0000","last_became_active":"2024-05-14T14:40:14.945162+0000","last_became_peered":"2024-05-14T14:40:14.945162+0000","last_unstale":"2024-05-14T14:40:21.004576+0000","last_undegraded":"2024-05-14T14:40:21.004576+0000","last_fullsized":"2024-05-14T14:40:21.004576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:03:50.412968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353899+0000","last_change":"2024-05-14T14:40:20.021422+0000","last_active":"2024-05-14T14:40:21.353899+0000","last_peered":"2024-05-14T14:40:21.353899+0000","last_clean":"2024-05-14T14:40:21.353899+0000","last_became_active":"2024-05-14T14:40:20.020363+0000","last_became_peered":"2024-05-14T14:40:20.020363+0000","last_unstale":"2024-05-14T14:40:21.353899+0000","last_undegraded":"2024-05-14T14:40:21.353899+0000","last_fullsized":"2024-05-14T14:40:21.353899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:09:34.037991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351255+0000","last_change":"2024-05-14T14:40:15.956227+0000","last_active":"2024-05-14T14:40:21.351255+0000","last_peered":"2024-05-14T14:40:21.351255+0000","last_clean":"2024-05-14T14:40:21.351255+0000","last_became_active":"2024-05-14T14:40:15.955850+0000","last_became_peered":"2024-05-14T14:40:15.955850+0000","last_unstale":"2024-05-14T14:40:21.351255+0000","last_undegraded":"2024-05-14T14:40:21.351255+0000","last_fullsized":"2024-05-14T14:40:21.351255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:19:45.703395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351460+0000","last_change":"2024-05-14T14:40:14.953611+0000","last_active":"2024-05-14T14:40:21.351460+0000","last_peered":"2024-05-14T14:40:21.351460+0000","last_clean":"2024-05-14T14:40:21.351460+0000","last_became_active":"2024-05-14T14:40:14.953288+0000","last_became_peered":"2024-05-14T14:40:14.953288+0000","last_unstale":"2024-05-14T14:40:21.351460+0000","last_undegraded":"2024-05-14T14:40:21.351460+0000","last_fullsized":"2024-05-14T14:40:21.351460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:22:54.052167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353571+0000","last_change":"2024-05-14T14:40:20.372908+0000","last_active":"2024-05-14T14:40:21.353571+0000","last_peered":"2024-05-14T14:40:21.353571+0000","last_clean":"2024-05-14T14:40:21.353571+0000","last_became_active":"2024-05-14T14:40:20.372440+0000","last_became_peered":"2024-05-14T14:40:20.372440+0000","last_unstale":"2024-05-14T14:40:21.353571+0000","last_undegraded":"2024-05-14T14:40:21.353571+0000","last_fullsized":"2024-05-14T14:40:21.353571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:36:41.517853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352312+0000","last_change":"2024-05-14T14:40:15.978286+0000","last_active":"2024-05-14T14:40:21.352312+0000","last_peered":"2024-05-14T14:40:21.352312+0000","last_clean":"2024-05-14T14:40:21.352312+0000","last_became_active":"2024-05-14T14:40:15.977864+0000","last_became_peered":"2024-05-14T14:40:15.977864+0000","last_unstale":"2024-05-14T14:40:21.352312+0000","last_undegraded":"2024-05-14T14:40:21.352312+0000","last_fullsized":"2024-05-14T14:40:21.352312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:16:59.783346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.005670+0000","last_change":"2024-05-14T14:40:14.939289+0000","last_active":"2024-05-14T14:40:21.005670+0000","last_peered":"2024-05-14T14:40:21.005670+0000","last_clean":"2024-05-14T14:40:21.005670+0000","last_became_active":"2024-05-14T14:40:14.938761+0000","last_became_peered":"2024-05-14T14:40:14.938761+0000","last_unstale":"2024-05-14T14:40:21.005670+0000","last_undegraded":"2024-05-14T14:40:21.005670+0000","last_fullsized":"2024-05-14T14:40:21.005670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:09:41.002376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":118,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351602+0000","last_change":"2024-05-14T14:40:06.302050+0000","last_active":"2024-05-14T14:40:21.351602+0000","last_peered":"2024-05-14T14:40:21.351602+0000","last_clean":"2024-05-14T14:40:21.351602+0000","last_became_active":"2024-05-14T14:40:06.300956+0000","last_became_peered":"2024-05-14T14:40:06.300956+0000","last_unstale":"2024-05-14T14:40:21.351602+0000","last_undegraded":"2024-05-14T14:40:21.351602+0000","last_fullsized":"2024-05-14T14:40:21.351602+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:04.850996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:04.850996+0000","last_clean_scrub_stamp":"2024-05-14T14:40:04.850996+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:08:41.028114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006296+0000","last_change":"2024-05-14T14:40:20.378549+0000","last_active":"2024-05-14T14:40:21.006296+0000","last_peered":"2024-05-14T14:40:21.006296+0000","last_clean":"2024-05-14T14:40:21.006296+0000","last_became_active":"2024-05-14T14:40:20.377998+0000","last_became_peered":"2024-05-14T14:40:20.377998+0000","last_unstale":"2024-05-14T14:40:21.006296+0000","last_undegraded":"2024-05-14T14:40:21.006296+0000","last_fullsized":"2024-05-14T14:40:21.006296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:01:01.849694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353100+0000","last_change":"2024-05-14T14:40:15.976278+0000","last_active":"2024-05-14T14:40:21.353100+0000","last_peered":"2024-05-14T14:40:21.353100+0000","last_clean":"2024-05-14T14:40:21.353100+0000","last_became_active":"2024-05-14T14:40:15.975906+0000","last_became_peered":"2024-05-14T14:40:15.975906+0000","last_unstale":"2024-05-14T14:40:21.353100+0000","last_undegraded":"2024-05-14T14:40:21.353100+0000","last_fullsized":"2024-05-14T14:40:21.353100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:41:42.097310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.004906+0000","last_change":"2024-05-14T14:40:14.949811+0000","last_active":"2024-05-14T14:40:21.004906+0000","last_peered":"2024-05-14T14:40:21.004906+0000","last_clean":"2024-05-14T14:40:21.004906+0000","last_became_active":"2024-05-14T14:40:14.949472+0000","last_became_peered":"2024-05-14T14:40:14.949472+0000","last_unstale":"2024-05-14T14:40:21.004906+0000","last_undegraded":"2024-05-14T14:40:21.004906+0000","last_fullsized":"2024-05-14T14:40:21.004906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:09:41.002376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.005991+0000","last_change":"2024-05-14T14:40:20.372940+0000","last_active":"2024-05-14T14:40:21.005991+0000","last_peered":"2024-05-14T14:40:21.005991+0000","last_clean":"2024-05-14T14:40:21.005991+0000","last_became_active":"2024-05-14T14:40:20.372407+0000","last_became_peered":"2024-05-14T14:40:20.372407+0000","last_unstale":"2024-05-14T14:40:21.005991+0000","last_undegraded":"2024-05-14T14:40:21.005991+0000","last_fullsized":"2024-05-14T14:40:21.005991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:28:38.834985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.007082+0000","last_change":"2024-05-14T14:40:15.972277+0000","last_active":"2024-05-14T14:40:21.007082+0000","last_peered":"2024-05-14T14:40:21.007082+0000","last_clean":"2024-05-14T14:40:21.007082+0000","last_became_active":"2024-05-14T14:40:15.971952+0000","last_became_peered":"2024-05-14T14:40:15.971952+0000","last_unstale":"2024-05-14T14:40:21.007082+0000","last_undegraded":"2024-05-14T14:40:21.007082+0000","last_fullsized":"2024-05-14T14:40:21.007082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:00:57.797820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352274+0000","last_change":"2024-05-14T14:40:14.940215+0000","last_active":"2024-05-14T14:40:21.352274+0000","last_peered":"2024-05-14T14:40:21.352274+0000","last_clean":"2024-05-14T14:40:21.352274+0000","last_became_active":"2024-05-14T14:40:14.939878+0000","last_became_peered":"2024-05-14T14:40:14.939878+0000","last_unstale":"2024-05-14T14:40:21.352274+0000","last_undegraded":"2024-05-14T14:40:21.352274+0000","last_fullsized":"2024-05-14T14:40:21.352274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:36:37.730760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352612+0000","last_change":"2024-05-14T14:40:20.022658+0000","last_active":"2024-05-14T14:40:21.352612+0000","last_peered":"2024-05-14T14:40:21.352612+0000","last_clean":"2024-05-14T14:40:21.352612+0000","last_became_active":"2024-05-14T14:40:20.022176+0000","last_became_peered":"2024-05-14T14:40:20.022176+0000","last_unstale":"2024-05-14T14:40:21.352612+0000","last_undegraded":"2024-05-14T14:40:21.352612+0000","last_fullsized":"2024-05-14T14:40:21.352612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:01:01.849694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352973+0000","last_change":"2024-05-14T14:40:15.973870+0000","last_active":"2024-05-14T14:40:21.352973+0000","last_peered":"2024-05-14T14:40:21.352973+0000","last_clean":"2024-05-14T14:40:21.352973+0000","last_became_active":"2024-05-14T14:40:15.973324+0000","last_became_peered":"2024-05-14T14:40:15.973324+0000","last_unstale":"2024-05-14T14:40:21.352973+0000","last_undegraded":"2024-05-14T14:40:21.352973+0000","last_fullsized":"2024-05-14T14:40:21.352973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:19:26.250841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.004828+0000","last_change":"2024-05-14T14:40:14.942944+0000","last_active":"2024-05-14T14:40:21.004828+0000","last_peered":"2024-05-14T14:40:21.004828+0000","last_clean":"2024-05-14T14:40:21.004828+0000","last_became_active":"2024-05-14T14:40:14.942604+0000","last_became_peered":"2024-05-14T14:40:14.942604+0000","last_unstale":"2024-05-14T14:40:21.004828+0000","last_undegraded":"2024-05-14T14:40:21.004828+0000","last_fullsized":"2024-05-14T14:40:21.004828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:42:43.352565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.005290+0000","last_change":"2024-05-14T14:40:20.373005+0000","last_active":"2024-05-14T14:40:21.005290+0000","last_peered":"2024-05-14T14:40:21.005290+0000","last_clean":"2024-05-14T14:40:21.005290+0000","last_became_active":"2024-05-14T14:40:20.372502+0000","last_became_peered":"2024-05-14T14:40:20.372502+0000","last_unstale":"2024-05-14T14:40:21.005290+0000","last_undegraded":"2024-05-14T14:40:21.005290+0000","last_fullsized":"2024-05-14T14:40:21.005290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:43:06.799558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352729+0000","last_change":"2024-05-14T14:40:15.978754+0000","last_active":"2024-05-14T14:40:21.352729+0000","last_peered":"2024-05-14T14:40:21.352729+0000","last_clean":"2024-05-14T14:40:21.352729+0000","last_became_active":"2024-05-14T14:40:15.978406+0000","last_became_peered":"2024-05-14T14:40:15.978406+0000","last_unstale":"2024-05-14T14:40:21.352729+0000","last_undegraded":"2024-05-14T14:40:21.352729+0000","last_fullsized":"2024-05-14T14:40:21.352729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:00:58.953906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352912+0000","last_change":"2024-05-14T14:40:14.950699+0000","last_active":"2024-05-14T14:40:21.352912+0000","last_peered":"2024-05-14T14:40:21.352912+0000","last_clean":"2024-05-14T14:40:21.352912+0000","last_became_active":"2024-05-14T14:40:14.950333+0000","last_became_peered":"2024-05-14T14:40:14.950333+0000","last_unstale":"2024-05-14T14:40:21.352912+0000","last_undegraded":"2024-05-14T14:40:21.352912+0000","last_fullsized":"2024-05-14T14:40:21.352912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:59:30.772720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351835+0000","last_change":"2024-05-14T14:40:20.019464+0000","last_active":"2024-05-14T14:40:21.351835+0000","last_peered":"2024-05-14T14:40:21.351835+0000","last_clean":"2024-05-14T14:40:21.351835+0000","last_became_active":"2024-05-14T14:40:20.018546+0000","last_became_peered":"2024-05-14T14:40:20.018546+0000","last_unstale":"2024-05-14T14:40:21.351835+0000","last_undegraded":"2024-05-14T14:40:21.351835+0000","last_fullsized":"2024-05-14T14:40:21.351835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:58:53.100702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352000+0000","last_change":"2024-05-14T14:40:15.979685+0000","last_active":"2024-05-14T14:40:21.352000+0000","last_peered":"2024-05-14T14:40:21.352000+0000","last_clean":"2024-05-14T14:40:21.352000+0000","last_became_active":"2024-05-14T14:40:15.979324+0000","last_became_peered":"2024-05-14T14:40:15.979324+0000","last_unstale":"2024-05-14T14:40:21.352000+0000","last_undegraded":"2024-05-14T14:40:21.352000+0000","last_fullsized":"2024-05-14T14:40:21.352000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:43:15.190648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.004331+0000","last_change":"2024-05-14T14:40:14.940764+0000","last_active":"2024-05-14T14:40:21.004331+0000","last_peered":"2024-05-14T14:40:21.004331+0000","last_clean":"2024-05-14T14:40:21.004331+0000","last_became_active":"2024-05-14T14:40:14.940412+0000","last_became_peered":"2024-05-14T14:40:14.940412+0000","last_unstale":"2024-05-14T14:40:21.004331+0000","last_undegraded":"2024-05-14T14:40:21.004331+0000","last_fullsized":"2024-05-14T14:40:21.004331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:04:43.508873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353379+0000","last_change":"2024-05-14T14:40:20.019451+0000","last_active":"2024-05-14T14:40:21.353379+0000","last_peered":"2024-05-14T14:40:21.353379+0000","last_clean":"2024-05-14T14:40:21.353379+0000","last_became_active":"2024-05-14T14:40:20.018790+0000","last_became_peered":"2024-05-14T14:40:20.018790+0000","last_unstale":"2024-05-14T14:40:21.353379+0000","last_undegraded":"2024-05-14T14:40:21.353379+0000","last_fullsized":"2024-05-14T14:40:21.353379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:55:00.709986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.005590+0000","last_change":"2024-05-14T14:40:15.967830+0000","last_active":"2024-05-14T14:40:21.005590+0000","last_peered":"2024-05-14T14:40:21.005590+0000","last_clean":"2024-05-14T14:40:21.005590+0000","last_became_active":"2024-05-14T14:40:15.967508+0000","last_became_peered":"2024-05-14T14:40:15.967508+0000","last_unstale":"2024-05-14T14:40:21.005590+0000","last_undegraded":"2024-05-14T14:40:21.005590+0000","last_fullsized":"2024-05-14T14:40:21.005590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:06:01.598712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006580+0000","last_change":"2024-05-14T14:40:14.940313+0000","last_active":"2024-05-14T14:40:21.006580+0000","last_peered":"2024-05-14T14:40:21.006580+0000","last_clean":"2024-05-14T14:40:21.006580+0000","last_became_active":"2024-05-14T14:40:14.939989+0000","last_became_peered":"2024-05-14T14:40:14.939989+0000","last_unstale":"2024-05-14T14:40:21.006580+0000","last_undegraded":"2024-05-14T14:40:21.006580+0000","last_fullsized":"2024-05-14T14:40:21.006580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:09:41.002376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352073+0000","last_change":"2024-05-14T14:40:20.379270+0000","last_active":"2024-05-14T14:40:21.352073+0000","last_peered":"2024-05-14T14:40:21.352073+0000","last_clean":"2024-05-14T14:40:21.352073+0000","last_became_active":"2024-05-14T14:40:20.378163+0000","last_became_peered":"2024-05-14T14:40:20.378163+0000","last_unstale":"2024-05-14T14:40:21.352073+0000","last_undegraded":"2024-05-14T14:40:21.352073+0000","last_fullsized":"2024-05-14T14:40:21.352073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:56:23.335268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352261+0000","last_change":"2024-05-14T14:40:15.979702+0000","last_active":"2024-05-14T14:40:21.352261+0000","last_peered":"2024-05-14T14:40:21.352261+0000","last_clean":"2024-05-14T14:40:21.352261+0000","last_became_active":"2024-05-14T14:40:15.978801+0000","last_became_peered":"2024-05-14T14:40:15.978801+0000","last_unstale":"2024-05-14T14:40:21.352261+0000","last_undegraded":"2024-05-14T14:40:21.352261+0000","last_fullsized":"2024-05-14T14:40:21.352261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:28:34.783112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006507+0000","last_change":"2024-05-14T14:40:14.946153+0000","last_active":"2024-05-14T14:40:21.006507+0000","last_peered":"2024-05-14T14:40:21.006507+0000","last_clean":"2024-05-14T14:40:21.006507+0000","last_became_active":"2024-05-14T14:40:14.945598+0000","last_became_peered":"2024-05-14T14:40:14.945598+0000","last_unstale":"2024-05-14T14:40:21.006507+0000","last_undegraded":"2024-05-14T14:40:21.006507+0000","last_fullsized":"2024-05-14T14:40:21.006507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:30:28.647287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352265+0000","last_change":"2024-05-14T14:40:20.373021+0000","last_active":"2024-05-14T14:40:21.352265+0000","last_peered":"2024-05-14T14:40:21.352265+0000","last_clean":"2024-05-14T14:40:21.352265+0000","last_became_active":"2024-05-14T14:40:20.372611+0000","last_became_peered":"2024-05-14T14:40:20.372611+0000","last_unstale":"2024-05-14T14:40:21.352265+0000","last_undegraded":"2024-05-14T14:40:21.352265+0000","last_fullsized":"2024-05-14T14:40:21.352265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:20:04.831495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352027+0000","last_change":"2024-05-14T14:40:15.963419+0000","last_active":"2024-05-14T14:40:21.352027+0000","last_peered":"2024-05-14T14:40:21.352027+0000","last_clean":"2024-05-14T14:40:21.352027+0000","last_became_active":"2024-05-14T14:40:15.963015+0000","last_became_peered":"2024-05-14T14:40:15.963015+0000","last_unstale":"2024-05-14T14:40:21.352027+0000","last_undegraded":"2024-05-14T14:40:21.352027+0000","last_fullsized":"2024-05-14T14:40:21.352027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:02:28.598796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353002+0000","last_change":"2024-05-14T14:40:14.950887+0000","last_active":"2024-05-14T14:40:21.353002+0000","last_peered":"2024-05-14T14:40:21.353002+0000","last_clean":"2024-05-14T14:40:21.353002+0000","last_became_active":"2024-05-14T14:40:14.950546+0000","last_became_peered":"2024-05-14T14:40:14.950546+0000","last_unstale":"2024-05-14T14:40:21.353002+0000","last_undegraded":"2024-05-14T14:40:21.353002+0000","last_fullsized":"2024-05-14T14:40:21.353002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:15:53.584304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.007527+0000","last_change":"2024-05-14T14:40:20.378686+0000","last_active":"2024-05-14T14:40:21.007527+0000","last_peered":"2024-05-14T14:40:21.007527+0000","last_clean":"2024-05-14T14:40:21.007527+0000","last_became_active":"2024-05-14T14:40:20.378123+0000","last_became_peered":"2024-05-14T14:40:20.378123+0000","last_unstale":"2024-05-14T14:40:21.007527+0000","last_undegraded":"2024-05-14T14:40:21.007527+0000","last_fullsized":"2024-05-14T14:40:21.007527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:56:23.335268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352960+0000","last_change":"2024-05-14T14:40:15.973748+0000","last_active":"2024-05-14T14:40:21.352960+0000","last_peered":"2024-05-14T14:40:21.352960+0000","last_clean":"2024-05-14T14:40:21.352960+0000","last_became_active":"2024-05-14T14:40:15.972604+0000","last_became_peered":"2024-05-14T14:40:15.972604+0000","last_unstale":"2024-05-14T14:40:21.352960+0000","last_undegraded":"2024-05-14T14:40:21.352960+0000","last_fullsized":"2024-05-14T14:40:21.352960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:00:57.797820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:25.672493+0000","last_change":"2024-05-14T14:40:14.953883+0000","last_active":"2024-05-14T14:40:25.672493+0000","last_peered":"2024-05-14T14:40:25.672493+0000","last_clean":"2024-05-14T14:40:25.672493+0000","last_became_active":"2024-05-14T14:40:14.953540+0000","last_became_peered":"2024-05-14T14:40:14.953540+0000","last_unstale":"2024-05-14T14:40:25.672493+0000","last_undegraded":"2024-05-14T14:40:25.672493+0000","last_fullsized":"2024-05-14T14:40:25.672493+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:22:54.052167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353319+0000","last_change":"2024-05-14T14:40:20.017238+0000","last_active":"2024-05-14T14:40:21.353319+0000","last_peered":"2024-05-14T14:40:21.353319+0000","last_clean":"2024-05-14T14:40:21.353319+0000","last_became_active":"2024-05-14T14:40:20.016725+0000","last_became_peered":"2024-05-14T14:40:20.016725+0000","last_unstale":"2024-05-14T14:40:21.353319+0000","last_undegraded":"2024-05-14T14:40:21.353319+0000","last_fullsized":"2024-05-14T14:40:21.353319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:01:03.005779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352553+0000","last_change":"2024-05-14T14:40:15.965371+0000","last_active":"2024-05-14T14:40:21.352553+0000","last_peered":"2024-05-14T14:40:21.352553+0000","last_clean":"2024-05-14T14:40:21.352553+0000","last_became_active":"2024-05-14T14:40:15.964988+0000","last_became_peered":"2024-05-14T14:40:15.964988+0000","last_unstale":"2024-05-14T14:40:21.352553+0000","last_undegraded":"2024-05-14T14:40:21.352553+0000","last_fullsized":"2024-05-14T14:40:21.352553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:17:12.953751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352156+0000","last_change":"2024-05-14T14:40:14.950270+0000","last_active":"2024-05-14T14:40:21.352156+0000","last_peered":"2024-05-14T14:40:21.352156+0000","last_clean":"2024-05-14T14:40:21.352156+0000","last_became_active":"2024-05-14T14:40:14.949473+0000","last_became_peered":"2024-05-14T14:40:14.949473+0000","last_unstale":"2024-05-14T14:40:21.352156+0000","last_undegraded":"2024-05-14T14:40:21.352156+0000","last_fullsized":"2024-05-14T14:40:21.352156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:22:54.052167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351973+0000","last_change":"2024-05-14T14:40:20.008055+0000","last_active":"2024-05-14T14:40:21.351973+0000","last_peered":"2024-05-14T14:40:21.351973+0000","last_clean":"2024-05-14T14:40:21.351973+0000","last_became_active":"2024-05-14T14:40:20.007482+0000","last_became_peered":"2024-05-14T14:40:20.007482+0000","last_unstale":"2024-05-14T14:40:21.351973+0000","last_undegraded":"2024-05-14T14:40:21.351973+0000","last_fullsized":"2024-05-14T14:40:21.351973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:20:24.893525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353866+0000","last_change":"2024-05-14T14:40:15.954872+0000","last_active":"2024-05-14T14:40:21.353866+0000","last_peered":"2024-05-14T14:40:21.353866+0000","last_clean":"2024-05-14T14:40:21.353866+0000","last_became_active":"2024-05-14T14:40:15.954475+0000","last_became_peered":"2024-05-14T14:40:15.954475+0000","last_unstale":"2024-05-14T14:40:21.353866+0000","last_undegraded":"2024-05-14T14:40:21.353866+0000","last_fullsized":"2024-05-14T14:40:21.353866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:16:59.783346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.007184+0000","last_change":"2024-05-14T14:40:14.946318+0000","last_active":"2024-05-14T14:40:21.007184+0000","last_peered":"2024-05-14T14:40:21.007184+0000","last_clean":"2024-05-14T14:40:21.007184+0000","last_became_active":"2024-05-14T14:40:14.945963+0000","last_became_peered":"2024-05-14T14:40:14.945963+0000","last_unstale":"2024-05-14T14:40:21.007184+0000","last_undegraded":"2024-05-14T14:40:21.007184+0000","last_fullsized":"2024-05-14T14:40:21.007184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:03:50.412968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351737+0000","last_change":"2024-05-14T14:40:20.012702+0000","last_active":"2024-05-14T14:40:21.351737+0000","last_peered":"2024-05-14T14:40:21.351737+0000","last_clean":"2024-05-14T14:40:21.351737+0000","last_became_active":"2024-05-14T14:40:20.012262+0000","last_became_peered":"2024-05-14T14:40:20.012262+0000","last_unstale":"2024-05-14T14:40:21.351737+0000","last_undegraded":"2024-05-14T14:40:21.351737+0000","last_fullsized":"2024-05-14T14:40:21.351737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:12:03.474411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.007052+0000","last_change":"2024-05-14T14:40:15.967089+0000","last_active":"2024-05-14T14:40:21.007052+0000","last_peered":"2024-05-14T14:40:21.007052+0000","last_clean":"2024-05-14T14:40:21.007052+0000","last_became_active":"2024-05-14T14:40:15.963492+0000","last_became_peered":"2024-05-14T14:40:15.963492+0000","last_unstale":"2024-05-14T14:40:21.007052+0000","last_undegraded":"2024-05-14T14:40:21.007052+0000","last_fullsized":"2024-05-14T14:40:21.007052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:54:56.658112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006874+0000","last_change":"2024-05-14T14:40:14.949559+0000","last_active":"2024-05-14T14:40:21.006874+0000","last_peered":"2024-05-14T14:40:21.006874+0000","last_clean":"2024-05-14T14:40:21.006874+0000","last_became_active":"2024-05-14T14:40:14.949108+0000","last_became_peered":"2024-05-14T14:40:14.949108+0000","last_unstale":"2024-05-14T14:40:21.006874+0000","last_undegraded":"2024-05-14T14:40:21.006874+0000","last_fullsized":"2024-05-14T14:40:21.006874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:03:50.412968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352199+0000","last_change":"2024-05-14T14:40:20.380409+0000","last_active":"2024-05-14T14:40:21.352199+0000","last_peered":"2024-05-14T14:40:21.352199+0000","last_clean":"2024-05-14T14:40:21.352199+0000","last_became_active":"2024-05-14T14:40:20.377982+0000","last_became_peered":"2024-05-14T14:40:20.377982+0000","last_unstale":"2024-05-14T14:40:21.352199+0000","last_undegraded":"2024-05-14T14:40:21.352199+0000","last_fullsized":"2024-05-14T14:40:21.352199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:54:43.610454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353208+0000","last_change":"2024-05-14T14:40:20.378415+0000","last_active":"2024-05-14T14:40:21.353208+0000","last_peered":"2024-05-14T14:40:21.353208+0000","last_clean":"2024-05-14T14:40:21.353208+0000","last_became_active":"2024-05-14T14:40:20.378008+0000","last_became_peered":"2024-05-14T14:40:20.378008+0000","last_unstale":"2024-05-14T14:40:21.353208+0000","last_undegraded":"2024-05-14T14:40:21.353208+0000","last_fullsized":"2024-05-14T14:40:21.353208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:01:03.005779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351155+0000","last_change":"2024-05-14T14:40:15.973814+0000","last_active":"2024-05-14T14:40:21.351155+0000","last_peered":"2024-05-14T14:40:21.351155+0000","last_clean":"2024-05-14T14:40:21.351155+0000","last_became_active":"2024-05-14T14:40:15.972930+0000","last_became_peered":"2024-05-14T14:40:15.972930+0000","last_unstale":"2024-05-14T14:40:21.351155+0000","last_undegraded":"2024-05-14T14:40:21.351155+0000","last_fullsized":"2024-05-14T14:40:21.351155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:54:04.167075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.005569+0000","last_change":"2024-05-14T14:40:14.940248+0000","last_active":"2024-05-14T14:40:21.005569+0000","last_peered":"2024-05-14T14:40:21.005569+0000","last_clean":"2024-05-14T14:40:21.005569+0000","last_became_active":"2024-05-14T14:40:14.938524+0000","last_became_peered":"2024-05-14T14:40:14.938524+0000","last_unstale":"2024-05-14T14:40:21.005569+0000","last_undegraded":"2024-05-14T14:40:21.005569+0000","last_fullsized":"2024-05-14T14:40:21.005569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:42:43.352565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006899+0000","last_change":"2024-05-14T14:40:20.017769+0000","last_active":"2024-05-14T14:40:21.006899+0000","last_peered":"2024-05-14T14:40:21.006899+0000","last_clean":"2024-05-14T14:40:21.006899+0000","last_became_active":"2024-05-14T14:40:20.017248+0000","last_became_peered":"2024-05-14T14:40:20.017248+0000","last_unstale":"2024-05-14T14:40:21.006899+0000","last_undegraded":"2024-05-14T14:40:21.006899+0000","last_fullsized":"2024-05-14T14:40:21.006899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:01:03.005779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351813+0000","last_change":"2024-05-14T14:40:15.970841+0000","last_active":"2024-05-14T14:40:21.351813+0000","last_peered":"2024-05-14T14:40:21.351813+0000","last_clean":"2024-05-14T14:40:21.351813+0000","last_became_active":"2024-05-14T14:40:15.970405+0000","last_became_peered":"2024-05-14T14:40:15.970405+0000","last_unstale":"2024-05-14T14:40:21.351813+0000","last_undegraded":"2024-05-14T14:40:21.351813+0000","last_fullsized":"2024-05-14T14:40:21.351813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:06:01.598712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351688+0000","last_change":"2024-05-14T14:40:14.952894+0000","last_active":"2024-05-14T14:40:21.351688+0000","last_peered":"2024-05-14T14:40:21.351688+0000","last_clean":"2024-05-14T14:40:21.351688+0000","last_became_active":"2024-05-14T14:40:14.952591+0000","last_became_peered":"2024-05-14T14:40:14.952591+0000","last_unstale":"2024-05-14T14:40:21.351688+0000","last_undegraded":"2024-05-14T14:40:21.351688+0000","last_fullsized":"2024-05-14T14:40:21.351688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:09:41.002376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006239+0000","last_change":"2024-05-14T14:40:14.942311+0000","last_active":"2024-05-14T14:40:21.006239+0000","last_peered":"2024-05-14T14:40:21.006239+0000","last_clean":"2024-05-14T14:40:21.006239+0000","last_became_active":"2024-05-14T14:40:14.941964+0000","last_became_peered":"2024-05-14T14:40:14.941964+0000","last_unstale":"2024-05-14T14:40:21.006239+0000","last_undegraded":"2024-05-14T14:40:21.006239+0000","last_fullsized":"2024-05-14T14:40:21.006239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:42:43.352565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352830+0000","last_change":"2024-05-14T14:40:15.955268+0000","last_active":"2024-05-14T14:40:21.352830+0000","last_peered":"2024-05-14T14:40:21.352830+0000","last_clean":"2024-05-14T14:40:21.352830+0000","last_became_active":"2024-05-14T14:40:15.954880+0000","last_became_peered":"2024-05-14T14:40:15.954880+0000","last_unstale":"2024-05-14T14:40:21.352830+0000","last_undegraded":"2024-05-14T14:40:21.352830+0000","last_fullsized":"2024-05-14T14:40:21.352830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:24:18.488847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.004720+0000","last_change":"2024-05-14T14:40:20.009663+0000","last_active":"2024-05-14T14:40:21.004720+0000","last_peered":"2024-05-14T14:40:21.004720+0000","last_clean":"2024-05-14T14:40:21.004720+0000","last_became_active":"2024-05-14T14:40:20.009220+0000","last_became_peered":"2024-05-14T14:40:20.009220+0000","last_unstale":"2024-05-14T14:40:21.004720+0000","last_undegraded":"2024-05-14T14:40:21.004720+0000","last_fullsized":"2024-05-14T14:40:21.004720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:19:49.755269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352741+0000","last_change":"2024-05-14T14:40:14.947750+0000","last_active":"2024-05-14T14:40:21.352741+0000","last_peered":"2024-05-14T14:40:21.352741+0000","last_clean":"2024-05-14T14:40:21.352741+0000","last_became_active":"2024-05-14T14:40:14.947440+0000","last_became_peered":"2024-05-14T14:40:14.947440+0000","last_unstale":"2024-05-14T14:40:21.352741+0000","last_undegraded":"2024-05-14T14:40:21.352741+0000","last_fullsized":"2024-05-14T14:40:21.352741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:48:44.948315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352347+0000","last_change":"2024-05-14T14:40:15.970419+0000","last_active":"2024-05-14T14:40:21.352347+0000","last_peered":"2024-05-14T14:40:21.352347+0000","last_clean":"2024-05-14T14:40:21.352347+0000","last_became_active":"2024-05-14T14:40:15.969621+0000","last_became_peered":"2024-05-14T14:40:15.969621+0000","last_unstale":"2024-05-14T14:40:21.352347+0000","last_undegraded":"2024-05-14T14:40:21.352347+0000","last_fullsized":"2024-05-14T14:40:21.352347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:03:51.418638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353215+0000","last_change":"2024-05-14T14:40:20.023154+0000","last_active":"2024-05-14T14:40:21.353215+0000","last_peered":"2024-05-14T14:40:21.353215+0000","last_clean":"2024-05-14T14:40:21.353215+0000","last_became_active":"2024-05-14T14:40:20.022012+0000","last_became_peered":"2024-05-14T14:40:20.022012+0000","last_unstale":"2024-05-14T14:40:21.353215+0000","last_undegraded":"2024-05-14T14:40:21.353215+0000","last_fullsized":"2024-05-14T14:40:21.353215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:52:47.149904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.005435+0000","last_change":"2024-05-14T14:40:15.968635+0000","last_active":"2024-05-14T14:40:21.005435+0000","last_peered":"2024-05-14T14:40:21.005435+0000","last_clean":"2024-05-14T14:40:21.005435+0000","last_became_active":"2024-05-14T14:40:15.968332+0000","last_became_peered":"2024-05-14T14:40:15.968332+0000","last_unstale":"2024-05-14T14:40:21.005435+0000","last_undegraded":"2024-05-14T14:40:21.005435+0000","last_fullsized":"2024-05-14T14:40:21.005435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:23:34.578655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.004351+0000","last_change":"2024-05-14T14:40:15.976612+0000","last_active":"2024-05-14T14:40:21.004351+0000","last_peered":"2024-05-14T14:40:21.004351+0000","last_clean":"2024-05-14T14:40:21.004351+0000","last_became_active":"2024-05-14T14:40:15.975536+0000","last_became_peered":"2024-05-14T14:40:15.975536+0000","last_unstale":"2024-05-14T14:40:21.004351+0000","last_undegraded":"2024-05-14T14:40:21.004351+0000","last_fullsized":"2024-05-14T14:40:21.004351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:17:12.953751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006389+0000","last_change":"2024-05-14T14:40:15.977511+0000","last_active":"2024-05-14T14:40:21.006389+0000","last_peered":"2024-05-14T14:40:21.006389+0000","last_clean":"2024-05-14T14:40:21.006389+0000","last_became_active":"2024-05-14T14:40:15.977176+0000","last_became_peered":"2024-05-14T14:40:15.977176+0000","last_unstale":"2024-05-14T14:40:21.006389+0000","last_undegraded":"2024-05-14T14:40:21.006389+0000","last_fullsized":"2024-05-14T14:40:21.006389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:32:21.620701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352721+0000","last_change":"2024-05-14T14:40:15.969442+0000","last_active":"2024-05-14T14:40:21.352721+0000","last_peered":"2024-05-14T14:40:21.352721+0000","last_clean":"2024-05-14T14:40:21.352721+0000","last_became_active":"2024-05-14T14:40:15.968989+0000","last_became_peered":"2024-05-14T14:40:15.968989+0000","last_unstale":"2024-05-14T14:40:21.352721+0000","last_undegraded":"2024-05-14T14:40:21.352721+0000","last_fullsized":"2024-05-14T14:40:21.352721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:59:55.024165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352423+0000","last_change":"2024-05-14T14:40:15.981801+0000","last_active":"2024-05-14T14:40:21.352423+0000","last_peered":"2024-05-14T14:40:21.352423+0000","last_clean":"2024-05-14T14:40:21.352423+0000","last_became_active":"2024-05-14T14:40:15.981444+0000","last_became_peered":"2024-05-14T14:40:15.981444+0000","last_unstale":"2024-05-14T14:40:21.352423+0000","last_undegraded":"2024-05-14T14:40:21.352423+0000","last_fullsized":"2024-05-14T14:40:21.352423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:59:55.024165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351958+0000","last_change":"2024-05-14T14:40:15.973771+0000","last_active":"2024-05-14T14:40:21.351958+0000","last_peered":"2024-05-14T14:40:21.351958+0000","last_clean":"2024-05-14T14:40:21.351958+0000","last_became_active":"2024-05-14T14:40:15.973388+0000","last_became_peered":"2024-05-14T14:40:15.973388+0000","last_unstale":"2024-05-14T14:40:21.351958+0000","last_undegraded":"2024-05-14T14:40:21.351958+0000","last_fullsized":"2024-05-14T14:40:21.351958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:53.130907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006356+0000","last_change":"2024-05-14T14:40:15.969745+0000","last_active":"2024-05-14T14:40:21.006356+0000","last_peered":"2024-05-14T14:40:21.006356+0000","last_clean":"2024-05-14T14:40:21.006356+0000","last_became_active":"2024-05-14T14:40:15.969412+0000","last_became_peered":"2024-05-14T14:40:15.969412+0000","last_unstale":"2024-05-14T14:40:21.006356+0000","last_undegraded":"2024-05-14T14:40:21.006356+0000","last_fullsized":"2024-05-14T14:40:21.006356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:24:18.488847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352189+0000","last_change":"2024-05-14T14:40:15.982718+0000","last_active":"2024-05-14T14:40:21.352189+0000","last_peered":"2024-05-14T14:40:21.352189+0000","last_clean":"2024-05-14T14:40:21.352189+0000","last_became_active":"2024-05-14T14:40:15.982354+0000","last_became_peered":"2024-05-14T14:40:15.982354+0000","last_unstale":"2024-05-14T14:40:21.352189+0000","last_undegraded":"2024-05-14T14:40:21.352189+0000","last_fullsized":"2024-05-14T14:40:21.352189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:32:21.620701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.005438+0000","last_change":"2024-05-14T14:40:15.966798+0000","last_active":"2024-05-14T14:40:21.005438+0000","last_peered":"2024-05-14T14:40:21.005438+0000","last_clean":"2024-05-14T14:40:21.005438+0000","last_became_active":"2024-05-14T14:40:15.966408+0000","last_became_peered":"2024-05-14T14:40:15.966408+0000","last_unstale":"2024-05-14T14:40:21.005438+0000","last_undegraded":"2024-05-14T14:40:21.005438+0000","last_fullsized":"2024-05-14T14:40:21.005438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:24:18.488847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351504+0000","last_change":"2024-05-14T14:40:15.970022+0000","last_active":"2024-05-14T14:40:21.351504+0000","last_peered":"2024-05-14T14:40:21.351504+0000","last_clean":"2024-05-14T14:40:21.351504+0000","last_became_active":"2024-05-14T14:40:15.969695+0000","last_became_peered":"2024-05-14T14:40:15.969695+0000","last_unstale":"2024-05-14T14:40:21.351504+0000","last_undegraded":"2024-05-14T14:40:21.351504+0000","last_fullsized":"2024-05-14T14:40:21.351504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:58:49.048828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006273+0000","last_change":"2024-05-14T14:40:15.963064+0000","last_active":"2024-05-14T14:40:21.006273+0000","last_peered":"2024-05-14T14:40:21.006273+0000","last_clean":"2024-05-14T14:40:21.006273+0000","last_became_active":"2024-05-14T14:40:15.962710+0000","last_became_peered":"2024-05-14T14:40:15.962710+0000","last_unstale":"2024-05-14T14:40:21.006273+0000","last_undegraded":"2024-05-14T14:40:21.006273+0000","last_fullsized":"2024-05-14T14:40:21.006273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:20:20.841651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352408+0000","last_change":"2024-05-14T14:40:15.967114+0000","last_active":"2024-05-14T14:40:21.352408+0000","last_peered":"2024-05-14T14:40:21.352408+0000","last_clean":"2024-05-14T14:40:21.352408+0000","last_became_active":"2024-05-14T14:40:15.966769+0000","last_became_peered":"2024-05-14T14:40:15.966769+0000","last_unstale":"2024-05-14T14:40:21.352408+0000","last_undegraded":"2024-05-14T14:40:21.352408+0000","last_fullsized":"2024-05-14T14:40:21.352408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:54:04.167075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006690+0000","last_change":"2024-05-14T14:40:15.959522+0000","last_active":"2024-05-14T14:40:21.006690+0000","last_peered":"2024-05-14T14:40:21.006690+0000","last_clean":"2024-05-14T14:40:21.006690+0000","last_became_active":"2024-05-14T14:40:15.959175+0000","last_became_peered":"2024-05-14T14:40:15.959175+0000","last_unstale":"2024-05-14T14:40:21.006690+0000","last_undegraded":"2024-05-14T14:40:21.006690+0000","last_fullsized":"2024-05-14T14:40:21.006690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:16:59.783346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353319+0000","last_change":"2024-05-14T14:40:15.965742+0000","last_active":"2024-05-14T14:40:21.353319+0000","last_peered":"2024-05-14T14:40:21.353319+0000","last_clean":"2024-05-14T14:40:21.353319+0000","last_became_active":"2024-05-14T14:40:15.965402+0000","last_became_peered":"2024-05-14T14:40:15.965402+0000","last_unstale":"2024-05-14T14:40:21.353319+0000","last_undegraded":"2024-05-14T14:40:21.353319+0000","last_fullsized":"2024-05-14T14:40:21.353319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:54:56.658112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.004698+0000","last_change":"2024-05-14T14:40:15.958876+0000","last_active":"2024-05-14T14:40:21.004698+0000","last_peered":"2024-05-14T14:40:21.004698+0000","last_clean":"2024-05-14T14:40:21.004698+0000","last_became_active":"2024-05-14T14:40:15.958527+0000","last_became_peered":"2024-05-14T14:40:15.958527+0000","last_unstale":"2024-05-14T14:40:21.004698+0000","last_undegraded":"2024-05-14T14:40:21.004698+0000","last_fullsized":"2024-05-14T14:40:21.004698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:36:38.736430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.007564+0000","last_change":"2024-05-14T14:40:15.962954+0000","last_active":"2024-05-14T14:40:21.007564+0000","last_peered":"2024-05-14T14:40:21.007564+0000","last_clean":"2024-05-14T14:40:21.007564+0000","last_became_active":"2024-05-14T14:40:15.962607+0000","last_became_peered":"2024-05-14T14:40:15.962607+0000","last_unstale":"2024-05-14T14:40:21.007564+0000","last_undegraded":"2024-05-14T14:40:21.007564+0000","last_fullsized":"2024-05-14T14:40:21.007564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:36:37.465980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.005302+0000","last_change":"2024-05-14T14:40:15.959274+0000","last_active":"2024-05-14T14:40:21.005302+0000","last_peered":"2024-05-14T14:40:21.005302+0000","last_clean":"2024-05-14T14:40:21.005302+0000","last_became_active":"2024-05-14T14:40:15.958645+0000","last_became_peered":"2024-05-14T14:40:15.958645+0000","last_unstale":"2024-05-14T14:40:21.005302+0000","last_undegraded":"2024-05-14T14:40:21.005302+0000","last_fullsized":"2024-05-14T14:40:21.005302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:59:55.024165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351254+0000","last_change":"2024-05-14T14:40:15.969772+0000","last_active":"2024-05-14T14:40:21.351254+0000","last_peered":"2024-05-14T14:40:21.351254+0000","last_clean":"2024-05-14T14:40:21.351254+0000","last_became_active":"2024-05-14T14:40:15.969426+0000","last_became_peered":"2024-05-14T14:40:15.969426+0000","last_unstale":"2024-05-14T14:40:21.351254+0000","last_undegraded":"2024-05-14T14:40:21.351254+0000","last_fullsized":"2024-05-14T14:40:21.351254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:23:34.578655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351920+0000","last_change":"2024-05-14T14:40:15.968134+0000","last_active":"2024-05-14T14:40:21.351920+0000","last_peered":"2024-05-14T14:40:21.351920+0000","last_clean":"2024-05-14T14:40:21.351920+0000","last_became_active":"2024-05-14T14:40:15.967777+0000","last_became_peered":"2024-05-14T14:40:15.967777+0000","last_unstale":"2024-05-14T14:40:21.351920+0000","last_undegraded":"2024-05-14T14:40:21.351920+0000","last_fullsized":"2024-05-14T14:40:21.351920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:55:12.523931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352640+0000","last_change":"2024-05-14T14:40:15.968186+0000","last_active":"2024-05-14T14:40:21.352640+0000","last_peered":"2024-05-14T14:40:21.352640+0000","last_clean":"2024-05-14T14:40:21.352640+0000","last_became_active":"2024-05-14T14:40:15.967015+0000","last_became_peered":"2024-05-14T14:40:15.967015+0000","last_unstale":"2024-05-14T14:40:21.352640+0000","last_undegraded":"2024-05-14T14:40:21.352640+0000","last_fullsized":"2024-05-14T14:40:21.352640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:20:20.841651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352491+0000","last_change":"2024-05-14T14:40:15.957490+0000","last_active":"2024-05-14T14:40:21.352491+0000","last_peered":"2024-05-14T14:40:21.352491+0000","last_clean":"2024-05-14T14:40:21.352491+0000","last_became_active":"2024-05-14T14:40:15.957138+0000","last_became_peered":"2024-05-14T14:40:15.957138+0000","last_unstale":"2024-05-14T14:40:21.352491+0000","last_undegraded":"2024-05-14T14:40:21.352491+0000","last_fullsized":"2024-05-14T14:40:21.352491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:36:38.736430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.007117+0000","last_change":"2024-05-14T14:40:15.980390+0000","last_active":"2024-05-14T14:40:21.007117+0000","last_peered":"2024-05-14T14:40:21.007117+0000","last_clean":"2024-05-14T14:40:21.007117+0000","last_became_active":"2024-05-14T14:40:15.975197+0000","last_became_peered":"2024-05-14T14:40:15.975197+0000","last_unstale":"2024-05-14T14:40:21.007117+0000","last_undegraded":"2024-05-14T14:40:21.007117+0000","last_fullsized":"2024-05-14T14:40:21.007117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:53.130907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006219+0000","last_change":"2024-05-14T14:40:15.980514+0000","last_active":"2024-05-14T14:40:21.006219+0000","last_peered":"2024-05-14T14:40:21.006219+0000","last_clean":"2024-05-14T14:40:21.006219+0000","last_became_active":"2024-05-14T14:40:15.980024+0000","last_became_peered":"2024-05-14T14:40:15.980024+0000","last_unstale":"2024-05-14T14:40:21.006219+0000","last_undegraded":"2024-05-14T14:40:21.006219+0000","last_fullsized":"2024-05-14T14:40:21.006219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:59:55.024165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352960+0000","last_change":"2024-05-14T14:40:15.977265+0000","last_active":"2024-05-14T14:40:21.352960+0000","last_peered":"2024-05-14T14:40:21.352960+0000","last_clean":"2024-05-14T14:40:21.352960+0000","last_became_active":"2024-05-14T14:40:15.976826+0000","last_became_peered":"2024-05-14T14:40:15.976826+0000","last_unstale":"2024-05-14T14:40:21.352960+0000","last_undegraded":"2024-05-14T14:40:21.352960+0000","last_fullsized":"2024-05-14T14:40:21.352960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:36:37.465980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351694+0000","last_change":"2024-05-14T14:40:15.979087+0000","last_active":"2024-05-14T14:40:21.351694+0000","last_peered":"2024-05-14T14:40:21.351694+0000","last_clean":"2024-05-14T14:40:21.351694+0000","last_became_active":"2024-05-14T14:40:15.978749+0000","last_became_peered":"2024-05-14T14:40:15.978749+0000","last_unstale":"2024-05-14T14:40:21.351694+0000","last_undegraded":"2024-05-14T14:40:21.351694+0000","last_fullsized":"2024-05-14T14:40:21.351694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:54:04.167075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351866+0000","last_change":"2024-05-14T14:40:15.972565+0000","last_active":"2024-05-14T14:40:21.351866+0000","last_peered":"2024-05-14T14:40:21.351866+0000","last_clean":"2024-05-14T14:40:21.351866+0000","last_became_active":"2024-05-14T14:40:15.972197+0000","last_became_peered":"2024-05-14T14:40:15.972197+0000","last_unstale":"2024-05-14T14:40:21.351866+0000","last_undegraded":"2024-05-14T14:40:21.351866+0000","last_fullsized":"2024-05-14T14:40:21.351866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:20:20.841651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006142+0000","last_change":"2024-05-14T14:40:15.962025+0000","last_active":"2024-05-14T14:40:21.006142+0000","last_peered":"2024-05-14T14:40:21.006142+0000","last_clean":"2024-05-14T14:40:21.006142+0000","last_became_active":"2024-05-14T14:40:15.961314+0000","last_became_peered":"2024-05-14T14:40:15.961314+0000","last_unstale":"2024-05-14T14:40:21.006142+0000","last_undegraded":"2024-05-14T14:40:21.006142+0000","last_fullsized":"2024-05-14T14:40:21.006142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:58:49.048828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352128+0000","last_change":"2024-05-14T14:40:15.964970+0000","last_active":"2024-05-14T14:40:21.352128+0000","last_peered":"2024-05-14T14:40:21.352128+0000","last_clean":"2024-05-14T14:40:21.352128+0000","last_became_active":"2024-05-14T14:40:15.964611+0000","last_became_peered":"2024-05-14T14:40:15.964611+0000","last_unstale":"2024-05-14T14:40:21.352128+0000","last_undegraded":"2024-05-14T14:40:21.352128+0000","last_fullsized":"2024-05-14T14:40:21.352128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:32:21.620701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006800+0000","last_change":"2024-05-14T14:40:15.974010+0000","last_active":"2024-05-14T14:40:21.006800+0000","last_peered":"2024-05-14T14:40:21.006800+0000","last_clean":"2024-05-14T14:40:21.006800+0000","last_became_active":"2024-05-14T14:40:15.973683+0000","last_became_peered":"2024-05-14T14:40:15.973683+0000","last_unstale":"2024-05-14T14:40:21.006800+0000","last_undegraded":"2024-05-14T14:40:21.006800+0000","last_fullsized":"2024-05-14T14:40:21.006800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:43:15.190648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352691+0000","last_change":"2024-05-14T14:40:15.958806+0000","last_active":"2024-05-14T14:40:21.352691+0000","last_peered":"2024-05-14T14:40:21.352691+0000","last_clean":"2024-05-14T14:40:21.352691+0000","last_became_active":"2024-05-14T14:40:15.958397+0000","last_became_peered":"2024-05-14T14:40:15.958397+0000","last_unstale":"2024-05-14T14:40:21.352691+0000","last_undegraded":"2024-05-14T14:40:21.352691+0000","last_fullsized":"2024-05-14T14:40:21.352691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:23:34.578655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352925+0000","last_change":"2024-05-14T14:40:15.968981+0000","last_active":"2024-05-14T14:40:21.352925+0000","last_peered":"2024-05-14T14:40:21.352925+0000","last_clean":"2024-05-14T14:40:21.352925+0000","last_became_active":"2024-05-14T14:40:15.968588+0000","last_became_peered":"2024-05-14T14:40:15.968588+0000","last_unstale":"2024-05-14T14:40:21.352925+0000","last_undegraded":"2024-05-14T14:40:21.352925+0000","last_fullsized":"2024-05-14T14:40:21.352925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:24:18.488847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352818+0000","last_change":"2024-05-14T14:40:15.967640+0000","last_active":"2024-05-14T14:40:21.352818+0000","last_peered":"2024-05-14T14:40:21.352818+0000","last_clean":"2024-05-14T14:40:21.352818+0000","last_became_active":"2024-05-14T14:40:15.967316+0000","last_became_peered":"2024-05-14T14:40:15.967316+0000","last_unstale":"2024-05-14T14:40:21.352818+0000","last_undegraded":"2024-05-14T14:40:21.352818+0000","last_fullsized":"2024-05-14T14:40:21.352818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:09:29.986117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T14:40:34.912 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T14:40:35.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.077+0000 7f1b8c1d5640 1 Processor -- start 2024-05-14T14:40:35.062 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.078+0000 7f1b8c1d5640 1 -- start start 2024-05-14T14:40:35.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.079+0000 7f1b8c1d5640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1b840ce8c0 0x7f1b84164a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:35.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.079+0000 7f1b8c1d5640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b84161130 con 0x7f1b84164600 2024-05-14T14:40:35.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.079+0000 7f1b8c1d5640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b84161410 con 0x7f1b840cf2a0 2024-05-14T14:40:35.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.079+0000 7f1b8c1d5640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f1b84164170 con 0x7f1b840ce8c0 2024-05-14T14:40:35.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.079+0000 7f1b8a772640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1b840ce8c0 0x7f1b84164a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:35.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.079+0000 7f1b89770640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f1b84164600 0x7f1b840ce1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:56402/0 (socket says 172.21.15.39:56402) 2024-05-14T14:40:35.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.079+0000 7f1b89770640 1 -- 172.21.15.39:0/1309502965 learned_addr learned my addr 172.21.15.39:0/1309502965 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:35.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.080+0000 7f1b8a772640 1 -- 172.21.15.39:0/1309502965 >> v1:172.21.15.62:6789/0 conn(0x7f1b840cf2a0 legacy=0x7f1b841608e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:35.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.080+0000 7f1b8a772640 1 -- 172.21.15.39:0/1309502965 >> v1:172.21.15.39:6789/0 conn(0x7f1b84164600 legacy=0x7f1b840ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:35.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.080+0000 7f1b88f6f640 1 -- 172.21.15.39:0/1309502965 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3951100700 0 0) 0x7f1b84161130 con 0x7f1b84164600 2024-05-14T14:40:35.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.080+0000 7f1b8a772640 1 -- 172.21.15.39:0/1309502965 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b841616f0 con 0x7f1b840ce8c0 2024-05-14T14:40:35.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.080+0000 7f1b8a772640 1 --2- 172.21.15.39:0/1309502965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b840ce8c0 0x7f1b84164a10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c009d90 tx=0x7f1b7c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76a41c88460bdae6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:35.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.080+0000 7f1b88f6f640 1 -- 172.21.15.39:0/1309502965 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c007740 con 0x7f1b840ce8c0 2024-05-14T14:40:35.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.080+0000 7f1b88f6f640 1 -- 172.21.15.39:0/1309502965 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b7c0078e0 con 0x7f1b840ce8c0 2024-05-14T14:40:35.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.081+0000 7f1b88f6f640 1 -- 172.21.15.39:0/1309502965 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c007cb0 con 0x7f1b840ce8c0 2024-05-14T14:40:35.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.081+0000 7f1b8c1d5640 1 -- 172.21.15.39:0/1309502965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b840ce8c0 msgr2=0x7f1b84164a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:35.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.081+0000 7f1b8c1d5640 1 --2- 172.21.15.39:0/1309502965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b840ce8c0 0x7f1b84164a10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c009d90 tx=0x7f1b7c02a6f0 comp rx=0 tx=0).stop 2024-05-14T14:40:35.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.081+0000 7f1b8c1d5640 1 -- 172.21.15.39:0/1309502965 shutdown_connections 2024-05-14T14:40:35.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.081+0000 7f1b8c1d5640 1 --2- 172.21.15.39:0/1309502965 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b840ce8c0 0x7f1b84164a10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:35.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.081+0000 7f1b8c1d5640 1 -- 172.21.15.39:0/1309502965 >> 172.21.15.39:0/1309502965 conn(0x7f1b84071680 msgr2=0x7f1b84071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:35.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.081+0000 7f1b8c1d5640 1 -- 172.21.15.39:0/1309502965 shutdown_connections 2024-05-14T14:40:35.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.081+0000 7f1b8c1d5640 1 -- 172.21.15.39:0/1309502965 wait complete. 2024-05-14T14:40:35.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.083+0000 7f1b8c1d5640 1 Processor -- start 2024-05-14T14:40:35.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.083+0000 7f1b8c1d5640 1 -- start start 2024-05-14T14:40:35.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.084+0000 7f1b8c1d5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b840cf2a0 0x7f1b841549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:35.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.084+0000 7f1b8c1d5640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b84164600 0x7f1b840b5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:35.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.085+0000 7f1b8c1d5640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1b841eac20 0x7f1b840b88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:35.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.085+0000 7f1b8c1d5640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8406e4a0 con 0x7f1b84164600 2024-05-14T14:40:35.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.085+0000 7f1b8c1d5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1b840d0e20 con 0x7f1b840cf2a0 2024-05-14T14:40:35.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.085+0000 7f1b8c1d5640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f1b8406e620 con 0x7f1b841eac20 2024-05-14T14:40:35.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.085+0000 7f1b89770640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b84164600 0x7f1b840b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:35.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.085+0000 7f1b89770640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b84164600 0x7f1b840b5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48470/0 (socket says 172.21.15.39:48470) 2024-05-14T14:40:35.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.085+0000 7f1b89770640 1 -- 172.21.15.39:0/2685523625 learned_addr learned my addr 172.21.15.39:0/2685523625 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:35.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.085+0000 7f1b8a772640 1 --2- 172.21.15.39:0/2685523625 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1b841eac20 0x7f1b840b88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:35.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.085+0000 7f1b89f71640 1 --2- 172.21.15.39:0/2685523625 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b840cf2a0 0x7f1b841549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:35.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.085+0000 7f1b89770640 1 -- 172.21.15.39:0/2685523625 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1b841eac20 msgr2=0x7f1b840b88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:35.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.085+0000 7f1b89770640 1 --2- 172.21.15.39:0/2685523625 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1b841eac20 0x7f1b840b88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:35.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.085+0000 7f1b89770640 1 -- 172.21.15.39:0/2685523625 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b840cf2a0 msgr2=0x7f1b841549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:35.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.085+0000 7f1b89770640 1 --2- 172.21.15.39:0/2685523625 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b840cf2a0 0x7f1b841549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:35.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.085+0000 7f1b89770640 1 -- 172.21.15.39:0/2685523625 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b841e9b80 con 0x7f1b84164600 2024-05-14T14:40:35.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.085+0000 7f1b89770640 1 --2- 172.21.15.39:0/2685523625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b84164600 0x7f1b840b5330 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1b7400c3d0 tx=0x7f1b7400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:35.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.086+0000 7f1b7a7fc640 1 -- 172.21.15.39:0/2685523625 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b740074e0 con 0x7f1b84164600 2024-05-14T14:40:35.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.086+0000 7f1b7a7fc640 1 -- 172.21.15.39:0/2685523625 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b740047e0 con 0x7f1b84164600 2024-05-14T14:40:35.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.086+0000 7f1b7a7fc640 1 -- 172.21.15.39:0/2685523625 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b74004bd0 con 0x7f1b84164600 2024-05-14T14:40:35.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.086+0000 7f1b8c1d5640 1 -- 172.21.15.39:0/2685523625 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b841e9e60 con 0x7f1b84164600 2024-05-14T14:40:35.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.086+0000 7f1b8c1d5640 1 -- 172.21.15.39:0/2685523625 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b841ea420 con 0x7f1b84164600 2024-05-14T14:40:35.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.087+0000 7f1b8c1d5640 1 -- 172.21.15.39:0/2685523625 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b84076aa0 con 0x7f1b84164600 2024-05-14T14:40:35.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.088+0000 7f1b7a7fc640 1 -- 172.21.15.39:0/2685523625 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1b74011070 con 0x7f1b84164600 2024-05-14T14:40:35.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.088+0000 7f1b7a7fc640 1 --2- 172.21.15.39:0/2685523625 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1b680762d0 0x7f1b680787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:35.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.088+0000 7f1b7a7fc640 1 -- 172.21.15.39:0/2685523625 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1b74097450 con 0x7f1b84164600 2024-05-14T14:40:35.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.088+0000 7f1b89f71640 1 --2- 172.21.15.39:0/2685523625 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1b680762d0 0x7f1b680787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:35.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.089+0000 7f1b89f71640 1 --2- 172.21.15.39:0/2685523625 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1b680762d0 0x7f1b680787e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1b80000f60 tx=0x7f1b80009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:35.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.095+0000 7f1b7a7fc640 1 -- 172.21.15.39:0/2685523625 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1b74060a70 con 0x7f1b84164600 2024-05-14T14:40:35.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.285+0000 7f1b8c1d5640 1 -- 172.21.15.39:0/2685523625 --> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1b841e9930 con 0x7f1b680762d0 2024-05-14T14:40:35.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.293+0000 7f1b7a7fc640 1 -- 172.21.15.39:0/2685523625 <== mgr.4105 v2:172.21.15.39:6832/498853008 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332523 (secure 0 0 0) 0x7f1b841e9930 con 0x7f1b680762d0 2024-05-14T14:40:35.281 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:40:35.282 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-05-14T14:40:35.284 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.297+0000 7f1b8c1d5640 1 -- 172.21.15.39:0/2685523625 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1b680762d0 msgr2=0x7f1b680787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:35.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.297+0000 7f1b8c1d5640 1 --2- 172.21.15.39:0/2685523625 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1b680762d0 0x7f1b680787e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1b80000f60 tx=0x7f1b80009040 comp rx=0 tx=0).stop 2024-05-14T14:40:35.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.297+0000 7f1b8c1d5640 1 -- 172.21.15.39:0/2685523625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b84164600 msgr2=0x7f1b840b5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:35.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.297+0000 7f1b8c1d5640 1 --2- 172.21.15.39:0/2685523625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b84164600 0x7f1b840b5330 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1b7400c3d0 tx=0x7f1b7400c890 comp rx=0 tx=0).stop 2024-05-14T14:40:35.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.297+0000 7f1b8c1d5640 1 -- 172.21.15.39:0/2685523625 shutdown_connections 2024-05-14T14:40:35.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.297+0000 7f1b8c1d5640 1 --2- 172.21.15.39:0/2685523625 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1b680762d0 0x7f1b680787e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:35.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.297+0000 7f1b8c1d5640 1 --2- 172.21.15.39:0/2685523625 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1b841eac20 0x7f1b840b88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:35.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.297+0000 7f1b8c1d5640 1 --2- 172.21.15.39:0/2685523625 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b84164600 0x7f1b840b5330 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:35.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.297+0000 7f1b8c1d5640 1 --2- 172.21.15.39:0/2685523625 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b840cf2a0 0x7f1b841549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:35.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.297+0000 7f1b8c1d5640 1 -- 172.21.15.39:0/2685523625 >> 172.21.15.39:0/2685523625 conn(0x7f1b84071680 msgr2=0x7f1b841632a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:35.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.297+0000 7f1b8c1d5640 1 -- 172.21.15.39:0/2685523625 shutdown_connections 2024-05-14T14:40:35.285 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.297+0000 7f1b8c1d5640 1 -- 172.21.15.39:0/2685523625 wait complete. 2024-05-14T14:40:35.292 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-05-14T14:40:34.680828+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231864,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742856,"statfs":{"total":773094113280,"available":772856684544,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":234016308},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002915"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353941+0000","last_change":"2024-05-14T14:40:14.954342+0000","last_active":"2024-05-14T14:40:21.353941+0000","last_peered":"2024-05-14T14:40:21.353941+0000","last_clean":"2024-05-14T14:40:21.353941+0000","last_became_active":"2024-05-14T14:40:14.954008+0000","last_became_peered":"2024-05-14T14:40:14.954008+0000","last_unstale":"2024-05-14T14:40:21.353941+0000","last_undegraded":"2024-05-14T14:40:21.353941+0000","last_fullsized":"2024-05-14T14:40:21.353941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:48:44.948315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351459+0000","last_change":"2024-05-14T14:40:15.977901+0000","last_active":"2024-05-14T14:40:21.351459+0000","last_peered":"2024-05-14T14:40:21.351459+0000","last_clean":"2024-05-14T14:40:21.351459+0000","last_became_active":"2024-05-14T14:40:15.977572+0000","last_became_peered":"2024-05-14T14:40:15.977572+0000","last_unstale":"2024-05-14T14:40:21.351459+0000","last_undegraded":"2024-05-14T14:40:21.351459+0000","last_fullsized":"2024-05-14T14:40:21.351459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:53.130907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351078+0000","last_change":"2024-05-14T14:40:20.380801+0000","last_active":"2024-05-14T14:40:21.351078+0000","last_peered":"2024-05-14T14:40:21.351078+0000","last_clean":"2024-05-14T14:40:21.351078+0000","last_became_active":"2024-05-14T14:40:20.379931+0000","last_became_peered":"2024-05-14T14:40:20.379931+0000","last_unstale":"2024-05-14T14:40:21.351078+0000","last_undegraded":"2024-05-14T14:40:21.351078+0000","last_fullsized":"2024-05-14T14:40:21.351078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:06:08.604105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351767+0000","last_change":"2024-05-14T14:40:14.951857+0000","last_active":"2024-05-14T14:40:21.351767+0000","last_peered":"2024-05-14T14:40:21.351767+0000","last_clean":"2024-05-14T14:40:21.351767+0000","last_became_active":"2024-05-14T14:40:14.951514+0000","last_became_peered":"2024-05-14T14:40:14.951514+0000","last_unstale":"2024-05-14T14:40:21.351767+0000","last_undegraded":"2024-05-14T14:40:21.351767+0000","last_fullsized":"2024-05-14T14:40:21.351767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:04:43.508873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353664+0000","last_change":"2024-05-14T14:40:15.954769+0000","last_active":"2024-05-14T14:40:21.353664+0000","last_peered":"2024-05-14T14:40:21.353664+0000","last_clean":"2024-05-14T14:40:21.353664+0000","last_became_active":"2024-05-14T14:40:15.954410+0000","last_became_peered":"2024-05-14T14:40:15.954410+0000","last_unstale":"2024-05-14T14:40:21.353664+0000","last_undegraded":"2024-05-14T14:40:21.353664+0000","last_fullsized":"2024-05-14T14:40:21.353664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:06:01.598712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351319+0000","last_change":"2024-05-14T14:40:20.012885+0000","last_active":"2024-05-14T14:40:21.351319+0000","last_peered":"2024-05-14T14:40:21.351319+0000","last_clean":"2024-05-14T14:40:21.351319+0000","last_became_active":"2024-05-14T14:40:20.012401+0000","last_became_peered":"2024-05-14T14:40:20.012401+0000","last_unstale":"2024-05-14T14:40:21.351319+0000","last_undegraded":"2024-05-14T14:40:21.351319+0000","last_fullsized":"2024-05-14T14:40:21.351319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:24:22.540721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353214+0000","last_change":"2024-05-14T14:40:14.952296+0000","last_active":"2024-05-14T14:40:21.353214+0000","last_peered":"2024-05-14T14:40:21.353214+0000","last_clean":"2024-05-14T14:40:21.353214+0000","last_became_active":"2024-05-14T14:40:14.951962+0000","last_became_peered":"2024-05-14T14:40:14.951962+0000","last_unstale":"2024-05-14T14:40:21.353214+0000","last_undegraded":"2024-05-14T14:40:21.353214+0000","last_fullsized":"2024-05-14T14:40:21.353214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:36:37.730760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006947+0000","last_change":"2024-05-14T14:40:15.952430+0000","last_active":"2024-05-14T14:40:21.006947+0000","last_peered":"2024-05-14T14:40:21.006947+0000","last_clean":"2024-05-14T14:40:21.006947+0000","last_became_active":"2024-05-14T14:40:15.952073+0000","last_became_peered":"2024-05-14T14:40:15.952073+0000","last_unstale":"2024-05-14T14:40:21.006947+0000","last_undegraded":"2024-05-14T14:40:21.006947+0000","last_fullsized":"2024-05-14T14:40:21.006947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:41:42.097310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351837+0000","last_change":"2024-05-14T14:40:20.020148+0000","last_active":"2024-05-14T14:40:21.351837+0000","last_peered":"2024-05-14T14:40:21.351837+0000","last_clean":"2024-05-14T14:40:21.351837+0000","last_became_active":"2024-05-14T14:40:20.019445+0000","last_became_peered":"2024-05-14T14:40:20.019445+0000","last_unstale":"2024-05-14T14:40:21.351837+0000","last_undegraded":"2024-05-14T14:40:21.351837+0000","last_fullsized":"2024-05-14T14:40:21.351837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:41:46.149184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352471+0000","last_change":"2024-05-14T14:40:14.952153+0000","last_active":"2024-05-14T14:40:21.352471+0000","last_peered":"2024-05-14T14:40:21.352471+0000","last_clean":"2024-05-14T14:40:21.352471+0000","last_became_active":"2024-05-14T14:40:14.951611+0000","last_became_peered":"2024-05-14T14:40:14.951611+0000","last_unstale":"2024-05-14T14:40:21.352471+0000","last_undegraded":"2024-05-14T14:40:21.352471+0000","last_fullsized":"2024-05-14T14:40:21.352471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:17:11.948081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.007527+0000","last_change":"2024-05-14T14:40:15.952403+0000","last_active":"2024-05-14T14:40:21.007527+0000","last_peered":"2024-05-14T14:40:21.007527+0000","last_clean":"2024-05-14T14:40:21.007527+0000","last_became_active":"2024-05-14T14:40:15.951977+0000","last_became_peered":"2024-05-14T14:40:15.951977+0000","last_unstale":"2024-05-14T14:40:21.007527+0000","last_undegraded":"2024-05-14T14:40:21.007527+0000","last_fullsized":"2024-05-14T14:40:21.007527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:28:34.783112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351495+0000","last_change":"2024-05-14T14:40:20.014394+0000","last_active":"2024-05-14T14:40:21.351495+0000","last_peered":"2024-05-14T14:40:21.351495+0000","last_clean":"2024-05-14T14:40:21.351495+0000","last_became_active":"2024-05-14T14:40:20.013530+0000","last_became_peered":"2024-05-14T14:40:20.013530+0000","last_unstale":"2024-05-14T14:40:21.351495+0000","last_undegraded":"2024-05-14T14:40:21.351495+0000","last_fullsized":"2024-05-14T14:40:21.351495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:43:19.242522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006074+0000","last_change":"2024-05-14T14:40:15.961488+0000","last_active":"2024-05-14T14:40:21.006074+0000","last_peered":"2024-05-14T14:40:21.006074+0000","last_clean":"2024-05-14T14:40:21.006074+0000","last_became_active":"2024-05-14T14:40:15.960660+0000","last_became_peered":"2024-05-14T14:40:15.960660+0000","last_unstale":"2024-05-14T14:40:21.006074+0000","last_undegraded":"2024-05-14T14:40:21.006074+0000","last_fullsized":"2024-05-14T14:40:21.006074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:54:04.167075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352322+0000","last_change":"2024-05-14T14:40:14.951723+0000","last_active":"2024-05-14T14:40:21.352322+0000","last_peered":"2024-05-14T14:40:21.352322+0000","last_clean":"2024-05-14T14:40:21.352322+0000","last_became_active":"2024-05-14T14:40:14.951352+0000","last_became_peered":"2024-05-14T14:40:14.951352+0000","last_unstale":"2024-05-14T14:40:21.352322+0000","last_undegraded":"2024-05-14T14:40:21.352322+0000","last_fullsized":"2024-05-14T14:40:21.352322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:07:48.920558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352736+0000","last_change":"2024-05-14T14:40:20.014226+0000","last_active":"2024-05-14T14:40:21.352736+0000","last_peered":"2024-05-14T14:40:21.352736+0000","last_clean":"2024-05-14T14:40:21.352736+0000","last_became_active":"2024-05-14T14:40:20.013489+0000","last_became_peered":"2024-05-14T14:40:20.013489+0000","last_unstale":"2024-05-14T14:40:21.352736+0000","last_undegraded":"2024-05-14T14:40:21.352736+0000","last_fullsized":"2024-05-14T14:40:21.352736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:28:38.834985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352716+0000","last_change":"2024-05-14T14:40:15.971905+0000","last_active":"2024-05-14T14:40:21.352716+0000","last_peered":"2024-05-14T14:40:21.352716+0000","last_clean":"2024-05-14T14:40:21.352716+0000","last_became_active":"2024-05-14T14:40:15.971131+0000","last_became_peered":"2024-05-14T14:40:15.971131+0000","last_unstale":"2024-05-14T14:40:21.352716+0000","last_undegraded":"2024-05-14T14:40:21.352716+0000","last_fullsized":"2024-05-14T14:40:21.352716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:43:15.190648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353431+0000","last_change":"2024-05-14T14:40:14.948435+0000","last_active":"2024-05-14T14:40:21.353431+0000","last_peered":"2024-05-14T14:40:21.353431+0000","last_clean":"2024-05-14T14:40:21.353431+0000","last_became_active":"2024-05-14T14:40:14.948096+0000","last_became_peered":"2024-05-14T14:40:14.948096+0000","last_unstale":"2024-05-14T14:40:21.353431+0000","last_undegraded":"2024-05-14T14:40:21.353431+0000","last_fullsized":"2024-05-14T14:40:21.353431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:30:28.647287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351533+0000","last_change":"2024-05-14T14:40:20.019546+0000","last_active":"2024-05-14T14:40:21.351533+0000","last_peered":"2024-05-14T14:40:21.351533+0000","last_clean":"2024-05-14T14:40:21.351533+0000","last_became_active":"2024-05-14T14:40:20.019087+0000","last_became_peered":"2024-05-14T14:40:20.019087+0000","last_unstale":"2024-05-14T14:40:21.351533+0000","last_undegraded":"2024-05-14T14:40:21.351533+0000","last_fullsized":"2024-05-14T14:40:21.351533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:32:25.672575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351856+0000","last_change":"2024-05-14T14:40:15.966369+0000","last_active":"2024-05-14T14:40:21.351856+0000","last_peered":"2024-05-14T14:40:21.351856+0000","last_clean":"2024-05-14T14:40:21.351856+0000","last_became_active":"2024-05-14T14:40:15.965662+0000","last_became_peered":"2024-05-14T14:40:15.965662+0000","last_unstale":"2024-05-14T14:40:21.351856+0000","last_undegraded":"2024-05-14T14:40:21.351856+0000","last_fullsized":"2024-05-14T14:40:21.351856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:23:34.578655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351349+0000","last_change":"2024-05-14T14:40:14.954350+0000","last_active":"2024-05-14T14:40:21.351349+0000","last_peered":"2024-05-14T14:40:21.351349+0000","last_clean":"2024-05-14T14:40:21.351349+0000","last_became_active":"2024-05-14T14:40:14.954046+0000","last_became_peered":"2024-05-14T14:40:14.954046+0000","last_unstale":"2024-05-14T14:40:21.351349+0000","last_undegraded":"2024-05-14T14:40:21.351349+0000","last_fullsized":"2024-05-14T14:40:21.351349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:17:11.948081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353677+0000","last_change":"2024-05-14T14:40:20.379814+0000","last_active":"2024-05-14T14:40:21.353677+0000","last_peered":"2024-05-14T14:40:21.353677+0000","last_clean":"2024-05-14T14:40:21.353677+0000","last_became_active":"2024-05-14T14:40:20.378729+0000","last_became_peered":"2024-05-14T14:40:20.378729+0000","last_unstale":"2024-05-14T14:40:21.353677+0000","last_undegraded":"2024-05-14T14:40:21.353677+0000","last_fullsized":"2024-05-14T14:40:21.353677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:36:41.517853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352411+0000","last_change":"2024-05-14T14:40:15.961572+0000","last_active":"2024-05-14T14:40:21.352411+0000","last_peered":"2024-05-14T14:40:21.352411+0000","last_clean":"2024-05-14T14:40:21.352411+0000","last_became_active":"2024-05-14T14:40:15.961236+0000","last_became_peered":"2024-05-14T14:40:15.961236+0000","last_unstale":"2024-05-14T14:40:21.352411+0000","last_undegraded":"2024-05-14T14:40:21.352411+0000","last_fullsized":"2024-05-14T14:40:21.352411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:30:29.652957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351393+0000","last_change":"2024-05-14T14:40:14.952977+0000","last_active":"2024-05-14T14:40:21.351393+0000","last_peered":"2024-05-14T14:40:21.351393+0000","last_clean":"2024-05-14T14:40:21.351393+0000","last_became_active":"2024-05-14T14:40:14.952638+0000","last_became_peered":"2024-05-14T14:40:14.952638+0000","last_unstale":"2024-05-14T14:40:21.351393+0000","last_undegraded":"2024-05-14T14:40:21.351393+0000","last_fullsized":"2024-05-14T14:40:21.351393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:30:28.647287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353054+0000","last_change":"2024-05-14T14:40:20.019116+0000","last_active":"2024-05-14T14:40:21.353054+0000","last_peered":"2024-05-14T14:40:21.353054+0000","last_clean":"2024-05-14T14:40:21.353054+0000","last_became_active":"2024-05-14T14:40:20.018572+0000","last_became_peered":"2024-05-14T14:40:20.018572+0000","last_unstale":"2024-05-14T14:40:21.353054+0000","last_undegraded":"2024-05-14T14:40:21.353054+0000","last_fullsized":"2024-05-14T14:40:21.353054+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:01:01.849694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353666+0000","last_change":"2024-05-14T14:40:15.968343+0000","last_active":"2024-05-14T14:40:21.353666+0000","last_peered":"2024-05-14T14:40:21.353666+0000","last_clean":"2024-05-14T14:40:21.353666+0000","last_became_active":"2024-05-14T14:40:15.967789+0000","last_became_peered":"2024-05-14T14:40:15.967789+0000","last_unstale":"2024-05-14T14:40:21.353666+0000","last_undegraded":"2024-05-14T14:40:21.353666+0000","last_fullsized":"2024-05-14T14:40:21.353666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:53.130907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.007066+0000","last_change":"2024-05-14T14:40:14.949732+0000","last_active":"2024-05-14T14:40:21.007066+0000","last_peered":"2024-05-14T14:40:21.007066+0000","last_clean":"2024-05-14T14:40:21.007066+0000","last_became_active":"2024-05-14T14:40:14.949224+0000","last_became_peered":"2024-05-14T14:40:14.949224+0000","last_unstale":"2024-05-14T14:40:21.007066+0000","last_undegraded":"2024-05-14T14:40:21.007066+0000","last_fullsized":"2024-05-14T14:40:21.007066+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:30:28.647287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351359+0000","last_change":"2024-05-14T14:40:20.374754+0000","last_active":"2024-05-14T14:40:21.351359+0000","last_peered":"2024-05-14T14:40:21.351359+0000","last_clean":"2024-05-14T14:40:21.351359+0000","last_became_active":"2024-05-14T14:40:20.373425+0000","last_became_peered":"2024-05-14T14:40:20.373425+0000","last_unstale":"2024-05-14T14:40:21.351359+0000","last_undegraded":"2024-05-14T14:40:21.351359+0000","last_fullsized":"2024-05-14T14:40:21.351359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:59:59.076038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352304+0000","last_change":"2024-05-14T14:40:15.971052+0000","last_active":"2024-05-14T14:40:21.352304+0000","last_peered":"2024-05-14T14:40:21.352304+0000","last_clean":"2024-05-14T14:40:21.352304+0000","last_became_active":"2024-05-14T14:40:15.970626+0000","last_became_peered":"2024-05-14T14:40:15.970626+0000","last_unstale":"2024-05-14T14:40:21.352304+0000","last_undegraded":"2024-05-14T14:40:21.352304+0000","last_fullsized":"2024-05-14T14:40:21.352304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:24:18.488847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353001+0000","last_change":"2024-05-14T14:40:14.945387+0000","last_active":"2024-05-14T14:40:21.353001+0000","last_peered":"2024-05-14T14:40:21.353001+0000","last_clean":"2024-05-14T14:40:21.353001+0000","last_became_active":"2024-05-14T14:40:14.945047+0000","last_became_peered":"2024-05-14T14:40:14.945047+0000","last_unstale":"2024-05-14T14:40:21.353001+0000","last_undegraded":"2024-05-14T14:40:21.353001+0000","last_fullsized":"2024-05-14T14:40:21.353001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:03:50.412968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351995+0000","last_change":"2024-05-14T14:40:20.378427+0000","last_active":"2024-05-14T14:40:21.351995+0000","last_peered":"2024-05-14T14:40:21.351995+0000","last_clean":"2024-05-14T14:40:21.351995+0000","last_became_active":"2024-05-14T14:40:20.377986+0000","last_became_peered":"2024-05-14T14:40:20.377986+0000","last_unstale":"2024-05-14T14:40:21.351995+0000","last_undegraded":"2024-05-14T14:40:21.351995+0000","last_fullsized":"2024-05-14T14:40:21.351995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:43:06.799558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353676+0000","last_change":"2024-05-14T14:40:15.961279+0000","last_active":"2024-05-14T14:40:21.353676+0000","last_peered":"2024-05-14T14:40:21.353676+0000","last_clean":"2024-05-14T14:40:21.353676+0000","last_became_active":"2024-05-14T14:40:15.960895+0000","last_became_peered":"2024-05-14T14:40:15.960895+0000","last_unstale":"2024-05-14T14:40:21.353676+0000","last_undegraded":"2024-05-14T14:40:21.353676+0000","last_fullsized":"2024-05-14T14:40:21.353676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:59:55.024165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353350+0000","last_change":"2024-05-14T14:40:14.952912+0000","last_active":"2024-05-14T14:40:21.353350+0000","last_peered":"2024-05-14T14:40:21.353350+0000","last_clean":"2024-05-14T14:40:21.353350+0000","last_became_active":"2024-05-14T14:40:14.952548+0000","last_became_peered":"2024-05-14T14:40:14.952548+0000","last_unstale":"2024-05-14T14:40:21.353350+0000","last_undegraded":"2024-05-14T14:40:21.353350+0000","last_fullsized":"2024-05-14T14:40:21.353350+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:50:00.234669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352297+0000","last_change":"2024-05-14T14:40:20.372845+0000","last_active":"2024-05-14T14:40:21.352297+0000","last_peered":"2024-05-14T14:40:21.352297+0000","last_clean":"2024-05-14T14:40:21.352297+0000","last_became_active":"2024-05-14T14:40:20.372340+0000","last_became_peered":"2024-05-14T14:40:20.372340+0000","last_unstale":"2024-05-14T14:40:21.352297+0000","last_undegraded":"2024-05-14T14:40:21.352297+0000","last_fullsized":"2024-05-14T14:40:21.352297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:28:38.834985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.007718+0000","last_change":"2024-05-14T14:40:15.976323+0000","last_active":"2024-05-14T14:40:21.007718+0000","last_peered":"2024-05-14T14:40:21.007718+0000","last_clean":"2024-05-14T14:40:21.007718+0000","last_became_active":"2024-05-14T14:40:15.975931+0000","last_became_peered":"2024-05-14T14:40:15.975931+0000","last_unstale":"2024-05-14T14:40:21.007718+0000","last_undegraded":"2024-05-14T14:40:21.007718+0000","last_fullsized":"2024-05-14T14:40:21.007718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:00:58.953906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353806+0000","last_change":"2024-05-14T14:40:14.954043+0000","last_active":"2024-05-14T14:40:21.353806+0000","last_peered":"2024-05-14T14:40:21.353806+0000","last_clean":"2024-05-14T14:40:21.353806+0000","last_became_active":"2024-05-14T14:40:14.953734+0000","last_became_peered":"2024-05-14T14:40:14.953734+0000","last_unstale":"2024-05-14T14:40:21.353806+0000","last_undegraded":"2024-05-14T14:40:21.353806+0000","last_fullsized":"2024-05-14T14:40:21.353806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:42:43.352565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351130+0000","last_change":"2024-05-14T14:40:20.015959+0000","last_active":"2024-05-14T14:40:21.351130+0000","last_peered":"2024-05-14T14:40:21.351130+0000","last_clean":"2024-05-14T14:40:21.351130+0000","last_became_active":"2024-05-14T14:40:20.015515+0000","last_became_peered":"2024-05-14T14:40:20.015515+0000","last_unstale":"2024-05-14T14:40:21.351130+0000","last_undegraded":"2024-05-14T14:40:21.351130+0000","last_fullsized":"2024-05-14T14:40:21.351130+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:01:01.849694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352393+0000","last_change":"2024-05-14T14:40:15.950703+0000","last_active":"2024-05-14T14:40:21.352393+0000","last_peered":"2024-05-14T14:40:21.352393+0000","last_clean":"2024-05-14T14:40:21.352393+0000","last_became_active":"2024-05-14T14:40:15.950367+0000","last_became_peered":"2024-05-14T14:40:15.950367+0000","last_unstale":"2024-05-14T14:40:21.352393+0000","last_undegraded":"2024-05-14T14:40:21.352393+0000","last_fullsized":"2024-05-14T14:40:21.352393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:22:55.057837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006627+0000","last_change":"2024-05-14T14:40:14.942269+0000","last_active":"2024-05-14T14:40:21.006627+0000","last_peered":"2024-05-14T14:40:21.006627+0000","last_clean":"2024-05-14T14:40:21.006627+0000","last_became_active":"2024-05-14T14:40:14.941907+0000","last_became_peered":"2024-05-14T14:40:14.941907+0000","last_unstale":"2024-05-14T14:40:21.006627+0000","last_undegraded":"2024-05-14T14:40:21.006627+0000","last_fullsized":"2024-05-14T14:40:21.006627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:22:54.052167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353476+0000","last_change":"2024-05-14T14:40:20.021170+0000","last_active":"2024-05-14T14:40:21.353476+0000","last_peered":"2024-05-14T14:40:21.353476+0000","last_clean":"2024-05-14T14:40:21.353476+0000","last_became_active":"2024-05-14T14:40:20.019417+0000","last_became_peered":"2024-05-14T14:40:20.019417+0000","last_unstale":"2024-05-14T14:40:21.353476+0000","last_undegraded":"2024-05-14T14:40:21.353476+0000","last_fullsized":"2024-05-14T14:40:21.353476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:55:00.709986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351519+0000","last_change":"2024-05-14T14:40:15.962249+0000","last_active":"2024-05-14T14:40:21.351519+0000","last_peered":"2024-05-14T14:40:21.351519+0000","last_clean":"2024-05-14T14:40:21.351519+0000","last_became_active":"2024-05-14T14:40:15.961914+0000","last_became_peered":"2024-05-14T14:40:15.961914+0000","last_unstale":"2024-05-14T14:40:21.351519+0000","last_undegraded":"2024-05-14T14:40:21.351519+0000","last_fullsized":"2024-05-14T14:40:21.351519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:16:59.783346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.004576+0000","last_change":"2024-05-14T14:40:14.945511+0000","last_active":"2024-05-14T14:40:21.004576+0000","last_peered":"2024-05-14T14:40:21.004576+0000","last_clean":"2024-05-14T14:40:21.004576+0000","last_became_active":"2024-05-14T14:40:14.945162+0000","last_became_peered":"2024-05-14T14:40:14.945162+0000","last_unstale":"2024-05-14T14:40:21.004576+0000","last_undegraded":"2024-05-14T14:40:21.004576+0000","last_fullsized":"2024-05-14T14:40:21.004576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:03:50.412968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353899+0000","last_change":"2024-05-14T14:40:20.021422+0000","last_active":"2024-05-14T14:40:21.353899+0000","last_peered":"2024-05-14T14:40:21.353899+0000","last_clean":"2024-05-14T14:40:21.353899+0000","last_became_active":"2024-05-14T14:40:20.020363+0000","last_became_peered":"2024-05-14T14:40:20.020363+0000","last_unstale":"2024-05-14T14:40:21.353899+0000","last_undegraded":"2024-05-14T14:40:21.353899+0000","last_fullsized":"2024-05-14T14:40:21.353899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:09:34.037991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351255+0000","last_change":"2024-05-14T14:40:15.956227+0000","last_active":"2024-05-14T14:40:21.351255+0000","last_peered":"2024-05-14T14:40:21.351255+0000","last_clean":"2024-05-14T14:40:21.351255+0000","last_became_active":"2024-05-14T14:40:15.955850+0000","last_became_peered":"2024-05-14T14:40:15.955850+0000","last_unstale":"2024-05-14T14:40:21.351255+0000","last_undegraded":"2024-05-14T14:40:21.351255+0000","last_fullsized":"2024-05-14T14:40:21.351255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:19:45.703395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351460+0000","last_change":"2024-05-14T14:40:14.953611+0000","last_active":"2024-05-14T14:40:21.351460+0000","last_peered":"2024-05-14T14:40:21.351460+0000","last_clean":"2024-05-14T14:40:21.351460+0000","last_became_active":"2024-05-14T14:40:14.953288+0000","last_became_peered":"2024-05-14T14:40:14.953288+0000","last_unstale":"2024-05-14T14:40:21.351460+0000","last_undegraded":"2024-05-14T14:40:21.351460+0000","last_fullsized":"2024-05-14T14:40:21.351460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:22:54.052167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353571+0000","last_change":"2024-05-14T14:40:20.372908+0000","last_active":"2024-05-14T14:40:21.353571+0000","last_peered":"2024-05-14T14:40:21.353571+0000","last_clean":"2024-05-14T14:40:21.353571+0000","last_became_active":"2024-05-14T14:40:20.372440+0000","last_became_peered":"2024-05-14T14:40:20.372440+0000","last_unstale":"2024-05-14T14:40:21.353571+0000","last_undegraded":"2024-05-14T14:40:21.353571+0000","last_fullsized":"2024-05-14T14:40:21.353571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:36:41.517853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352312+0000","last_change":"2024-05-14T14:40:15.978286+0000","last_active":"2024-05-14T14:40:21.352312+0000","last_peered":"2024-05-14T14:40:21.352312+0000","last_clean":"2024-05-14T14:40:21.352312+0000","last_became_active":"2024-05-14T14:40:15.977864+0000","last_became_peered":"2024-05-14T14:40:15.977864+0000","last_unstale":"2024-05-14T14:40:21.352312+0000","last_undegraded":"2024-05-14T14:40:21.352312+0000","last_fullsized":"2024-05-14T14:40:21.352312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:16:59.783346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.005670+0000","last_change":"2024-05-14T14:40:14.939289+0000","last_active":"2024-05-14T14:40:21.005670+0000","last_peered":"2024-05-14T14:40:21.005670+0000","last_clean":"2024-05-14T14:40:21.005670+0000","last_became_active":"2024-05-14T14:40:14.938761+0000","last_became_peered":"2024-05-14T14:40:14.938761+0000","last_unstale":"2024-05-14T14:40:21.005670+0000","last_undegraded":"2024-05-14T14:40:21.005670+0000","last_fullsized":"2024-05-14T14:40:21.005670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:09:41.002376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":118,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351602+0000","last_change":"2024-05-14T14:40:06.302050+0000","last_active":"2024-05-14T14:40:21.351602+0000","last_peered":"2024-05-14T14:40:21.351602+0000","last_clean":"2024-05-14T14:40:21.351602+0000","last_became_active":"2024-05-14T14:40:06.300956+0000","last_became_peered":"2024-05-14T14:40:06.300956+0000","last_unstale":"2024-05-14T14:40:21.351602+0000","last_undegraded":"2024-05-14T14:40:21.351602+0000","last_fullsized":"2024-05-14T14:40:21.351602+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:04.850996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:04.850996+0000","last_clean_scrub_stamp":"2024-05-14T14:40:04.850996+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:08:41.028114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006296+0000","last_change":"2024-05-14T14:40:20.378549+0000","last_active":"2024-05-14T14:40:21.006296+0000","last_peered":"2024-05-14T14:40:21.006296+0000","last_clean":"2024-05-14T14:40:21.006296+0000","last_became_active":"2024-05-14T14:40:20.377998+0000","last_became_peered":"2024-05-14T14:40:20.377998+0000","last_unstale":"2024-05-14T14:40:21.006296+0000","last_undegraded":"2024-05-14T14:40:21.006296+0000","last_fullsized":"2024-05-14T14:40:21.006296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:01:01.849694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353100+0000","last_change":"2024-05-14T14:40:15.976278+0000","last_active":"2024-05-14T14:40:21.353100+0000","last_peered":"2024-05-14T14:40:21.353100+0000","last_clean":"2024-05-14T14:40:21.353100+0000","last_became_active":"2024-05-14T14:40:15.975906+0000","last_became_peered":"2024-05-14T14:40:15.975906+0000","last_unstale":"2024-05-14T14:40:21.353100+0000","last_undegraded":"2024-05-14T14:40:21.353100+0000","last_fullsized":"2024-05-14T14:40:21.353100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:41:42.097310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.004906+0000","last_change":"2024-05-14T14:40:14.949811+0000","last_active":"2024-05-14T14:40:21.004906+0000","last_peered":"2024-05-14T14:40:21.004906+0000","last_clean":"2024-05-14T14:40:21.004906+0000","last_became_active":"2024-05-14T14:40:14.949472+0000","last_became_peered":"2024-05-14T14:40:14.949472+0000","last_unstale":"2024-05-14T14:40:21.004906+0000","last_undegraded":"2024-05-14T14:40:21.004906+0000","last_fullsized":"2024-05-14T14:40:21.004906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:09:41.002376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.005991+0000","last_change":"2024-05-14T14:40:20.372940+0000","last_active":"2024-05-14T14:40:21.005991+0000","last_peered":"2024-05-14T14:40:21.005991+0000","last_clean":"2024-05-14T14:40:21.005991+0000","last_became_active":"2024-05-14T14:40:20.372407+0000","last_became_peered":"2024-05-14T14:40:20.372407+0000","last_unstale":"2024-05-14T14:40:21.005991+0000","last_undegraded":"2024-05-14T14:40:21.005991+0000","last_fullsized":"2024-05-14T14:40:21.005991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:28:38.834985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.007082+0000","last_change":"2024-05-14T14:40:15.972277+0000","last_active":"2024-05-14T14:40:21.007082+0000","last_peered":"2024-05-14T14:40:21.007082+0000","last_clean":"2024-05-14T14:40:21.007082+0000","last_became_active":"2024-05-14T14:40:15.971952+0000","last_became_peered":"2024-05-14T14:40:15.971952+0000","last_unstale":"2024-05-14T14:40:21.007082+0000","last_undegraded":"2024-05-14T14:40:21.007082+0000","last_fullsized":"2024-05-14T14:40:21.007082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:00:57.797820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352274+0000","last_change":"2024-05-14T14:40:14.940215+0000","last_active":"2024-05-14T14:40:21.352274+0000","last_peered":"2024-05-14T14:40:21.352274+0000","last_clean":"2024-05-14T14:40:21.352274+0000","last_became_active":"2024-05-14T14:40:14.939878+0000","last_became_peered":"2024-05-14T14:40:14.939878+0000","last_unstale":"2024-05-14T14:40:21.352274+0000","last_undegraded":"2024-05-14T14:40:21.352274+0000","last_fullsized":"2024-05-14T14:40:21.352274+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:36:37.730760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352612+0000","last_change":"2024-05-14T14:40:20.022658+0000","last_active":"2024-05-14T14:40:21.352612+0000","last_peered":"2024-05-14T14:40:21.352612+0000","last_clean":"2024-05-14T14:40:21.352612+0000","last_became_active":"2024-05-14T14:40:20.022176+0000","last_became_peered":"2024-05-14T14:40:20.022176+0000","last_unstale":"2024-05-14T14:40:21.352612+0000","last_undegraded":"2024-05-14T14:40:21.352612+0000","last_fullsized":"2024-05-14T14:40:21.352612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:01:01.849694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352973+0000","last_change":"2024-05-14T14:40:15.973870+0000","last_active":"2024-05-14T14:40:21.352973+0000","last_peered":"2024-05-14T14:40:21.352973+0000","last_clean":"2024-05-14T14:40:21.352973+0000","last_became_active":"2024-05-14T14:40:15.973324+0000","last_became_peered":"2024-05-14T14:40:15.973324+0000","last_unstale":"2024-05-14T14:40:21.352973+0000","last_undegraded":"2024-05-14T14:40:21.352973+0000","last_fullsized":"2024-05-14T14:40:21.352973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:19:26.250841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.004828+0000","last_change":"2024-05-14T14:40:14.942944+0000","last_active":"2024-05-14T14:40:21.004828+0000","last_peered":"2024-05-14T14:40:21.004828+0000","last_clean":"2024-05-14T14:40:21.004828+0000","last_became_active":"2024-05-14T14:40:14.942604+0000","last_became_peered":"2024-05-14T14:40:14.942604+0000","last_unstale":"2024-05-14T14:40:21.004828+0000","last_undegraded":"2024-05-14T14:40:21.004828+0000","last_fullsized":"2024-05-14T14:40:21.004828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:42:43.352565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.005290+0000","last_change":"2024-05-14T14:40:20.373005+0000","last_active":"2024-05-14T14:40:21.005290+0000","last_peered":"2024-05-14T14:40:21.005290+0000","last_clean":"2024-05-14T14:40:21.005290+0000","last_became_active":"2024-05-14T14:40:20.372502+0000","last_became_peered":"2024-05-14T14:40:20.372502+0000","last_unstale":"2024-05-14T14:40:21.005290+0000","last_undegraded":"2024-05-14T14:40:21.005290+0000","last_fullsized":"2024-05-14T14:40:21.005290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:43:06.799558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352729+0000","last_change":"2024-05-14T14:40:15.978754+0000","last_active":"2024-05-14T14:40:21.352729+0000","last_peered":"2024-05-14T14:40:21.352729+0000","last_clean":"2024-05-14T14:40:21.352729+0000","last_became_active":"2024-05-14T14:40:15.978406+0000","last_became_peered":"2024-05-14T14:40:15.978406+0000","last_unstale":"2024-05-14T14:40:21.352729+0000","last_undegraded":"2024-05-14T14:40:21.352729+0000","last_fullsized":"2024-05-14T14:40:21.352729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:00:58.953906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352912+0000","last_change":"2024-05-14T14:40:14.950699+0000","last_active":"2024-05-14T14:40:21.352912+0000","last_peered":"2024-05-14T14:40:21.352912+0000","last_clean":"2024-05-14T14:40:21.352912+0000","last_became_active":"2024-05-14T14:40:14.950333+0000","last_became_peered":"2024-05-14T14:40:14.950333+0000","last_unstale":"2024-05-14T14:40:21.352912+0000","last_undegraded":"2024-05-14T14:40:21.352912+0000","last_fullsized":"2024-05-14T14:40:21.352912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:59:30.772720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351835+0000","last_change":"2024-05-14T14:40:20.019464+0000","last_active":"2024-05-14T14:40:21.351835+0000","last_peered":"2024-05-14T14:40:21.351835+0000","last_clean":"2024-05-14T14:40:21.351835+0000","last_became_active":"2024-05-14T14:40:20.018546+0000","last_became_peered":"2024-05-14T14:40:20.018546+0000","last_unstale":"2024-05-14T14:40:21.351835+0000","last_undegraded":"2024-05-14T14:40:21.351835+0000","last_fullsized":"2024-05-14T14:40:21.351835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:58:53.100702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352000+0000","last_change":"2024-05-14T14:40:15.979685+0000","last_active":"2024-05-14T14:40:21.352000+0000","last_peered":"2024-05-14T14:40:21.352000+0000","last_clean":"2024-05-14T14:40:21.352000+0000","last_became_active":"2024-05-14T14:40:15.979324+0000","last_became_peered":"2024-05-14T14:40:15.979324+0000","last_unstale":"2024-05-14T14:40:21.352000+0000","last_undegraded":"2024-05-14T14:40:21.352000+0000","last_fullsized":"2024-05-14T14:40:21.352000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:43:15.190648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.004331+0000","last_change":"2024-05-14T14:40:14.940764+0000","last_active":"2024-05-14T14:40:21.004331+0000","last_peered":"2024-05-14T14:40:21.004331+0000","last_clean":"2024-05-14T14:40:21.004331+0000","last_became_active":"2024-05-14T14:40:14.940412+0000","last_became_peered":"2024-05-14T14:40:14.940412+0000","last_unstale":"2024-05-14T14:40:21.004331+0000","last_undegraded":"2024-05-14T14:40:21.004331+0000","last_fullsized":"2024-05-14T14:40:21.004331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:04:43.508873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353379+0000","last_change":"2024-05-14T14:40:20.019451+0000","last_active":"2024-05-14T14:40:21.353379+0000","last_peered":"2024-05-14T14:40:21.353379+0000","last_clean":"2024-05-14T14:40:21.353379+0000","last_became_active":"2024-05-14T14:40:20.018790+0000","last_became_peered":"2024-05-14T14:40:20.018790+0000","last_unstale":"2024-05-14T14:40:21.353379+0000","last_undegraded":"2024-05-14T14:40:21.353379+0000","last_fullsized":"2024-05-14T14:40:21.353379+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:55:00.709986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.005590+0000","last_change":"2024-05-14T14:40:15.967830+0000","last_active":"2024-05-14T14:40:21.005590+0000","last_peered":"2024-05-14T14:40:21.005590+0000","last_clean":"2024-05-14T14:40:21.005590+0000","last_became_active":"2024-05-14T14:40:15.967508+0000","last_became_peered":"2024-05-14T14:40:15.967508+0000","last_unstale":"2024-05-14T14:40:21.005590+0000","last_undegraded":"2024-05-14T14:40:21.005590+0000","last_fullsized":"2024-05-14T14:40:21.005590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:06:01.598712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006580+0000","last_change":"2024-05-14T14:40:14.940313+0000","last_active":"2024-05-14T14:40:21.006580+0000","last_peered":"2024-05-14T14:40:21.006580+0000","last_clean":"2024-05-14T14:40:21.006580+0000","last_became_active":"2024-05-14T14:40:14.939989+0000","last_became_peered":"2024-05-14T14:40:14.939989+0000","last_unstale":"2024-05-14T14:40:21.006580+0000","last_undegraded":"2024-05-14T14:40:21.006580+0000","last_fullsized":"2024-05-14T14:40:21.006580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:09:41.002376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352073+0000","last_change":"2024-05-14T14:40:20.379270+0000","last_active":"2024-05-14T14:40:21.352073+0000","last_peered":"2024-05-14T14:40:21.352073+0000","last_clean":"2024-05-14T14:40:21.352073+0000","last_became_active":"2024-05-14T14:40:20.378163+0000","last_became_peered":"2024-05-14T14:40:20.378163+0000","last_unstale":"2024-05-14T14:40:21.352073+0000","last_undegraded":"2024-05-14T14:40:21.352073+0000","last_fullsized":"2024-05-14T14:40:21.352073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:56:23.335268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352261+0000","last_change":"2024-05-14T14:40:15.979702+0000","last_active":"2024-05-14T14:40:21.352261+0000","last_peered":"2024-05-14T14:40:21.352261+0000","last_clean":"2024-05-14T14:40:21.352261+0000","last_became_active":"2024-05-14T14:40:15.978801+0000","last_became_peered":"2024-05-14T14:40:15.978801+0000","last_unstale":"2024-05-14T14:40:21.352261+0000","last_undegraded":"2024-05-14T14:40:21.352261+0000","last_fullsized":"2024-05-14T14:40:21.352261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:28:34.783112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006507+0000","last_change":"2024-05-14T14:40:14.946153+0000","last_active":"2024-05-14T14:40:21.006507+0000","last_peered":"2024-05-14T14:40:21.006507+0000","last_clean":"2024-05-14T14:40:21.006507+0000","last_became_active":"2024-05-14T14:40:14.945598+0000","last_became_peered":"2024-05-14T14:40:14.945598+0000","last_unstale":"2024-05-14T14:40:21.006507+0000","last_undegraded":"2024-05-14T14:40:21.006507+0000","last_fullsized":"2024-05-14T14:40:21.006507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:30:28.647287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352265+0000","last_change":"2024-05-14T14:40:20.373021+0000","last_active":"2024-05-14T14:40:21.352265+0000","last_peered":"2024-05-14T14:40:21.352265+0000","last_clean":"2024-05-14T14:40:21.352265+0000","last_became_active":"2024-05-14T14:40:20.372611+0000","last_became_peered":"2024-05-14T14:40:20.372611+0000","last_unstale":"2024-05-14T14:40:21.352265+0000","last_undegraded":"2024-05-14T14:40:21.352265+0000","last_fullsized":"2024-05-14T14:40:21.352265+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:20:04.831495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352027+0000","last_change":"2024-05-14T14:40:15.963419+0000","last_active":"2024-05-14T14:40:21.352027+0000","last_peered":"2024-05-14T14:40:21.352027+0000","last_clean":"2024-05-14T14:40:21.352027+0000","last_became_active":"2024-05-14T14:40:15.963015+0000","last_became_peered":"2024-05-14T14:40:15.963015+0000","last_unstale":"2024-05-14T14:40:21.352027+0000","last_undegraded":"2024-05-14T14:40:21.352027+0000","last_fullsized":"2024-05-14T14:40:21.352027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:02:28.598796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353002+0000","last_change":"2024-05-14T14:40:14.950887+0000","last_active":"2024-05-14T14:40:21.353002+0000","last_peered":"2024-05-14T14:40:21.353002+0000","last_clean":"2024-05-14T14:40:21.353002+0000","last_became_active":"2024-05-14T14:40:14.950546+0000","last_became_peered":"2024-05-14T14:40:14.950546+0000","last_unstale":"2024-05-14T14:40:21.353002+0000","last_undegraded":"2024-05-14T14:40:21.353002+0000","last_fullsized":"2024-05-14T14:40:21.353002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:15:53.584304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.007527+0000","last_change":"2024-05-14T14:40:20.378686+0000","last_active":"2024-05-14T14:40:21.007527+0000","last_peered":"2024-05-14T14:40:21.007527+0000","last_clean":"2024-05-14T14:40:21.007527+0000","last_became_active":"2024-05-14T14:40:20.378123+0000","last_became_peered":"2024-05-14T14:40:20.378123+0000","last_unstale":"2024-05-14T14:40:21.007527+0000","last_undegraded":"2024-05-14T14:40:21.007527+0000","last_fullsized":"2024-05-14T14:40:21.007527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:56:23.335268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352960+0000","last_change":"2024-05-14T14:40:15.973748+0000","last_active":"2024-05-14T14:40:21.352960+0000","last_peered":"2024-05-14T14:40:21.352960+0000","last_clean":"2024-05-14T14:40:21.352960+0000","last_became_active":"2024-05-14T14:40:15.972604+0000","last_became_peered":"2024-05-14T14:40:15.972604+0000","last_unstale":"2024-05-14T14:40:21.352960+0000","last_undegraded":"2024-05-14T14:40:21.352960+0000","last_fullsized":"2024-05-14T14:40:21.352960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:00:57.797820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:25.672493+0000","last_change":"2024-05-14T14:40:14.953883+0000","last_active":"2024-05-14T14:40:25.672493+0000","last_peered":"2024-05-14T14:40:25.672493+0000","last_clean":"2024-05-14T14:40:25.672493+0000","last_became_active":"2024-05-14T14:40:14.953540+0000","last_became_peered":"2024-05-14T14:40:14.953540+0000","last_unstale":"2024-05-14T14:40:25.672493+0000","last_undegraded":"2024-05-14T14:40:25.672493+0000","last_fullsized":"2024-05-14T14:40:25.672493+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:22:54.052167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353319+0000","last_change":"2024-05-14T14:40:20.017238+0000","last_active":"2024-05-14T14:40:21.353319+0000","last_peered":"2024-05-14T14:40:21.353319+0000","last_clean":"2024-05-14T14:40:21.353319+0000","last_became_active":"2024-05-14T14:40:20.016725+0000","last_became_peered":"2024-05-14T14:40:20.016725+0000","last_unstale":"2024-05-14T14:40:21.353319+0000","last_undegraded":"2024-05-14T14:40:21.353319+0000","last_fullsized":"2024-05-14T14:40:21.353319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:01:03.005779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352553+0000","last_change":"2024-05-14T14:40:15.965371+0000","last_active":"2024-05-14T14:40:21.352553+0000","last_peered":"2024-05-14T14:40:21.352553+0000","last_clean":"2024-05-14T14:40:21.352553+0000","last_became_active":"2024-05-14T14:40:15.964988+0000","last_became_peered":"2024-05-14T14:40:15.964988+0000","last_unstale":"2024-05-14T14:40:21.352553+0000","last_undegraded":"2024-05-14T14:40:21.352553+0000","last_fullsized":"2024-05-14T14:40:21.352553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:17:12.953751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352156+0000","last_change":"2024-05-14T14:40:14.950270+0000","last_active":"2024-05-14T14:40:21.352156+0000","last_peered":"2024-05-14T14:40:21.352156+0000","last_clean":"2024-05-14T14:40:21.352156+0000","last_became_active":"2024-05-14T14:40:14.949473+0000","last_became_peered":"2024-05-14T14:40:14.949473+0000","last_unstale":"2024-05-14T14:40:21.352156+0000","last_undegraded":"2024-05-14T14:40:21.352156+0000","last_fullsized":"2024-05-14T14:40:21.352156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:22:54.052167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351973+0000","last_change":"2024-05-14T14:40:20.008055+0000","last_active":"2024-05-14T14:40:21.351973+0000","last_peered":"2024-05-14T14:40:21.351973+0000","last_clean":"2024-05-14T14:40:21.351973+0000","last_became_active":"2024-05-14T14:40:20.007482+0000","last_became_peered":"2024-05-14T14:40:20.007482+0000","last_unstale":"2024-05-14T14:40:21.351973+0000","last_undegraded":"2024-05-14T14:40:21.351973+0000","last_fullsized":"2024-05-14T14:40:21.351973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:20:24.893525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353866+0000","last_change":"2024-05-14T14:40:15.954872+0000","last_active":"2024-05-14T14:40:21.353866+0000","last_peered":"2024-05-14T14:40:21.353866+0000","last_clean":"2024-05-14T14:40:21.353866+0000","last_became_active":"2024-05-14T14:40:15.954475+0000","last_became_peered":"2024-05-14T14:40:15.954475+0000","last_unstale":"2024-05-14T14:40:21.353866+0000","last_undegraded":"2024-05-14T14:40:21.353866+0000","last_fullsized":"2024-05-14T14:40:21.353866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:16:59.783346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.007184+0000","last_change":"2024-05-14T14:40:14.946318+0000","last_active":"2024-05-14T14:40:21.007184+0000","last_peered":"2024-05-14T14:40:21.007184+0000","last_clean":"2024-05-14T14:40:21.007184+0000","last_became_active":"2024-05-14T14:40:14.945963+0000","last_became_peered":"2024-05-14T14:40:14.945963+0000","last_unstale":"2024-05-14T14:40:21.007184+0000","last_undegraded":"2024-05-14T14:40:21.007184+0000","last_fullsized":"2024-05-14T14:40:21.007184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:03:50.412968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351737+0000","last_change":"2024-05-14T14:40:20.012702+0000","last_active":"2024-05-14T14:40:21.351737+0000","last_peered":"2024-05-14T14:40:21.351737+0000","last_clean":"2024-05-14T14:40:21.351737+0000","last_became_active":"2024-05-14T14:40:20.012262+0000","last_became_peered":"2024-05-14T14:40:20.012262+0000","last_unstale":"2024-05-14T14:40:21.351737+0000","last_undegraded":"2024-05-14T14:40:21.351737+0000","last_fullsized":"2024-05-14T14:40:21.351737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:12:03.474411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.007052+0000","last_change":"2024-05-14T14:40:15.967089+0000","last_active":"2024-05-14T14:40:21.007052+0000","last_peered":"2024-05-14T14:40:21.007052+0000","last_clean":"2024-05-14T14:40:21.007052+0000","last_became_active":"2024-05-14T14:40:15.963492+0000","last_became_peered":"2024-05-14T14:40:15.963492+0000","last_unstale":"2024-05-14T14:40:21.007052+0000","last_undegraded":"2024-05-14T14:40:21.007052+0000","last_fullsized":"2024-05-14T14:40:21.007052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:54:56.658112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006874+0000","last_change":"2024-05-14T14:40:14.949559+0000","last_active":"2024-05-14T14:40:21.006874+0000","last_peered":"2024-05-14T14:40:21.006874+0000","last_clean":"2024-05-14T14:40:21.006874+0000","last_became_active":"2024-05-14T14:40:14.949108+0000","last_became_peered":"2024-05-14T14:40:14.949108+0000","last_unstale":"2024-05-14T14:40:21.006874+0000","last_undegraded":"2024-05-14T14:40:21.006874+0000","last_fullsized":"2024-05-14T14:40:21.006874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:03:50.412968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352199+0000","last_change":"2024-05-14T14:40:20.380409+0000","last_active":"2024-05-14T14:40:21.352199+0000","last_peered":"2024-05-14T14:40:21.352199+0000","last_clean":"2024-05-14T14:40:21.352199+0000","last_became_active":"2024-05-14T14:40:20.377982+0000","last_became_peered":"2024-05-14T14:40:20.377982+0000","last_unstale":"2024-05-14T14:40:21.352199+0000","last_undegraded":"2024-05-14T14:40:21.352199+0000","last_fullsized":"2024-05-14T14:40:21.352199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:54:43.610454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353208+0000","last_change":"2024-05-14T14:40:20.378415+0000","last_active":"2024-05-14T14:40:21.353208+0000","last_peered":"2024-05-14T14:40:21.353208+0000","last_clean":"2024-05-14T14:40:21.353208+0000","last_became_active":"2024-05-14T14:40:20.378008+0000","last_became_peered":"2024-05-14T14:40:20.378008+0000","last_unstale":"2024-05-14T14:40:21.353208+0000","last_undegraded":"2024-05-14T14:40:21.353208+0000","last_fullsized":"2024-05-14T14:40:21.353208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:01:03.005779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351155+0000","last_change":"2024-05-14T14:40:15.973814+0000","last_active":"2024-05-14T14:40:21.351155+0000","last_peered":"2024-05-14T14:40:21.351155+0000","last_clean":"2024-05-14T14:40:21.351155+0000","last_became_active":"2024-05-14T14:40:15.972930+0000","last_became_peered":"2024-05-14T14:40:15.972930+0000","last_unstale":"2024-05-14T14:40:21.351155+0000","last_undegraded":"2024-05-14T14:40:21.351155+0000","last_fullsized":"2024-05-14T14:40:21.351155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:54:04.167075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.005569+0000","last_change":"2024-05-14T14:40:14.940248+0000","last_active":"2024-05-14T14:40:21.005569+0000","last_peered":"2024-05-14T14:40:21.005569+0000","last_clean":"2024-05-14T14:40:21.005569+0000","last_became_active":"2024-05-14T14:40:14.938524+0000","last_became_peered":"2024-05-14T14:40:14.938524+0000","last_unstale":"2024-05-14T14:40:21.005569+0000","last_undegraded":"2024-05-14T14:40:21.005569+0000","last_fullsized":"2024-05-14T14:40:21.005569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:42:43.352565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006899+0000","last_change":"2024-05-14T14:40:20.017769+0000","last_active":"2024-05-14T14:40:21.006899+0000","last_peered":"2024-05-14T14:40:21.006899+0000","last_clean":"2024-05-14T14:40:21.006899+0000","last_became_active":"2024-05-14T14:40:20.017248+0000","last_became_peered":"2024-05-14T14:40:20.017248+0000","last_unstale":"2024-05-14T14:40:21.006899+0000","last_undegraded":"2024-05-14T14:40:21.006899+0000","last_fullsized":"2024-05-14T14:40:21.006899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:01:03.005779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351813+0000","last_change":"2024-05-14T14:40:15.970841+0000","last_active":"2024-05-14T14:40:21.351813+0000","last_peered":"2024-05-14T14:40:21.351813+0000","last_clean":"2024-05-14T14:40:21.351813+0000","last_became_active":"2024-05-14T14:40:15.970405+0000","last_became_peered":"2024-05-14T14:40:15.970405+0000","last_unstale":"2024-05-14T14:40:21.351813+0000","last_undegraded":"2024-05-14T14:40:21.351813+0000","last_fullsized":"2024-05-14T14:40:21.351813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:06:01.598712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351688+0000","last_change":"2024-05-14T14:40:14.952894+0000","last_active":"2024-05-14T14:40:21.351688+0000","last_peered":"2024-05-14T14:40:21.351688+0000","last_clean":"2024-05-14T14:40:21.351688+0000","last_became_active":"2024-05-14T14:40:14.952591+0000","last_became_peered":"2024-05-14T14:40:14.952591+0000","last_unstale":"2024-05-14T14:40:21.351688+0000","last_undegraded":"2024-05-14T14:40:21.351688+0000","last_fullsized":"2024-05-14T14:40:21.351688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:09:41.002376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006239+0000","last_change":"2024-05-14T14:40:14.942311+0000","last_active":"2024-05-14T14:40:21.006239+0000","last_peered":"2024-05-14T14:40:21.006239+0000","last_clean":"2024-05-14T14:40:21.006239+0000","last_became_active":"2024-05-14T14:40:14.941964+0000","last_became_peered":"2024-05-14T14:40:14.941964+0000","last_unstale":"2024-05-14T14:40:21.006239+0000","last_undegraded":"2024-05-14T14:40:21.006239+0000","last_fullsized":"2024-05-14T14:40:21.006239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:42:43.352565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352830+0000","last_change":"2024-05-14T14:40:15.955268+0000","last_active":"2024-05-14T14:40:21.352830+0000","last_peered":"2024-05-14T14:40:21.352830+0000","last_clean":"2024-05-14T14:40:21.352830+0000","last_became_active":"2024-05-14T14:40:15.954880+0000","last_became_peered":"2024-05-14T14:40:15.954880+0000","last_unstale":"2024-05-14T14:40:21.352830+0000","last_undegraded":"2024-05-14T14:40:21.352830+0000","last_fullsized":"2024-05-14T14:40:21.352830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:24:18.488847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.004720+0000","last_change":"2024-05-14T14:40:20.009663+0000","last_active":"2024-05-14T14:40:21.004720+0000","last_peered":"2024-05-14T14:40:21.004720+0000","last_clean":"2024-05-14T14:40:21.004720+0000","last_became_active":"2024-05-14T14:40:20.009220+0000","last_became_peered":"2024-05-14T14:40:20.009220+0000","last_unstale":"2024-05-14T14:40:21.004720+0000","last_undegraded":"2024-05-14T14:40:21.004720+0000","last_fullsized":"2024-05-14T14:40:21.004720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:19:49.755269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352741+0000","last_change":"2024-05-14T14:40:14.947750+0000","last_active":"2024-05-14T14:40:21.352741+0000","last_peered":"2024-05-14T14:40:21.352741+0000","last_clean":"2024-05-14T14:40:21.352741+0000","last_became_active":"2024-05-14T14:40:14.947440+0000","last_became_peered":"2024-05-14T14:40:14.947440+0000","last_unstale":"2024-05-14T14:40:21.352741+0000","last_undegraded":"2024-05-14T14:40:21.352741+0000","last_fullsized":"2024-05-14T14:40:21.352741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:13.916124+0000","last_clean_scrub_stamp":"2024-05-14T14:40:13.916124+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:48:44.948315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352347+0000","last_change":"2024-05-14T14:40:15.970419+0000","last_active":"2024-05-14T14:40:21.352347+0000","last_peered":"2024-05-14T14:40:21.352347+0000","last_clean":"2024-05-14T14:40:21.352347+0000","last_became_active":"2024-05-14T14:40:15.969621+0000","last_became_peered":"2024-05-14T14:40:15.969621+0000","last_unstale":"2024-05-14T14:40:21.352347+0000","last_undegraded":"2024-05-14T14:40:21.352347+0000","last_fullsized":"2024-05-14T14:40:21.352347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:03:51.418638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353215+0000","last_change":"2024-05-14T14:40:20.023154+0000","last_active":"2024-05-14T14:40:21.353215+0000","last_peered":"2024-05-14T14:40:21.353215+0000","last_clean":"2024-05-14T14:40:21.353215+0000","last_became_active":"2024-05-14T14:40:20.022012+0000","last_became_peered":"2024-05-14T14:40:20.022012+0000","last_unstale":"2024-05-14T14:40:21.353215+0000","last_undegraded":"2024-05-14T14:40:21.353215+0000","last_fullsized":"2024-05-14T14:40:21.353215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:18.973668+0000","last_clean_scrub_stamp":"2024-05-14T14:40:18.973668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:52:47.149904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.005435+0000","last_change":"2024-05-14T14:40:15.968635+0000","last_active":"2024-05-14T14:40:21.005435+0000","last_peered":"2024-05-14T14:40:21.005435+0000","last_clean":"2024-05-14T14:40:21.005435+0000","last_became_active":"2024-05-14T14:40:15.968332+0000","last_became_peered":"2024-05-14T14:40:15.968332+0000","last_unstale":"2024-05-14T14:40:21.005435+0000","last_undegraded":"2024-05-14T14:40:21.005435+0000","last_fullsized":"2024-05-14T14:40:21.005435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:23:34.578655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.004351+0000","last_change":"2024-05-14T14:40:15.976612+0000","last_active":"2024-05-14T14:40:21.004351+0000","last_peered":"2024-05-14T14:40:21.004351+0000","last_clean":"2024-05-14T14:40:21.004351+0000","last_became_active":"2024-05-14T14:40:15.975536+0000","last_became_peered":"2024-05-14T14:40:15.975536+0000","last_unstale":"2024-05-14T14:40:21.004351+0000","last_undegraded":"2024-05-14T14:40:21.004351+0000","last_fullsized":"2024-05-14T14:40:21.004351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:17:12.953751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006389+0000","last_change":"2024-05-14T14:40:15.977511+0000","last_active":"2024-05-14T14:40:21.006389+0000","last_peered":"2024-05-14T14:40:21.006389+0000","last_clean":"2024-05-14T14:40:21.006389+0000","last_became_active":"2024-05-14T14:40:15.977176+0000","last_became_peered":"2024-05-14T14:40:15.977176+0000","last_unstale":"2024-05-14T14:40:21.006389+0000","last_undegraded":"2024-05-14T14:40:21.006389+0000","last_fullsized":"2024-05-14T14:40:21.006389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:32:21.620701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352721+0000","last_change":"2024-05-14T14:40:15.969442+0000","last_active":"2024-05-14T14:40:21.352721+0000","last_peered":"2024-05-14T14:40:21.352721+0000","last_clean":"2024-05-14T14:40:21.352721+0000","last_became_active":"2024-05-14T14:40:15.968989+0000","last_became_peered":"2024-05-14T14:40:15.968989+0000","last_unstale":"2024-05-14T14:40:21.352721+0000","last_undegraded":"2024-05-14T14:40:21.352721+0000","last_fullsized":"2024-05-14T14:40:21.352721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:59:55.024165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352423+0000","last_change":"2024-05-14T14:40:15.981801+0000","last_active":"2024-05-14T14:40:21.352423+0000","last_peered":"2024-05-14T14:40:21.352423+0000","last_clean":"2024-05-14T14:40:21.352423+0000","last_became_active":"2024-05-14T14:40:15.981444+0000","last_became_peered":"2024-05-14T14:40:15.981444+0000","last_unstale":"2024-05-14T14:40:21.352423+0000","last_undegraded":"2024-05-14T14:40:21.352423+0000","last_fullsized":"2024-05-14T14:40:21.352423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:59:55.024165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351958+0000","last_change":"2024-05-14T14:40:15.973771+0000","last_active":"2024-05-14T14:40:21.351958+0000","last_peered":"2024-05-14T14:40:21.351958+0000","last_clean":"2024-05-14T14:40:21.351958+0000","last_became_active":"2024-05-14T14:40:15.973388+0000","last_became_peered":"2024-05-14T14:40:15.973388+0000","last_unstale":"2024-05-14T14:40:21.351958+0000","last_undegraded":"2024-05-14T14:40:21.351958+0000","last_fullsized":"2024-05-14T14:40:21.351958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:53.130907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006356+0000","last_change":"2024-05-14T14:40:15.969745+0000","last_active":"2024-05-14T14:40:21.006356+0000","last_peered":"2024-05-14T14:40:21.006356+0000","last_clean":"2024-05-14T14:40:21.006356+0000","last_became_active":"2024-05-14T14:40:15.969412+0000","last_became_peered":"2024-05-14T14:40:15.969412+0000","last_unstale":"2024-05-14T14:40:21.006356+0000","last_undegraded":"2024-05-14T14:40:21.006356+0000","last_fullsized":"2024-05-14T14:40:21.006356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:24:18.488847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352189+0000","last_change":"2024-05-14T14:40:15.982718+0000","last_active":"2024-05-14T14:40:21.352189+0000","last_peered":"2024-05-14T14:40:21.352189+0000","last_clean":"2024-05-14T14:40:21.352189+0000","last_became_active":"2024-05-14T14:40:15.982354+0000","last_became_peered":"2024-05-14T14:40:15.982354+0000","last_unstale":"2024-05-14T14:40:21.352189+0000","last_undegraded":"2024-05-14T14:40:21.352189+0000","last_fullsized":"2024-05-14T14:40:21.352189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:32:21.620701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.005438+0000","last_change":"2024-05-14T14:40:15.966798+0000","last_active":"2024-05-14T14:40:21.005438+0000","last_peered":"2024-05-14T14:40:21.005438+0000","last_clean":"2024-05-14T14:40:21.005438+0000","last_became_active":"2024-05-14T14:40:15.966408+0000","last_became_peered":"2024-05-14T14:40:15.966408+0000","last_unstale":"2024-05-14T14:40:21.005438+0000","last_undegraded":"2024-05-14T14:40:21.005438+0000","last_fullsized":"2024-05-14T14:40:21.005438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:24:18.488847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351504+0000","last_change":"2024-05-14T14:40:15.970022+0000","last_active":"2024-05-14T14:40:21.351504+0000","last_peered":"2024-05-14T14:40:21.351504+0000","last_clean":"2024-05-14T14:40:21.351504+0000","last_became_active":"2024-05-14T14:40:15.969695+0000","last_became_peered":"2024-05-14T14:40:15.969695+0000","last_unstale":"2024-05-14T14:40:21.351504+0000","last_undegraded":"2024-05-14T14:40:21.351504+0000","last_fullsized":"2024-05-14T14:40:21.351504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:58:49.048828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006273+0000","last_change":"2024-05-14T14:40:15.963064+0000","last_active":"2024-05-14T14:40:21.006273+0000","last_peered":"2024-05-14T14:40:21.006273+0000","last_clean":"2024-05-14T14:40:21.006273+0000","last_became_active":"2024-05-14T14:40:15.962710+0000","last_became_peered":"2024-05-14T14:40:15.962710+0000","last_unstale":"2024-05-14T14:40:21.006273+0000","last_undegraded":"2024-05-14T14:40:21.006273+0000","last_fullsized":"2024-05-14T14:40:21.006273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:20:20.841651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352408+0000","last_change":"2024-05-14T14:40:15.967114+0000","last_active":"2024-05-14T14:40:21.352408+0000","last_peered":"2024-05-14T14:40:21.352408+0000","last_clean":"2024-05-14T14:40:21.352408+0000","last_became_active":"2024-05-14T14:40:15.966769+0000","last_became_peered":"2024-05-14T14:40:15.966769+0000","last_unstale":"2024-05-14T14:40:21.352408+0000","last_undegraded":"2024-05-14T14:40:21.352408+0000","last_fullsized":"2024-05-14T14:40:21.352408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:54:04.167075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006690+0000","last_change":"2024-05-14T14:40:15.959522+0000","last_active":"2024-05-14T14:40:21.006690+0000","last_peered":"2024-05-14T14:40:21.006690+0000","last_clean":"2024-05-14T14:40:21.006690+0000","last_became_active":"2024-05-14T14:40:15.959175+0000","last_became_peered":"2024-05-14T14:40:15.959175+0000","last_unstale":"2024-05-14T14:40:21.006690+0000","last_undegraded":"2024-05-14T14:40:21.006690+0000","last_fullsized":"2024-05-14T14:40:21.006690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:16:59.783346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.353319+0000","last_change":"2024-05-14T14:40:15.965742+0000","last_active":"2024-05-14T14:40:21.353319+0000","last_peered":"2024-05-14T14:40:21.353319+0000","last_clean":"2024-05-14T14:40:21.353319+0000","last_became_active":"2024-05-14T14:40:15.965402+0000","last_became_peered":"2024-05-14T14:40:15.965402+0000","last_unstale":"2024-05-14T14:40:21.353319+0000","last_undegraded":"2024-05-14T14:40:21.353319+0000","last_fullsized":"2024-05-14T14:40:21.353319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:54:56.658112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.004698+0000","last_change":"2024-05-14T14:40:15.958876+0000","last_active":"2024-05-14T14:40:21.004698+0000","last_peered":"2024-05-14T14:40:21.004698+0000","last_clean":"2024-05-14T14:40:21.004698+0000","last_became_active":"2024-05-14T14:40:15.958527+0000","last_became_peered":"2024-05-14T14:40:15.958527+0000","last_unstale":"2024-05-14T14:40:21.004698+0000","last_undegraded":"2024-05-14T14:40:21.004698+0000","last_fullsized":"2024-05-14T14:40:21.004698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:36:38.736430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.007564+0000","last_change":"2024-05-14T14:40:15.962954+0000","last_active":"2024-05-14T14:40:21.007564+0000","last_peered":"2024-05-14T14:40:21.007564+0000","last_clean":"2024-05-14T14:40:21.007564+0000","last_became_active":"2024-05-14T14:40:15.962607+0000","last_became_peered":"2024-05-14T14:40:15.962607+0000","last_unstale":"2024-05-14T14:40:21.007564+0000","last_undegraded":"2024-05-14T14:40:21.007564+0000","last_fullsized":"2024-05-14T14:40:21.007564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:36:37.465980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.005302+0000","last_change":"2024-05-14T14:40:15.959274+0000","last_active":"2024-05-14T14:40:21.005302+0000","last_peered":"2024-05-14T14:40:21.005302+0000","last_clean":"2024-05-14T14:40:21.005302+0000","last_became_active":"2024-05-14T14:40:15.958645+0000","last_became_peered":"2024-05-14T14:40:15.958645+0000","last_unstale":"2024-05-14T14:40:21.005302+0000","last_undegraded":"2024-05-14T14:40:21.005302+0000","last_fullsized":"2024-05-14T14:40:21.005302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:59:55.024165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351254+0000","last_change":"2024-05-14T14:40:15.969772+0000","last_active":"2024-05-14T14:40:21.351254+0000","last_peered":"2024-05-14T14:40:21.351254+0000","last_clean":"2024-05-14T14:40:21.351254+0000","last_became_active":"2024-05-14T14:40:15.969426+0000","last_became_peered":"2024-05-14T14:40:15.969426+0000","last_unstale":"2024-05-14T14:40:21.351254+0000","last_undegraded":"2024-05-14T14:40:21.351254+0000","last_fullsized":"2024-05-14T14:40:21.351254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:23:34.578655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351920+0000","last_change":"2024-05-14T14:40:15.968134+0000","last_active":"2024-05-14T14:40:21.351920+0000","last_peered":"2024-05-14T14:40:21.351920+0000","last_clean":"2024-05-14T14:40:21.351920+0000","last_became_active":"2024-05-14T14:40:15.967777+0000","last_became_peered":"2024-05-14T14:40:15.967777+0000","last_unstale":"2024-05-14T14:40:21.351920+0000","last_undegraded":"2024-05-14T14:40:21.351920+0000","last_fullsized":"2024-05-14T14:40:21.351920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:55:12.523931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352640+0000","last_change":"2024-05-14T14:40:15.968186+0000","last_active":"2024-05-14T14:40:21.352640+0000","last_peered":"2024-05-14T14:40:21.352640+0000","last_clean":"2024-05-14T14:40:21.352640+0000","last_became_active":"2024-05-14T14:40:15.967015+0000","last_became_peered":"2024-05-14T14:40:15.967015+0000","last_unstale":"2024-05-14T14:40:21.352640+0000","last_undegraded":"2024-05-14T14:40:21.352640+0000","last_fullsized":"2024-05-14T14:40:21.352640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:20:20.841651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352491+0000","last_change":"2024-05-14T14:40:15.957490+0000","last_active":"2024-05-14T14:40:21.352491+0000","last_peered":"2024-05-14T14:40:21.352491+0000","last_clean":"2024-05-14T14:40:21.352491+0000","last_became_active":"2024-05-14T14:40:15.957138+0000","last_became_peered":"2024-05-14T14:40:15.957138+0000","last_unstale":"2024-05-14T14:40:21.352491+0000","last_undegraded":"2024-05-14T14:40:21.352491+0000","last_fullsized":"2024-05-14T14:40:21.352491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:36:38.736430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.007117+0000","last_change":"2024-05-14T14:40:15.980390+0000","last_active":"2024-05-14T14:40:21.007117+0000","last_peered":"2024-05-14T14:40:21.007117+0000","last_clean":"2024-05-14T14:40:21.007117+0000","last_became_active":"2024-05-14T14:40:15.975197+0000","last_became_peered":"2024-05-14T14:40:15.975197+0000","last_unstale":"2024-05-14T14:40:21.007117+0000","last_undegraded":"2024-05-14T14:40:21.007117+0000","last_fullsized":"2024-05-14T14:40:21.007117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:24:53.130907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006219+0000","last_change":"2024-05-14T14:40:15.980514+0000","last_active":"2024-05-14T14:40:21.006219+0000","last_peered":"2024-05-14T14:40:21.006219+0000","last_clean":"2024-05-14T14:40:21.006219+0000","last_became_active":"2024-05-14T14:40:15.980024+0000","last_became_peered":"2024-05-14T14:40:15.980024+0000","last_unstale":"2024-05-14T14:40:21.006219+0000","last_undegraded":"2024-05-14T14:40:21.006219+0000","last_fullsized":"2024-05-14T14:40:21.006219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:59:55.024165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352960+0000","last_change":"2024-05-14T14:40:15.977265+0000","last_active":"2024-05-14T14:40:21.352960+0000","last_peered":"2024-05-14T14:40:21.352960+0000","last_clean":"2024-05-14T14:40:21.352960+0000","last_became_active":"2024-05-14T14:40:15.976826+0000","last_became_peered":"2024-05-14T14:40:15.976826+0000","last_unstale":"2024-05-14T14:40:21.352960+0000","last_undegraded":"2024-05-14T14:40:21.352960+0000","last_fullsized":"2024-05-14T14:40:21.352960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:36:37.465980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351694+0000","last_change":"2024-05-14T14:40:15.979087+0000","last_active":"2024-05-14T14:40:21.351694+0000","last_peered":"2024-05-14T14:40:21.351694+0000","last_clean":"2024-05-14T14:40:21.351694+0000","last_became_active":"2024-05-14T14:40:15.978749+0000","last_became_peered":"2024-05-14T14:40:15.978749+0000","last_unstale":"2024-05-14T14:40:21.351694+0000","last_undegraded":"2024-05-14T14:40:21.351694+0000","last_fullsized":"2024-05-14T14:40:21.351694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:54:04.167075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.351866+0000","last_change":"2024-05-14T14:40:15.972565+0000","last_active":"2024-05-14T14:40:21.351866+0000","last_peered":"2024-05-14T14:40:21.351866+0000","last_clean":"2024-05-14T14:40:21.351866+0000","last_became_active":"2024-05-14T14:40:15.972197+0000","last_became_peered":"2024-05-14T14:40:15.972197+0000","last_unstale":"2024-05-14T14:40:21.351866+0000","last_undegraded":"2024-05-14T14:40:21.351866+0000","last_fullsized":"2024-05-14T14:40:21.351866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:20:20.841651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006142+0000","last_change":"2024-05-14T14:40:15.962025+0000","last_active":"2024-05-14T14:40:21.006142+0000","last_peered":"2024-05-14T14:40:21.006142+0000","last_clean":"2024-05-14T14:40:21.006142+0000","last_became_active":"2024-05-14T14:40:15.961314+0000","last_became_peered":"2024-05-14T14:40:15.961314+0000","last_unstale":"2024-05-14T14:40:21.006142+0000","last_undegraded":"2024-05-14T14:40:21.006142+0000","last_fullsized":"2024-05-14T14:40:21.006142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:58:49.048828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352128+0000","last_change":"2024-05-14T14:40:15.964970+0000","last_active":"2024-05-14T14:40:21.352128+0000","last_peered":"2024-05-14T14:40:21.352128+0000","last_clean":"2024-05-14T14:40:21.352128+0000","last_became_active":"2024-05-14T14:40:15.964611+0000","last_became_peered":"2024-05-14T14:40:15.964611+0000","last_unstale":"2024-05-14T14:40:21.352128+0000","last_undegraded":"2024-05-14T14:40:21.352128+0000","last_fullsized":"2024-05-14T14:40:21.352128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:32:21.620701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.006800+0000","last_change":"2024-05-14T14:40:15.974010+0000","last_active":"2024-05-14T14:40:21.006800+0000","last_peered":"2024-05-14T14:40:21.006800+0000","last_clean":"2024-05-14T14:40:21.006800+0000","last_became_active":"2024-05-14T14:40:15.973683+0000","last_became_peered":"2024-05-14T14:40:15.973683+0000","last_unstale":"2024-05-14T14:40:21.006800+0000","last_undegraded":"2024-05-14T14:40:21.006800+0000","last_fullsized":"2024-05-14T14:40:21.006800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:43:15.190648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352691+0000","last_change":"2024-05-14T14:40:15.958806+0000","last_active":"2024-05-14T14:40:21.352691+0000","last_peered":"2024-05-14T14:40:21.352691+0000","last_clean":"2024-05-14T14:40:21.352691+0000","last_became_active":"2024-05-14T14:40:15.958397+0000","last_became_peered":"2024-05-14T14:40:15.958397+0000","last_unstale":"2024-05-14T14:40:21.352691+0000","last_undegraded":"2024-05-14T14:40:21.352691+0000","last_fullsized":"2024-05-14T14:40:21.352691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:23:34.578655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352925+0000","last_change":"2024-05-14T14:40:15.968981+0000","last_active":"2024-05-14T14:40:21.352925+0000","last_peered":"2024-05-14T14:40:21.352925+0000","last_clean":"2024-05-14T14:40:21.352925+0000","last_became_active":"2024-05-14T14:40:15.968588+0000","last_became_peered":"2024-05-14T14:40:15.968588+0000","last_unstale":"2024-05-14T14:40:21.352925+0000","last_undegraded":"2024-05-14T14:40:21.352925+0000","last_fullsized":"2024-05-14T14:40:21.352925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:24:18.488847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-05-14T14:40:21.352818+0000","last_change":"2024-05-14T14:40:15.967640+0000","last_active":"2024-05-14T14:40:21.352818+0000","last_peered":"2024-05-14T14:40:21.352818+0000","last_clean":"2024-05-14T14:40:21.352818+0000","last_became_active":"2024-05-14T14:40:15.967316+0000","last_became_peered":"2024-05-14T14:40:15.967316+0000","last_unstale":"2024-05-14T14:40:21.352818+0000","last_undegraded":"2024-05-14T14:40:21.352818+0000","last_fullsized":"2024-05-14T14:40:21.352818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:14.921794+0000","last_clean_scrub_stamp":"2024-05-14T14:40:14.921794+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:09:29.986117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T14:40:35.297 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-14T14:40:35.297 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-14T14:40:35.297 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-14T14:40:35.298 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-14T14:40:35.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.462+0000 7f0bc6613640 1 Processor -- start 2024-05-14T14:40:35.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.462+0000 7f0bc6613640 1 -- start start 2024-05-14T14:40:35.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.464+0000 7f0bc6613640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0bc00d09e0 0x7f0bc00d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:35.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.464+0000 7f0bc6613640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bc00d1330 con 0x7f0bc00b9190 2024-05-14T14:40:35.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.464+0000 7f0bc6613640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bc006df90 con 0x7f0bc00d3e40 2024-05-14T14:40:35.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.464+0000 7f0bc6613640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f0bc006db00 con 0x7f0bc00d09e0 2024-05-14T14:40:35.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.464+0000 7f0bb7fff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0bc00d09e0 0x7f0bc00d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:35.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.464+0000 7f0bc4bb0640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f0bc00b9190 0x7f0bc00b95a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:56410/0 (socket says 172.21.15.39:56410) 2024-05-14T14:40:35.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.464+0000 7f0bc4bb0640 1 -- 172.21.15.39:0/429751643 learned_addr learned my addr 172.21.15.39:0/429751643 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:35.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.464+0000 7f0bb7fff640 1 -- 172.21.15.39:0/429751643 >> v1:172.21.15.62:6789/0 conn(0x7f0bc00d3e40 legacy=0x7f0bc006c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:35.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.464+0000 7f0bb7fff640 1 -- 172.21.15.39:0/429751643 >> v1:172.21.15.39:6789/0 conn(0x7f0bc00b9190 legacy=0x7f0bc00b95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:35.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.464+0000 7f0bbf7fe640 1 -- 172.21.15.39:0/429751643 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3617121884 0 0) 0x7f0bb8001490 con 0x7f0bc00b9190 2024-05-14T14:40:35.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.464+0000 7f0bb7fff640 1 -- 172.21.15.39:0/429751643 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bc006cef0 con 0x7f0bc00d09e0 2024-05-14T14:40:35.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.465+0000 7f0bb7fff640 1 --2- 172.21.15.39:0/429751643 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0bc00d09e0 0x7f0bc00d0df0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0ba80097a0 tx=0x7f0ba802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82fe3d45f6de2fa server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:35.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.465+0000 7f0bbf7fe640 1 -- 172.21.15.39:0/429751643 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba8037070 con 0x7f0bc00d09e0 2024-05-14T14:40:35.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.465+0000 7f0bbf7fe640 1 -- 172.21.15.39:0/429751643 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ba8032440 con 0x7f0bc00d09e0 2024-05-14T14:40:35.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.465+0000 7f0bbf7fe640 1 -- 172.21.15.39:0/429751643 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba8032810 con 0x7f0bc00d09e0 2024-05-14T14:40:35.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.466+0000 7f0bc6613640 1 -- 172.21.15.39:0/429751643 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0bc00d09e0 msgr2=0x7f0bc00d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:35.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.466+0000 7f0bc6613640 1 --2- 172.21.15.39:0/429751643 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0bc00d09e0 0x7f0bc00d0df0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0ba80097a0 tx=0x7f0ba802a1a0 comp rx=0 tx=0).stop 2024-05-14T14:40:35.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.466+0000 7f0bc6613640 1 -- 172.21.15.39:0/429751643 shutdown_connections 2024-05-14T14:40:35.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.466+0000 7f0bc6613640 1 --2- 172.21.15.39:0/429751643 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0bc00d09e0 0x7f0bc00d0df0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:35.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.466+0000 7f0bc6613640 1 -- 172.21.15.39:0/429751643 >> 172.21.15.39:0/429751643 conn(0x7f0bc00d2eb0 msgr2=0x7f0bc00d5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:35.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.466+0000 7f0bc6613640 1 -- 172.21.15.39:0/429751643 shutdown_connections 2024-05-14T14:40:35.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.466+0000 7f0bc6613640 1 -- 172.21.15.39:0/429751643 wait complete. 2024-05-14T14:40:35.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.468+0000 7f0bc6613640 1 Processor -- start 2024-05-14T14:40:35.452 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.468+0000 7f0bc6613640 1 -- start start 2024-05-14T14:40:35.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.469+0000 7f0bc6613640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0bc00b9190 0x7f0bc00cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:35.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.469+0000 7f0bc6613640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0bc00d09e0 0x7f0bc01f94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:35.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.469+0000 7f0bc6613640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0bc00d3e40 0x7f0bc0161e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:35.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.469+0000 7f0bc6613640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc006d790 con 0x7f0bc00d09e0 2024-05-14T14:40:35.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.469+0000 7f0bc6613640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc006d4b0 con 0x7f0bc00b9190 2024-05-14T14:40:35.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.469+0000 7f0bc6613640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f0bc0160590 con 0x7f0bc00d3e40 2024-05-14T14:40:35.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.469+0000 7f0bb7fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0bc00d09e0 0x7f0bc01f94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:35.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.469+0000 7f0bb7fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0bc00d09e0 0x7f0bc01f94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48480/0 (socket says 172.21.15.39:48480) 2024-05-14T14:40:35.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.469+0000 7f0bb7fff640 1 -- 172.21.15.39:0/1873490502 learned_addr learned my addr 172.21.15.39:0/1873490502 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:35.455 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.469+0000 7f0bbffff640 1 --2- 172.21.15.39:0/1873490502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0bc00b9190 0x7f0bc00cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.469+0000 7f0bc4bb0640 1 --2- 172.21.15.39:0/1873490502 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0bc00d3e40 0x7f0bc0161e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.470+0000 7f0bb7fff640 1 -- 172.21.15.39:0/1873490502 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0bc00d3e40 msgr2=0x7f0bc0161e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.470+0000 7f0bb7fff640 1 --2- 172.21.15.39:0/1873490502 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0bc00d3e40 0x7f0bc0161e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.470+0000 7f0bb7fff640 1 -- 172.21.15.39:0/1873490502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0bc00b9190 msgr2=0x7f0bc00cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.470+0000 7f0bb7fff640 1 --2- 172.21.15.39:0/1873490502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0bc00b9190 0x7f0bc00cbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.470+0000 7f0bb7fff640 1 -- 172.21.15.39:0/1873490502 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bc00cc800 con 0x7f0bc00d09e0 2024-05-14T14:40:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.470+0000 7f0bb7fff640 1 --2- 172.21.15.39:0/1873490502 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0bc00d09e0 0x7f0bc01f94a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8000c00 tx=0x7f0ba80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.470+0000 7f0bbd7fa640 1 -- 172.21.15.39:0/1873490502 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba8041070 con 0x7f0bc00d09e0 2024-05-14T14:40:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.470+0000 7f0bbd7fa640 1 -- 172.21.15.39:0/1873490502 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ba803c930 con 0x7f0bc00d09e0 2024-05-14T14:40:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.470+0000 7f0bc6613640 1 -- 172.21.15.39:0/1873490502 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bc0161070 con 0x7f0bc00d09e0 2024-05-14T14:40:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.470+0000 7f0bbd7fa640 1 -- 172.21.15.39:0/1873490502 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba8037040 con 0x7f0bc00d09e0 2024-05-14T14:40:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.470+0000 7f0bc6613640 1 -- 172.21.15.39:0/1873490502 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bc0161630 con 0x7f0bc00d09e0 2024-05-14T14:40:35.456 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.471+0000 7f0bc6613640 1 -- 172.21.15.39:0/1873490502 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bc0076aa0 con 0x7f0bc00d09e0 2024-05-14T14:40:35.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.472+0000 7f0bbd7fa640 1 -- 172.21.15.39:0/1873490502 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0ba8044070 con 0x7f0bc00d09e0 2024-05-14T14:40:35.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.472+0000 7f0bbd7fa640 1 --2- 172.21.15.39:0/1873490502 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0ba00762d0 0x7f0ba00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:35.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.472+0000 7f0bbd7fa640 1 -- 172.21.15.39:0/1873490502 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0ba80b8480 con 0x7f0bc00d09e0 2024-05-14T14:40:35.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.472+0000 7f0bbffff640 1 --2- 172.21.15.39:0/1873490502 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0ba00762d0 0x7f0ba00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:35.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.473+0000 7f0bbffff640 1 --2- 172.21.15.39:0/1873490502 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0ba00762d0 0x7f0ba00787e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0000f60 tx=0x7f0bb0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:35.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.477+0000 7f0bbd7fa640 1 -- 172.21.15.39:0/1873490502 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0ba8081450 con 0x7f0bc00d09e0 2024-05-14T14:40:35.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.708+0000 7f0bc6613640 1 -- 172.21.15.39:0/1873490502 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0bc00c9270 con 0x7f0bc00d09e0 2024-05-14T14:40:35.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.709+0000 7f0bbd7fa640 1 -- 172.21.15.39:0/1873490502 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f0ba8085750 con 0x7f0bc00d09e0 2024-05-14T14:40:35.693 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:40:35.693 INFO:teuthology.orchestra.run.smithi039.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-14T14:40:35.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.711+0000 7f0bc6613640 1 -- 172.21.15.39:0/1873490502 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0ba00762d0 msgr2=0x7f0ba00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:35.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.711+0000 7f0bc6613640 1 --2- 172.21.15.39:0/1873490502 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0ba00762d0 0x7f0ba00787e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0000f60 tx=0x7f0bb0009040 comp rx=0 tx=0).stop 2024-05-14T14:40:35.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.711+0000 7f0bc6613640 1 -- 172.21.15.39:0/1873490502 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0bc00d09e0 msgr2=0x7f0bc01f94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:35.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.711+0000 7f0bc6613640 1 --2- 172.21.15.39:0/1873490502 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0bc00d09e0 0x7f0bc01f94a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8000c00 tx=0x7f0ba80046c0 comp rx=0 tx=0).stop 2024-05-14T14:40:35.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.711+0000 7f0bc6613640 1 -- 172.21.15.39:0/1873490502 shutdown_connections 2024-05-14T14:40:35.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.711+0000 7f0bc6613640 1 --2- 172.21.15.39:0/1873490502 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0ba00762d0 0x7f0ba00787e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:35.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.711+0000 7f0bc6613640 1 --2- 172.21.15.39:0/1873490502 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0bc00d3e40 0x7f0bc0161e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:35.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.711+0000 7f0bc6613640 1 --2- 172.21.15.39:0/1873490502 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0bc00d09e0 0x7f0bc01f94a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:35.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.711+0000 7f0bc6613640 1 --2- 172.21.15.39:0/1873490502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0bc00b9190 0x7f0bc00cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:35.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.711+0000 7f0bc6613640 1 -- 172.21.15.39:0/1873490502 >> 172.21.15.39:0/1873490502 conn(0x7f0bc00d2eb0 msgr2=0x7f0bc015f850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:35.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.711+0000 7f0bc6613640 1 -- 172.21.15.39:0/1873490502 shutdown_connections 2024-05-14T14:40:35.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.711+0000 7f0bc6613640 1 -- 172.21.15.39:0/1873490502 wait complete. 2024-05-14T14:40:35.706 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-14T14:40:35.707 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T14:40:35.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.837+0000 7f1092d38640 1 Processor -- start 2024-05-14T14:40:35.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.837+0000 7f1092d38640 1 -- start start 2024-05-14T14:40:35.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.839+0000 7f1092d38640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f108c0cf610 0x7f108c160590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:35.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.839+0000 7f1092d38640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f108c0cffb0 0x7f108c0b6930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:35.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.839+0000 7f1092d38640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f108c164c60 con 0x7f108c072fd0 2024-05-14T14:40:35.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.839+0000 7f1092d38640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f108c0d03c0 con 0x7f108c0cffb0 2024-05-14T14:40:35.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.839+0000 7f1092d38640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f108c164a10 con 0x7f108c0cf610 2024-05-14T14:40:35.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.839+0000 7f108bfff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f108c0cffb0 0x7f108c0b6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:35.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.839+0000 7f10912d5640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f108c072fd0 0x7f108c0733e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:56418/0 (socket says 172.21.15.39:56418) 2024-05-14T14:40:35.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.839+0000 7f10912d5640 1 -- 172.21.15.39:0/361185011 learned_addr learned my addr 172.21.15.39:0/361185011 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:35.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.839+0000 7f1090ad4640 1 --2- 172.21.15.39:0/361185011 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f108c0cf610 0x7f108c160590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:35.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.839+0000 7f108bfff640 1 -- 172.21.15.39:0/361185011 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f108c0cf610 msgr2=0x7f108c160590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:35.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.839+0000 7f108bfff640 1 --2- 172.21.15.39:0/361185011 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f108c0cf610 0x7f108c160590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:35.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.839+0000 7f108bfff640 1 -- 172.21.15.39:0/361185011 >> v1:172.21.15.39:6789/0 conn(0x7f108c072fd0 legacy=0x7f108c0733e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:35.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.839+0000 7f108bfff640 1 -- 172.21.15.39:0/361185011 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f108c0d3470 con 0x7f108c0cffb0 2024-05-14T14:40:35.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.839+0000 7f1090ad4640 1 --2- 172.21.15.39:0/361185011 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f108c0cf610 0x7f108c160590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:40:35.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.840+0000 7f108bfff640 1 --2- 172.21.15.39:0/361185011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f108c0cffb0 0x7f108c0b6930 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f10780097a0 tx=0x7f107802a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac5f7ea3316ac21e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:35.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.840+0000 7f108b7fe640 1 -- 172.21.15.39:0/361185011 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1078037070 con 0x7f108c0cffb0 2024-05-14T14:40:35.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.840+0000 7f108b7fe640 1 -- 172.21.15.39:0/361185011 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f107802adb0 con 0x7f108c0cffb0 2024-05-14T14:40:35.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.840+0000 7f108b7fe640 1 -- 172.21.15.39:0/361185011 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1078032660 con 0x7f108c0cffb0 2024-05-14T14:40:35.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.841+0000 7f1092d38640 1 -- 172.21.15.39:0/361185011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f108c0cffb0 msgr2=0x7f108c0b6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:35.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.841+0000 7f1092d38640 1 --2- 172.21.15.39:0/361185011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f108c0cffb0 0x7f108c0b6930 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f10780097a0 tx=0x7f107802a060 comp rx=0 tx=0).stop 2024-05-14T14:40:35.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.841+0000 7f1092d38640 1 -- 172.21.15.39:0/361185011 shutdown_connections 2024-05-14T14:40:35.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.841+0000 7f1092d38640 1 --2- 172.21.15.39:0/361185011 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f108c0cffb0 0x7f108c0b6930 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:35.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.841+0000 7f1092d38640 1 --2- 172.21.15.39:0/361185011 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f108c0cf610 0x7f108c160590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:35.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.841+0000 7f1092d38640 1 -- 172.21.15.39:0/361185011 >> 172.21.15.39:0/361185011 conn(0x7f108c0d3ae0 msgr2=0x7f108c0d3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:35.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.841+0000 7f1092d38640 1 -- 172.21.15.39:0/361185011 shutdown_connections 2024-05-14T14:40:35.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.841+0000 7f1092d38640 1 -- 172.21.15.39:0/361185011 wait complete. 2024-05-14T14:40:35.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.843+0000 7f1092d38640 1 Processor -- start 2024-05-14T14:40:35.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.843+0000 7f1092d38640 1 -- start start 2024-05-14T14:40:35.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.844+0000 7f1092d38640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f108c072fd0 0x7f108c15a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:35.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.844+0000 7f1092d38640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f108c0cf610 0x7f108c0caa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:35.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.844+0000 7f1092d38640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f108c0cffb0 0x7f108c1f6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:35.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.844+0000 7f1092d38640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f108c0ce130 con 0x7f108c0cf610 2024-05-14T14:40:35.837 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.844+0000 7f1092d38640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f108c164f40 con 0x7f108c072fd0 2024-05-14T14:40:35.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.844+0000 7f1092d38640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f108c0ce2b0 con 0x7f108c0cffb0 2024-05-14T14:40:35.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.844+0000 7f108bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f108c0cf610 0x7f108c0caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:35.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.844+0000 7f108bfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f108c0cf610 0x7f108c0caa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48500/0 (socket says 172.21.15.39:48500) 2024-05-14T14:40:35.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.844+0000 7f108bfff640 1 -- 172.21.15.39:0/2528622440 learned_addr learned my addr 172.21.15.39:0/2528622440 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:35.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.844+0000 7f10912d5640 1 --2- 172.21.15.39:0/2528622440 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f108c0cffb0 0x7f108c1f6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:35.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.844+0000 7f1090ad4640 1 --2- 172.21.15.39:0/2528622440 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f108c072fd0 0x7f108c15a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:35.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.845+0000 7f108bfff640 1 -- 172.21.15.39:0/2528622440 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f108c0cffb0 msgr2=0x7f108c1f6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:35.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.845+0000 7f108bfff640 1 --2- 172.21.15.39:0/2528622440 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f108c0cffb0 0x7f108c1f6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:35.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.845+0000 7f108bfff640 1 -- 172.21.15.39:0/2528622440 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f108c072fd0 msgr2=0x7f108c15a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:35.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.845+0000 7f108bfff640 1 --2- 172.21.15.39:0/2528622440 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f108c072fd0 0x7f108c15a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:35.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.845+0000 7f108bfff640 1 -- 172.21.15.39:0/2528622440 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f108c0cb680 con 0x7f108c0cf610 2024-05-14T14:40:35.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.845+0000 7f108bfff640 1 --2- 172.21.15.39:0/2528622440 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f108c0cf610 0x7f108c0caa40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1078035040 tx=0x7f10780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:35.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.845+0000 7f10897fa640 1 -- 172.21.15.39:0/2528622440 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1078041070 con 0x7f108c0cf610 2024-05-14T14:40:35.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.845+0000 7f10897fa640 1 -- 172.21.15.39:0/2528622440 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f107803c670 con 0x7f108c0cf610 2024-05-14T14:40:35.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.845+0000 7f10897fa640 1 -- 172.21.15.39:0/2528622440 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1078037040 con 0x7f108c0cf610 2024-05-14T14:40:35.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.845+0000 7f1092d38640 1 -- 172.21.15.39:0/2528622440 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f108c1595a0 con 0x7f108c0cf610 2024-05-14T14:40:35.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.845+0000 7f1092d38640 1 -- 172.21.15.39:0/2528622440 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f108c163720 con 0x7f108c0cf610 2024-05-14T14:40:35.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.846+0000 7f1092d38640 1 -- 172.21.15.39:0/2528622440 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f108c0b5380 con 0x7f108c0cf610 2024-05-14T14:40:35.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.847+0000 7f10897fa640 1 -- 172.21.15.39:0/2528622440 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f107803a070 con 0x7f108c0cf610 2024-05-14T14:40:35.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.847+0000 7f10897fa640 1 --2- 172.21.15.39:0/2528622440 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f10700762d0 0x7f10700787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:35.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.847+0000 7f10897fa640 1 -- 172.21.15.39:0/2528622440 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f10780b7c90 con 0x7f108c0cf610 2024-05-14T14:40:35.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.847+0000 7f1090ad4640 1 --2- 172.21.15.39:0/2528622440 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f10700762d0 0x7f10700787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:35.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.848+0000 7f1090ad4640 1 --2- 172.21.15.39:0/2528622440 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f10700762d0 0x7f10700787e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f108c0b66d0 tx=0x7f1080008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:35.842 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:35.852+0000 7f10897fa640 1 -- 172.21.15.39:0/2528622440 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f108c0b5380 con 0x7f108c0cf610 2024-05-14T14:40:36.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.082+0000 7f1092d38640 1 -- 172.21.15.39:0/2528622440 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f108c076aa0 con 0x7f108c0cf610 2024-05-14T14:40:36.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.082+0000 7f10897fa640 1 -- 172.21.15.39:0/2528622440 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5171 (secure 0 0 0) 0x7f10780892a0 con 0x7f108c0cf610 2024-05-14T14:40:36.067 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:40:36.067 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/3753262818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3753262818},{"type":"v1","addr":"172.21.15.62:6834","nonce":3753262818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/97693396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6835","nonce":97693396},{"type":"v1","addr":"172.21.15.39:6837","nonce":97693396}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6836/1648047942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":1648047942},{"type":"v1","addr":"172.21.15.39:6836","nonce":1648047942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T14:40:15.320927+0000","modified":"2024-05-14T14:40:28.417797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/1519798364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":1519798364},{"type":"v1","addr":"172.21.15.62:6835","nonce":1519798364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-05-14T14:40:36.067 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 9 2024-05-14T14:40:36.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.084+0000 7f1092d38640 1 -- 172.21.15.39:0/2528622440 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f10700762d0 msgr2=0x7f10700787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:36.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.084+0000 7f1092d38640 1 --2- 172.21.15.39:0/2528622440 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f10700762d0 0x7f10700787e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f108c0b66d0 tx=0x7f1080008040 comp rx=0 tx=0).stop 2024-05-14T14:40:36.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.084+0000 7f1092d38640 1 -- 172.21.15.39:0/2528622440 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f108c0cf610 msgr2=0x7f108c0caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:36.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.084+0000 7f1092d38640 1 --2- 172.21.15.39:0/2528622440 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f108c0cf610 0x7f108c0caa40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1078035040 tx=0x7f10780046c0 comp rx=0 tx=0).stop 2024-05-14T14:40:36.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.085+0000 7f1092d38640 1 -- 172.21.15.39:0/2528622440 shutdown_connections 2024-05-14T14:40:36.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.085+0000 7f1092d38640 1 --2- 172.21.15.39:0/2528622440 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f10700762d0 0x7f10700787e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:36.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.085+0000 7f1092d38640 1 --2- 172.21.15.39:0/2528622440 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f108c0cffb0 0x7f108c1f6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:36.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.085+0000 7f1092d38640 1 --2- 172.21.15.39:0/2528622440 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f108c0cf610 0x7f108c0caa40 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:36.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.085+0000 7f1092d38640 1 --2- 172.21.15.39:0/2528622440 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f108c072fd0 0x7f108c15a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:36.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.085+0000 7f1092d38640 1 -- 172.21.15.39:0/2528622440 >> 172.21.15.39:0/2528622440 conn(0x7f108c0d3ae0 msgr2=0x7f108c15abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:36.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.085+0000 7f1092d38640 1 -- 172.21.15.39:0/2528622440 shutdown_connections 2024-05-14T14:40:36.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.085+0000 7f1092d38640 1 -- 172.21.15.39:0/2528622440 wait complete. 2024-05-14T14:40:36.080 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T14:40:36.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.211+0000 7f39ce73f640 1 Processor -- start 2024-05-14T14:40:36.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.211+0000 7f39ce73f640 1 -- start start 2024-05-14T14:40:36.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.212+0000 7f39ce73f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f39c80b4ec0 0x7f39c81602d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:36.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.212+0000 7f39ce73f640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39c80d5840 con 0x7f39c80d0ad0 2024-05-14T14:40:36.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.212+0000 7f39ce73f640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39c80d4fa0 con 0x7f39c80d15f0 2024-05-14T14:40:36.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.212+0000 7f39ce73f640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f39c80d4d50 con 0x7f39c80b4ec0 2024-05-14T14:40:36.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.212+0000 7f39c77fe640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f39c80d0ad0 0x7f39c80d0ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:56424/0 (socket says 172.21.15.39:56424) 2024-05-14T14:40:36.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.212+0000 7f39c77fe640 1 -- 172.21.15.39:0/4030022380 learned_addr learned my addr 172.21.15.39:0/4030022380 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:36.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.213+0000 7f39c7fff640 1 --2- 172.21.15.39:0/4030022380 >> v2:172.21.15.62:3300/0 conn(0x7f39c80b4ec0 0x7f39c81602d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:36.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.213+0000 7f39c6ffd640 1 -- 172.21.15.39:0/4030022380 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1128743231 0 0) 0x7f39c80d5840 con 0x7f39c80d0ad0 2024-05-14T14:40:36.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.213+0000 7f39c6ffd640 1 -- 172.21.15.39:0/4030022380 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39b0003520 con 0x7f39c80d0ad0 2024-05-14T14:40:36.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.213+0000 7f39c6ffd640 1 -- 172.21.15.39:0/4030022380 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1447984692 0 0) 0x7f39b0003520 con 0x7f39c80d0ad0 2024-05-14T14:40:36.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.213+0000 7f39c6ffd640 1 -- 172.21.15.39:0/4030022380 >> v2:172.21.15.62:3300/0 conn(0x7f39c80b4ec0 msgr2=0x7f39c81602d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:36.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.213+0000 7f39c6ffd640 1 --2- 172.21.15.39:0/4030022380 >> v2:172.21.15.62:3300/0 conn(0x7f39c80b4ec0 0x7f39c81602d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:36.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.213+0000 7f39c6ffd640 1 -- 172.21.15.39:0/4030022380 >> v1:172.21.15.62:6789/0 conn(0x7f39c80d15f0 legacy=0x7f39c806ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:36.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.213+0000 7f39c6ffd640 1 -- 172.21.15.39:0/4030022380 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c80d5280 con 0x7f39c80d0ad0 2024-05-14T14:40:36.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.213+0000 7f39c6ffd640 1 -- 172.21.15.39:0/4030022380 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1803005051 0 0) 0x7f39bc0016f0 con 0x7f39c80d0ad0 2024-05-14T14:40:36.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.213+0000 7f39c6ffd640 1 -- 172.21.15.39:0/4030022380 >> v1:172.21.15.39:6789/0 conn(0x7f39c80d0ad0 legacy=0x7f39c80d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:36.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.213+0000 7f39c6ffd640 1 --2- 172.21.15.39:0/4030022380 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39b0003a50 0x7f39b0003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:36.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.213+0000 7f39c6ffd640 1 --2- 172.21.15.39:0/4030022380 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39b0004800 0x7f39b0004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:36.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.213+0000 7f39c6ffd640 1 --2- 172.21.15.39:0/4030022380 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39b0005250 0x7f39b000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:36.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.213+0000 7f39c6ffd640 1 -- 172.21.15.39:0/4030022380 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f39c80d4d50 con 0x7f39b0003a50 2024-05-14T14:40:36.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.213+0000 7f39c6ffd640 1 -- 172.21.15.39:0/4030022380 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f39b000c1e0 con 0x7f39b0005250 2024-05-14T14:40:36.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.213+0000 7f39c6ffd640 1 -- 172.21.15.39:0/4030022380 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f39b000c3e0 con 0x7f39b0004800 2024-05-14T14:40:36.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.213+0000 7f39c7fff640 1 --2- 172.21.15.39:0/4030022380 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39b0003a50 0x7f39b0003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:36.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.213+0000 7f39c77fe640 1 --2- 172.21.15.39:0/4030022380 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39b0004800 0x7f39b0004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:36.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.213+0000 7f39cccdc640 1 --2- 172.21.15.39:0/4030022380 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39b0005250 0x7f39b000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:36.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.213+0000 7f39c7fff640 1 -- 172.21.15.39:0/4030022380 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39b0004800 msgr2=0x7f39b0004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:36.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.213+0000 7f39c7fff640 1 --2- 172.21.15.39:0/4030022380 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39b0004800 0x7f39b0004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:36.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.213+0000 7f39c7fff640 1 -- 172.21.15.39:0/4030022380 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39b0005250 msgr2=0x7f39b000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:36.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.213+0000 7f39c7fff640 1 --2- 172.21.15.39:0/4030022380 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39b0005250 0x7f39b000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:36.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.213+0000 7f39c7fff640 1 -- 172.21.15.39:0/4030022380 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39b0003520 con 0x7f39b0003a50 2024-05-14T14:40:36.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.213+0000 7f39cccdc640 1 -- 172.21.15.39:0/4030022380 reap_dead start 2024-05-14T14:40:36.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.213+0000 7f39c77fe640 1 --2- 172.21.15.39:0/4030022380 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39b0004800 0x7f39b0004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:40:36.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.214+0000 7f39c7fff640 1 --2- 172.21.15.39:0/4030022380 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39b0003a50 0x7f39b0003ec0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f39b8009ac0 tx=0x7f39b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae55d261cf79b658 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:36.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.214+0000 7f39c6ffd640 1 -- 172.21.15.39:0/4030022380 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b8036070 con 0x7f39b0003a50 2024-05-14T14:40:36.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.214+0000 7f39c6ffd640 1 -- 172.21.15.39:0/4030022380 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39b8031400 con 0x7f39b0003a50 2024-05-14T14:40:36.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.214+0000 7f39c6ffd640 1 -- 172.21.15.39:0/4030022380 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b8009690 con 0x7f39b0003a50 2024-05-14T14:40:36.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.215+0000 7f39ce73f640 1 -- 172.21.15.39:0/4030022380 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39b0003a50 msgr2=0x7f39b0003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:36.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.215+0000 7f39ce73f640 1 --2- 172.21.15.39:0/4030022380 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39b0003a50 0x7f39b0003ec0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f39b8009ac0 tx=0x7f39b0005830 comp rx=0 tx=0).stop 2024-05-14T14:40:36.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.215+0000 7f39ce73f640 1 -- 172.21.15.39:0/4030022380 shutdown_connections 2024-05-14T14:40:36.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.215+0000 7f39ce73f640 1 --2- 172.21.15.39:0/4030022380 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39b0003a50 0x7f39b0003ec0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:36.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.215+0000 7f39ce73f640 1 -- 172.21.15.39:0/4030022380 >> 172.21.15.39:0/4030022380 conn(0x7f39c806f270 msgr2=0x7f39c80d5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:36.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.215+0000 7f39ce73f640 1 -- 172.21.15.39:0/4030022380 shutdown_connections 2024-05-14T14:40:36.204 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.215+0000 7f39ce73f640 1 -- 172.21.15.39:0/4030022380 wait complete. 2024-05-14T14:40:36.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.217+0000 7f39ce73f640 1 Processor -- start 2024-05-14T14:40:36.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.217+0000 7f39ce73f640 1 -- start start 2024-05-14T14:40:36.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.218+0000 7f39ce73f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39b0003a50 0x7f39c815ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:36.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.218+0000 7f39ce73f640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39c80c97a0 0x7f39c81626d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:36.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.218+0000 7f39ce73f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39c814ae70 0x7f39c8162c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:36.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.218+0000 7f39ce73f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f39c80b5480 con 0x7f39b0003a50 2024-05-14T14:40:36.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.218+0000 7f39ce73f640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f39c806c840 con 0x7f39c814ae70 2024-05-14T14:40:36.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.218+0000 7f39ce73f640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f39c81602d0 con 0x7f39c80c97a0 2024-05-14T14:40:36.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.219+0000 7f39c7fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39b0003a50 0x7f39c815ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:36.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.219+0000 7f39c7fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39b0003a50 0x7f39c815ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48518/0 (socket says 172.21.15.39:48518) 2024-05-14T14:40:36.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.219+0000 7f39c7fff640 1 -- 172.21.15.39:0/3872792372 learned_addr learned my addr 172.21.15.39:0/3872792372 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:36.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.219+0000 7f39cccdc640 1 --2- 172.21.15.39:0/3872792372 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39c814ae70 0x7f39c8162c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:36.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.219+0000 7f39c77fe640 1 --2- 172.21.15.39:0/3872792372 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39c80c97a0 0x7f39c81626d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:36.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.219+0000 7f39c7fff640 1 -- 172.21.15.39:0/3872792372 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39c80c97a0 msgr2=0x7f39c81626d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:36.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.219+0000 7f39c7fff640 1 --2- 172.21.15.39:0/3872792372 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39c80c97a0 0x7f39c81626d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:36.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.219+0000 7f39c7fff640 1 -- 172.21.15.39:0/3872792372 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39c814ae70 msgr2=0x7f39c8162c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:36.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.219+0000 7f39c7fff640 1 --2- 172.21.15.39:0/3872792372 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39c814ae70 0x7f39c8162c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:36.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.219+0000 7f39c7fff640 1 -- 172.21.15.39:0/3872792372 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c80ccb10 con 0x7f39b0003a50 2024-05-14T14:40:36.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.219+0000 7f39cccdc640 1 --2- 172.21.15.39:0/3872792372 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39c814ae70 0x7f39c8162c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:40:36.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.219+0000 7f39c77fe640 1 --2- 172.21.15.39:0/3872792372 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39c80c97a0 0x7f39c81626d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:40:36.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.219+0000 7f39c7fff640 1 --2- 172.21.15.39:0/3872792372 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39b0003a50 0x7f39c815ca60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f39b8034040 tx=0x7f39b8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:36.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.219+0000 7f39c4ff9640 1 -- 172.21.15.39:0/3872792372 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b803f020 con 0x7f39b0003a50 2024-05-14T14:40:36.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.219+0000 7f39c4ff9640 1 -- 172.21.15.39:0/3872792372 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39b8037040 con 0x7f39b0003a50 2024-05-14T14:40:36.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.219+0000 7f39ce73f640 1 -- 172.21.15.39:0/3872792372 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39c80cc590 con 0x7f39b0003a50 2024-05-14T14:40:36.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.219+0000 7f39c4ff9640 1 -- 172.21.15.39:0/3872792372 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39b8036070 con 0x7f39b0003a50 2024-05-14T14:40:36.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.219+0000 7f39ce73f640 1 -- 172.21.15.39:0/3872792372 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39c80cc830 con 0x7f39b0003a50 2024-05-14T14:40:36.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.220+0000 7f39ce73f640 1 -- 172.21.15.39:0/3872792372 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39c8076aa0 con 0x7f39b0003a50 2024-05-14T14:40:36.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.221+0000 7f39c4ff9640 1 -- 172.21.15.39:0/3872792372 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f39b8042020 con 0x7f39b0003a50 2024-05-14T14:40:36.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.222+0000 7f39c4ff9640 1 --2- 172.21.15.39:0/3872792372 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f39b40762d0 0x7f39b40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:36.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.222+0000 7f39c4ff9640 1 -- 172.21.15.39:0/3872792372 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f39b80b79a0 con 0x7f39b0003a50 2024-05-14T14:40:36.207 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.222+0000 7f39c77fe640 1 --2- 172.21.15.39:0/3872792372 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f39b40762d0 0x7f39b40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:36.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.222+0000 7f39c77fe640 1 --2- 172.21.15.39:0/3872792372 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f39b40762d0 0x7f39b40787e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f39bc000f60 tx=0x7f39bc000ed0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:36.210 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.227+0000 7f39c4ff9640 1 -- 172.21.15.39:0/3872792372 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f39b8049030 con 0x7f39b0003a50 2024-05-14T14:40:36.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.456+0000 7f39ce73f640 1 -- 172.21.15.39:0/3872792372 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f39c80d4120 con 0x7f39b0003a50 2024-05-14T14:40:36.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.457+0000 7f39c4ff9640 1 -- 172.21.15.39:0/3872792372 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5171 (secure 0 0 0) 0x7f39b8081110 con 0x7f39b0003a50 2024-05-14T14:40:36.441 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:40:36.441 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/3753262818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3753262818},{"type":"v1","addr":"172.21.15.62:6834","nonce":3753262818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/97693396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6835","nonce":97693396},{"type":"v1","addr":"172.21.15.39:6837","nonce":97693396}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6836/1648047942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":1648047942},{"type":"v1","addr":"172.21.15.39:6836","nonce":1648047942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T14:40:15.320927+0000","modified":"2024-05-14T14:40:28.417797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/1519798364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":1519798364},{"type":"v1","addr":"172.21.15.62:6835","nonce":1519798364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-05-14T14:40:36.441 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 9 2024-05-14T14:40:36.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.459+0000 7f39ce73f640 1 -- 172.21.15.39:0/3872792372 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f39b40762d0 msgr2=0x7f39b40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:36.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.459+0000 7f39ce73f640 1 --2- 172.21.15.39:0/3872792372 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f39b40762d0 0x7f39b40787e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f39bc000f60 tx=0x7f39bc000ed0 comp rx=0 tx=0).stop 2024-05-14T14:40:36.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.459+0000 7f39ce73f640 1 -- 172.21.15.39:0/3872792372 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39b0003a50 msgr2=0x7f39c815ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:36.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.459+0000 7f39ce73f640 1 --2- 172.21.15.39:0/3872792372 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39b0003a50 0x7f39c815ca60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f39b8034040 tx=0x7f39b8004730 comp rx=0 tx=0).stop 2024-05-14T14:40:36.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.459+0000 7f39ce73f640 1 -- 172.21.15.39:0/3872792372 shutdown_connections 2024-05-14T14:40:36.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.459+0000 7f39ce73f640 1 --2- 172.21.15.39:0/3872792372 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f39b40762d0 0x7f39b40787e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:36.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.459+0000 7f39ce73f640 1 --2- 172.21.15.39:0/3872792372 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39c814ae70 0x7f39c8162c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:36.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.459+0000 7f39ce73f640 1 --2- 172.21.15.39:0/3872792372 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f39c80c97a0 0x7f39c81626d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:36.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.459+0000 7f39ce73f640 1 --2- 172.21.15.39:0/3872792372 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f39b0003a50 0x7f39c815ca60 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:36.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.459+0000 7f39ce73f640 1 -- 172.21.15.39:0/3872792372 >> 172.21.15.39:0/3872792372 conn(0x7f39c806f270 msgr2=0x7f39c80b6f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:36.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.459+0000 7f39ce73f640 1 -- 172.21.15.39:0/3872792372 shutdown_connections 2024-05-14T14:40:36.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.459+0000 7f39ce73f640 1 -- 172.21.15.39:0/3872792372 wait complete. 2024-05-14T14:40:36.454 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T14:40:36.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.585+0000 7fb3c44bd640 1 Processor -- start 2024-05-14T14:40:36.569 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.585+0000 7fb3c44bd640 1 -- start start 2024-05-14T14:40:36.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.586+0000 7fb3c44bd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb3bc0d2fd0 0x7fb3bc0d1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:36.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.586+0000 7fb3c44bd640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fb3bc0d2250 0x7fb3bc0b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:36.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.586+0000 7fb3c44bd640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3bc0cf300 con 0x7fb3bc0ce4e0 2024-05-14T14:40:36.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.586+0000 7fb3c44bd640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fb3bc0ce050 con 0x7fb3bc0d2250 2024-05-14T14:40:36.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.586+0000 7fb3c44bd640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fb3bc0cd440 con 0x7fb3bc0d2fd0 2024-05-14T14:40:36.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.586+0000 7fb3c2259640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fb3bc0ce4e0 0x7fb3bc0cebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:56436/0 (socket says 172.21.15.39:56436) 2024-05-14T14:40:36.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.586+0000 7fb3c2259640 1 -- 172.21.15.39:0/15728072 learned_addr learned my addr 172.21.15.39:0/15728072 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:36.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.586+0000 7fb3c2a5a640 1 --2- 172.21.15.39:0/15728072 >> v2:172.21.15.39:3300/0 conn(0x7fb3bc0d2250 0x7fb3bc0b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:36.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.586+0000 7fb3c1a58640 1 --2- 172.21.15.39:0/15728072 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb3bc0d2fd0 0x7fb3bc0d1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:36.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.587+0000 7fb3c2a5a640 1 -- 172.21.15.39:0/15728072 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb3bc0d2fd0 msgr2=0x7fb3bc0d1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:36.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.587+0000 7fb3c2a5a640 1 --2- 172.21.15.39:0/15728072 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb3bc0d2fd0 0x7fb3bc0d1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:36.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.587+0000 7fb3c2a5a640 1 -- 172.21.15.39:0/15728072 >> v1:172.21.15.39:6789/0 conn(0x7fb3bc0ce4e0 legacy=0x7fb3bc0cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:36.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.587+0000 7fb3c1257640 1 -- 172.21.15.39:0/15728072 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 628050541 0 0) 0x7fb3bc0cf300 con 0x7fb3bc0ce4e0 2024-05-14T14:40:36.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.587+0000 7fb3c2a5a640 1 -- 172.21.15.39:0/15728072 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3bc0cd720 con 0x7fb3bc0d2250 2024-05-14T14:40:36.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.587+0000 7fb3c2a5a640 1 --2- 172.21.15.39:0/15728072 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3bc0d2250 0x7fb3bc0b3b50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb3b40097a0 tx=0x7fb3b402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=698ef0faa8a38c6e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:36.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.588+0000 7fb3c1257640 1 -- 172.21.15.39:0/15728072 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b4037070 con 0x7fb3bc0d2250 2024-05-14T14:40:36.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.588+0000 7fb3c1257640 1 -- 172.21.15.39:0/15728072 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3b4032440 con 0x7fb3bc0d2250 2024-05-14T14:40:36.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.588+0000 7fb3c1257640 1 -- 172.21.15.39:0/15728072 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b4032810 con 0x7fb3bc0d2250 2024-05-14T14:40:36.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.588+0000 7fb3c44bd640 1 -- 172.21.15.39:0/15728072 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3bc0d2250 msgr2=0x7fb3bc0b3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:36.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.588+0000 7fb3c44bd640 1 --2- 172.21.15.39:0/15728072 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3bc0d2250 0x7fb3bc0b3b50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb3b40097a0 tx=0x7fb3b402a180 comp rx=0 tx=0).stop 2024-05-14T14:40:36.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.588+0000 7fb3c44bd640 1 -- 172.21.15.39:0/15728072 shutdown_connections 2024-05-14T14:40:36.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.588+0000 7fb3c44bd640 1 --2- 172.21.15.39:0/15728072 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3bc0d2250 0x7fb3bc0b3b50 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:36.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.588+0000 7fb3c44bd640 1 --2- 172.21.15.39:0/15728072 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb3bc0d2fd0 0x7fb3bc0d1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:36.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.588+0000 7fb3c44bd640 1 -- 172.21.15.39:0/15728072 >> 172.21.15.39:0/15728072 conn(0x7fb3bc09b5f0 msgr2=0x7fb3bc09ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:36.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.588+0000 7fb3c44bd640 1 -- 172.21.15.39:0/15728072 shutdown_connections 2024-05-14T14:40:36.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.588+0000 7fb3c44bd640 1 -- 172.21.15.39:0/15728072 wait complete. 2024-05-14T14:40:36.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.590+0000 7fb3c44bd640 1 Processor -- start 2024-05-14T14:40:36.574 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.590+0000 7fb3c44bd640 1 -- start start 2024-05-14T14:40:36.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.591+0000 7fb3c44bd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3bc0ce4e0 0x7fb3bc152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:36.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.592+0000 7fb3c44bd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb3bc0d2250 0x7fb3bc0cc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:36.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.592+0000 7fb3c44bd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3bc0d2fd0 0x7fb3bc1f9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:36.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.592+0000 7fb3c44bd640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb3bc0d2660 con 0x7fb3bc0d2fd0 2024-05-14T14:40:36.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.592+0000 7fb3c44bd640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb3bc0cdce0 con 0x7fb3bc0ce4e0 2024-05-14T14:40:36.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.592+0000 7fb3c44bd640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fb3bc0cd060 con 0x7fb3bc0d2250 2024-05-14T14:40:36.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.592+0000 7fb3c2a5a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3bc0d2fd0 0x7fb3bc1f9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:36.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.592+0000 7fb3c2a5a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3bc0d2fd0 0x7fb3bc1f9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48534/0 (socket says 172.21.15.39:48534) 2024-05-14T14:40:36.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.592+0000 7fb3c2a5a640 1 -- 172.21.15.39:0/2958018602 learned_addr learned my addr 172.21.15.39:0/2958018602 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:36.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.592+0000 7fb3c1a58640 1 --2- 172.21.15.39:0/2958018602 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb3bc0d2250 0x7fb3bc0cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:36.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.592+0000 7fb3c2259640 1 --2- 172.21.15.39:0/2958018602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3bc0ce4e0 0x7fb3bc152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:36.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.592+0000 7fb3c2a5a640 1 -- 172.21.15.39:0/2958018602 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb3bc0d2250 msgr2=0x7fb3bc0cc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:36.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.592+0000 7fb3c2a5a640 1 --2- 172.21.15.39:0/2958018602 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb3bc0d2250 0x7fb3bc0cc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:36.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.592+0000 7fb3c2a5a640 1 -- 172.21.15.39:0/2958018602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3bc0ce4e0 msgr2=0x7fb3bc152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:36.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.592+0000 7fb3c2a5a640 1 --2- 172.21.15.39:0/2958018602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3bc0ce4e0 0x7fb3bc152cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:36.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.592+0000 7fb3c2a5a640 1 -- 172.21.15.39:0/2958018602 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3bc0b0d90 con 0x7fb3bc0d2fd0 2024-05-14T14:40:36.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.592+0000 7fb3c1a58640 1 --2- 172.21.15.39:0/2958018602 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb3bc0d2250 0x7fb3bc0cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:40:36.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.592+0000 7fb3c2259640 1 --2- 172.21.15.39:0/2958018602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3bc0ce4e0 0x7fb3bc152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:40:36.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.592+0000 7fb3c2a5a640 1 --2- 172.21.15.39:0/2958018602 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3bc0d2fd0 0x7fb3bc1f9f90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb3b40098c0 tx=0x7fb3b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:36.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.592+0000 7fb3baffd640 1 -- 172.21.15.39:0/2958018602 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b4037040 con 0x7fb3bc0d2fd0 2024-05-14T14:40:36.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.592+0000 7fb3baffd640 1 -- 172.21.15.39:0/2958018602 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3b4042070 con 0x7fb3bc0d2fd0 2024-05-14T14:40:36.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.592+0000 7fb3baffd640 1 -- 172.21.15.39:0/2958018602 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b4030860 con 0x7fb3bc0d2fd0 2024-05-14T14:40:36.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.592+0000 7fb3c44bd640 1 -- 172.21.15.39:0/2958018602 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3bc0c9bc0 con 0x7fb3bc0d2fd0 2024-05-14T14:40:36.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.593+0000 7fb3c44bd640 1 -- 172.21.15.39:0/2958018602 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3bc0ca180 con 0x7fb3bc0d2fd0 2024-05-14T14:40:36.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.593+0000 7fb3c44bd640 1 -- 172.21.15.39:0/2958018602 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3bc0b0f60 con 0x7fb3bc0d2fd0 2024-05-14T14:40:36.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.594+0000 7fb3baffd640 1 -- 172.21.15.39:0/2958018602 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb3b4030a00 con 0x7fb3bc0d2fd0 2024-05-14T14:40:36.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.595+0000 7fb3baffd640 1 --2- 172.21.15.39:0/2958018602 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fb3a80762d0 0x7fb3a80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:36.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.595+0000 7fb3baffd640 1 -- 172.21.15.39:0/2958018602 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb3b40b8240 con 0x7fb3bc0d2fd0 2024-05-14T14:40:36.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.595+0000 7fb3c2259640 1 --2- 172.21.15.39:0/2958018602 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fb3a80762d0 0x7fb3a80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:36.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.595+0000 7fb3c2259640 1 --2- 172.21.15.39:0/2958018602 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fb3a80762d0 0x7fb3a80787e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac0012e0 tx=0x7fb3ac005b90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:36.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.599+0000 7fb3baffd640 1 -- 172.21.15.39:0/2958018602 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb3b4081860 con 0x7fb3bc0d2fd0 2024-05-14T14:40:36.775 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.791+0000 7fb3c44bd640 1 -- 172.21.15.39:0/2958018602 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb3bc15f570 con 0x7fb3bc0d2fd0 2024-05-14T14:40:36.777 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.793+0000 7fb3baffd640 1 -- 172.21.15.39:0/2958018602 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18454 (secure 0 0 0) 0x7fb3b4081160 con 0x7fb3bc0d2fd0 2024-05-14T14:40:36.777 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:40:36.777 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"fsid":"d7983fec-79c7-4991-b19c-1aecead64611","created":"2024-05-14T14:39:52.157167+0000","modified":"2024-05-14T14:40:20.397684+0000","last_up_change":"2024-05-14T14:40:03.848608+0000","last_in_change":"2024-05-14T14:39:54.591920+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T14:40:04.692846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T14:40:13.794415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T14:40:14.273154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T14:40:17.979457+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c4ec4534-6301-4dd7-b4d6-d560b096d442","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6801","nonce":4023478848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6803","nonce":4023478848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6807","nonce":4023478848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6805","nonce":4023478848}]},"public_addr":"172.21.15.39:6801/4023478848","cluster_addr":"172.21.15.39:6803/4023478848","heartbeat_back_addr":"172.21.15.39:6807/4023478848","heartbeat_front_addr":"172.21.15.39:6805/4023478848","state":["exists","up"]},{"osd":1,"uuid":"93f91b0e-096e-4bdf-aed0-d1136f73f136","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6817","nonce":926357398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6819","nonce":926357398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6823","nonce":926357398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6821","nonce":926357398}]},"public_addr":"172.21.15.39:6817/926357398","cluster_addr":"172.21.15.39:6819/926357398","heartbeat_back_addr":"172.21.15.39:6823/926357398","heartbeat_front_addr":"172.21.15.39:6821/926357398","state":["exists","up"]},{"osd":2,"uuid":"c590b1e0-67eb-452e-8e80-d2208da17d09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6809","nonce":610616754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6811","nonce":610616754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6815","nonce":610616754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6813","nonce":610616754}]},"public_addr":"172.21.15.39:6809/610616754","cluster_addr":"172.21.15.39:6811/610616754","heartbeat_back_addr":"172.21.15.39:6815/610616754","heartbeat_front_addr":"172.21.15.39:6813/610616754","state":["exists","up"]},{"osd":3,"uuid":"d57661b0-44f6-4355-9115-83eceb9b8f71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6825","nonce":1469314579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6827","nonce":1469314579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6831","nonce":1469314579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6829","nonce":1469314579}]},"public_addr":"172.21.15.39:6825/1469314579","cluster_addr":"172.21.15.39:6827/1469314579","heartbeat_back_addr":"172.21.15.39:6831/1469314579","heartbeat_front_addr":"172.21.15.39:6829/1469314579","state":["exists","up"]},{"osd":4,"uuid":"b131436f-f6e1-4d72-a86e-de200afdcebb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6825","nonce":3481507129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6827","nonce":3481507129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6831","nonce":3481507129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6829","nonce":3481507129}]},"public_addr":"172.21.15.62:6825/3481507129","cluster_addr":"172.21.15.62:6827/3481507129","heartbeat_back_addr":"172.21.15.62:6831/3481507129","heartbeat_front_addr":"172.21.15.62:6829/3481507129","state":["exists","up"]},{"osd":5,"uuid":"12e10b40-28b1-410f-9ce0-7b427daa111e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6801","nonce":3291934116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6803","nonce":3291934116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6807","nonce":3291934116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6805","nonce":3291934116}]},"public_addr":"172.21.15.62:6801/3291934116","cluster_addr":"172.21.15.62:6803/3291934116","heartbeat_back_addr":"172.21.15.62:6807/3291934116","heartbeat_front_addr":"172.21.15.62:6805/3291934116","state":["exists","up"]},{"osd":6,"uuid":"ad8950a5-70bd-488c-8f29-010515cc4a04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6817","nonce":3005996101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6819","nonce":3005996101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6823","nonce":3005996101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6821","nonce":3005996101}]},"public_addr":"172.21.15.62:6817/3005996101","cluster_addr":"172.21.15.62:6819/3005996101","heartbeat_back_addr":"172.21.15.62:6823/3005996101","heartbeat_front_addr":"172.21.15.62:6821/3005996101","state":["exists","up"]},{"osd":7,"uuid":"e0d4b8b7-3c80-4760-a342-1d508cdecc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6809","nonce":2800379225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6811","nonce":2800379225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6815","nonce":2800379225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6813","nonce":2800379225}]},"public_addr":"172.21.15.62:6809/2800379225","cluster_addr":"172.21.15.62:6811/2800379225","heartbeat_back_addr":"172.21.15.62:6815/2800379225","heartbeat_front_addr":"172.21.15.62:6813/2800379225","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.773714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.760037+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.811225+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.752810+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.745165+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.700634+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.768477+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.747301+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T14:40:36.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.795+0000 7fb3c44bd640 1 -- 172.21.15.39:0/2958018602 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fb3a80762d0 msgr2=0x7fb3a80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:36.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.795+0000 7fb3c44bd640 1 --2- 172.21.15.39:0/2958018602 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fb3a80762d0 0x7fb3a80787e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac0012e0 tx=0x7fb3ac005b90 comp rx=0 tx=0).stop 2024-05-14T14:40:36.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.795+0000 7fb3c44bd640 1 -- 172.21.15.39:0/2958018602 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3bc0d2fd0 msgr2=0x7fb3bc1f9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:36.779 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.795+0000 7fb3c44bd640 1 --2- 172.21.15.39:0/2958018602 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3bc0d2fd0 0x7fb3bc1f9f90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb3b40098c0 tx=0x7fb3b40046c0 comp rx=0 tx=0).stop 2024-05-14T14:40:36.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.795+0000 7fb3c44bd640 1 -- 172.21.15.39:0/2958018602 shutdown_connections 2024-05-14T14:40:36.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.795+0000 7fb3c44bd640 1 --2- 172.21.15.39:0/2958018602 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fb3a80762d0 0x7fb3a80787e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:36.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.795+0000 7fb3c44bd640 1 --2- 172.21.15.39:0/2958018602 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb3bc0d2fd0 0x7fb3bc1f9f90 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:36.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.795+0000 7fb3c44bd640 1 --2- 172.21.15.39:0/2958018602 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb3bc0d2250 0x7fb3bc0cc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:36.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.795+0000 7fb3c44bd640 1 --2- 172.21.15.39:0/2958018602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3bc0ce4e0 0x7fb3bc152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:36.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.795+0000 7fb3c44bd640 1 -- 172.21.15.39:0/2958018602 >> 172.21.15.39:0/2958018602 conn(0x7fb3bc09b5f0 msgr2=0x7fb3bc0ce8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:36.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.795+0000 7fb3c44bd640 1 -- 172.21.15.39:0/2958018602 shutdown_connections 2024-05-14T14:40:36.780 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.795+0000 7fb3c44bd640 1 -- 172.21.15.39:0/2958018602 wait complete. 2024-05-14T14:40:36.790 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T14:40:36.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.923+0000 7f8929884640 1 Processor -- start 2024-05-14T14:40:36.907 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.923+0000 7f8929884640 1 -- start start 2024-05-14T14:40:36.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.924+0000 7f8929884640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f89241603e0 0x7f89240d52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:36.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.924+0000 7f8929884640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89240d0ac0 0x7f89240d0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:36.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.924+0000 7f8929884640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89240d1410 con 0x7f892406df00 2024-05-14T14:40:36.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.924+0000 7f8929884640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f89240ba250 con 0x7f89241603e0 2024-05-14T14:40:36.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.924+0000 7f8929884640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f892406da70 con 0x7f89240d0ac0 2024-05-14T14:40:36.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.924+0000 7f891a7fc640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f89241603e0 0x7f89240d52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:36.911 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.924+0000 7f891a7fc640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f89241603e0 0x7f89240d52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48546/0 (socket says 172.21.15.39:48546) 2024-05-14T14:40:36.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.924+0000 7f891a7fc640 1 -- 172.21.15.39:0/620807273 learned_addr learned my addr 172.21.15.39:0/620807273 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:36.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.925+0000 7f89237fe640 1 --2- 172.21.15.39:0/620807273 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89240d0ac0 0x7f89240d0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:36.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.925+0000 7f891a7fc640 1 -- 172.21.15.39:0/620807273 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89240d0ac0 msgr2=0x7f89240d0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:36.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.925+0000 7f891a7fc640 1 --2- 172.21.15.39:0/620807273 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89240d0ac0 0x7f89240d0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:36.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.925+0000 7f891a7fc640 1 -- 172.21.15.39:0/620807273 >> v1:172.21.15.62:6789/0 conn(0x7f892406df00 legacy=0x7f892406c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:36.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.925+0000 7f891a7fc640 1 -- 172.21.15.39:0/620807273 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f892406ce60 con 0x7f89241603e0 2024-05-14T14:40:36.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.925+0000 7f89237fe640 1 --2- 172.21.15.39:0/620807273 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89240d0ac0 0x7f89240d0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:40:36.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.925+0000 7f891a7fc640 1 --2- 172.21.15.39:0/620807273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89241603e0 0x7f89240d52c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f890c009870 tx=0x7f890c02a240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beb9b686aa18a8da server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:36.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.926+0000 7f89227fc640 1 -- 172.21.15.39:0/620807273 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890c037070 con 0x7f89241603e0 2024-05-14T14:40:36.912 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.926+0000 7f89227fc640 1 -- 172.21.15.39:0/620807273 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f890c032440 con 0x7f89241603e0 2024-05-14T14:40:36.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.926+0000 7f89227fc640 1 -- 172.21.15.39:0/620807273 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890c032810 con 0x7f89241603e0 2024-05-14T14:40:36.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.926+0000 7f8929884640 1 -- 172.21.15.39:0/620807273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89241603e0 msgr2=0x7f89240d52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:36.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.926+0000 7f8929884640 1 --2- 172.21.15.39:0/620807273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89241603e0 0x7f89240d52c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f890c009870 tx=0x7f890c02a240 comp rx=0 tx=0).stop 2024-05-14T14:40:36.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.926+0000 7f8929884640 1 -- 172.21.15.39:0/620807273 shutdown_connections 2024-05-14T14:40:36.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.926+0000 7f8929884640 1 --2- 172.21.15.39:0/620807273 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89240d0ac0 0x7f89240d0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:36.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.926+0000 7f8929884640 1 --2- 172.21.15.39:0/620807273 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89241603e0 0x7f89240d52c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:36.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.926+0000 7f8929884640 1 -- 172.21.15.39:0/620807273 >> 172.21.15.39:0/620807273 conn(0x7f89240d28e0 msgr2=0x7f89240d2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:36.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.926+0000 7f8929884640 1 -- 172.21.15.39:0/620807273 shutdown_connections 2024-05-14T14:40:36.913 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.926+0000 7f8929884640 1 -- 172.21.15.39:0/620807273 wait complete. 2024-05-14T14:40:36.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.928+0000 7f8929884640 1 Processor -- start 2024-05-14T14:40:36.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.928+0000 7f8929884640 1 -- start start 2024-05-14T14:40:36.917 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.930+0000 7f8929884640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f892406df00 0x7f89240cac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:36.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.930+0000 7f8929884640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89240d0ac0 0x7f8924162ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:36.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.930+0000 7f8929884640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89241603e0 0x7f89240c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:36.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.930+0000 7f8929884640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f892406d700 con 0x7f89241603e0 2024-05-14T14:40:36.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.930+0000 7f8929884640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f892406d420 con 0x7f892406df00 2024-05-14T14:40:36.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.930+0000 7f8929884640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f89240b9240 con 0x7f89240d0ac0 2024-05-14T14:40:36.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.930+0000 7f89237fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89241603e0 0x7f89240c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:36.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.930+0000 7f89237fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89241603e0 0x7f89240c97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48548/0 (socket says 172.21.15.39:48548) 2024-05-14T14:40:36.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.930+0000 7f89237fe640 1 -- 172.21.15.39:0/4204151165 learned_addr learned my addr 172.21.15.39:0/4204151165 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:36.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.930+0000 7f8922ffd640 1 --2- 172.21.15.39:0/4204151165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f892406df00 0x7f89240cac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:36.918 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.930+0000 7f891a7fc640 1 --2- 172.21.15.39:0/4204151165 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89240d0ac0 0x7f8924162ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:36.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.930+0000 7f89237fe640 1 -- 172.21.15.39:0/4204151165 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89240d0ac0 msgr2=0x7f8924162ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:36.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.930+0000 7f89237fe640 1 --2- 172.21.15.39:0/4204151165 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89240d0ac0 0x7f8924162ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:36.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.930+0000 7f89237fe640 1 -- 172.21.15.39:0/4204151165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f892406df00 msgr2=0x7f89240cac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:36.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.930+0000 7f89237fe640 1 --2- 172.21.15.39:0/4204151165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f892406df00 0x7f89240cac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:36.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.930+0000 7f89237fe640 1 -- 172.21.15.39:0/4204151165 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89240cbae0 con 0x7f89241603e0 2024-05-14T14:40:36.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.930+0000 7f891a7fc640 1 --2- 172.21.15.39:0/4204151165 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89240d0ac0 0x7f8924162ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:40:36.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.930+0000 7f8922ffd640 1 --2- 172.21.15.39:0/4204151165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f892406df00 0x7f89240cac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:40:36.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.930+0000 7f89237fe640 1 --2- 172.21.15.39:0/4204151165 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89241603e0 0x7f89240c97b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f891c007e90 tx=0x7f891c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:36.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.930+0000 7f8920ff9640 1 -- 172.21.15.39:0/4204151165 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891c01a070 con 0x7f89241603e0 2024-05-14T14:40:36.919 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.931+0000 7f8920ff9640 1 -- 172.21.15.39:0/4204151165 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f891c015400 con 0x7f89241603e0 2024-05-14T14:40:36.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.931+0000 7f8929884640 1 -- 172.21.15.39:0/4204151165 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89240cbdc0 con 0x7f89241603e0 2024-05-14T14:40:36.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.931+0000 7f8920ff9640 1 -- 172.21.15.39:0/4204151165 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891c0157f0 con 0x7f89241603e0 2024-05-14T14:40:36.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.931+0000 7f8929884640 1 -- 172.21.15.39:0/4204151165 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89240cc380 con 0x7f89241603e0 2024-05-14T14:40:36.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.931+0000 7f8929884640 1 -- 172.21.15.39:0/4204151165 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89240cb850 con 0x7f89241603e0 2024-05-14T14:40:36.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.932+0000 7f8920ff9640 1 -- 172.21.15.39:0/4204151165 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f891c01d070 con 0x7f89241603e0 2024-05-14T14:40:36.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.933+0000 7f8920ff9640 1 --2- 172.21.15.39:0/4204151165 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f8904076300 0x7f8904078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:36.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.933+0000 7f8920ff9640 1 -- 172.21.15.39:0/4204151165 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f891c097c00 con 0x7f89241603e0 2024-05-14T14:40:36.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.933+0000 7f8922ffd640 1 --2- 172.21.15.39:0/4204151165 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f8904076300 0x7f8904078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:36.920 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.933+0000 7f8922ffd640 1 --2- 172.21.15.39:0/4204151165 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f8904076300 0x7f8904078810 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f89240c9590 tx=0x7f8914009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:36.921 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:36.937+0000 7f8920ff9640 1 -- 172.21.15.39:0/4204151165 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f891c09e080 con 0x7f89241603e0 2024-05-14T14:40:37.156 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.172+0000 7f8929884640 1 -- 172.21.15.39:0/4204151165 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8924076aa0 con 0x7f89241603e0 2024-05-14T14:40:37.157 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.173+0000 7f8920ff9640 1 -- 172.21.15.39:0/4204151165 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5171 (secure 0 0 0) 0x7f891c010070 con 0x7f89241603e0 2024-05-14T14:40:37.157 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:40:37.157 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/3753262818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3753262818},{"type":"v1","addr":"172.21.15.62:6834","nonce":3753262818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/97693396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6835","nonce":97693396},{"type":"v1","addr":"172.21.15.39:6837","nonce":97693396}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6836/1648047942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":1648047942},{"type":"v1","addr":"172.21.15.39:6836","nonce":1648047942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T14:40:15.320927+0000","modified":"2024-05-14T14:40:28.417797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/1519798364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":1519798364},{"type":"v1","addr":"172.21.15.62:6835","nonce":1519798364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-05-14T14:40:37.158 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 9 2024-05-14T14:40:37.159 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.175+0000 7f8929884640 1 -- 172.21.15.39:0/4204151165 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f8904076300 msgr2=0x7f8904078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:37.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.175+0000 7f8929884640 1 --2- 172.21.15.39:0/4204151165 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f8904076300 0x7f8904078810 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f89240c9590 tx=0x7f8914009040 comp rx=0 tx=0).stop 2024-05-14T14:40:37.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.175+0000 7f8929884640 1 -- 172.21.15.39:0/4204151165 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89241603e0 msgr2=0x7f89240c97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:37.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.175+0000 7f8929884640 1 --2- 172.21.15.39:0/4204151165 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89241603e0 0x7f89240c97b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f891c007e90 tx=0x7f891c00d4a0 comp rx=0 tx=0).stop 2024-05-14T14:40:37.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.175+0000 7f8929884640 1 -- 172.21.15.39:0/4204151165 shutdown_connections 2024-05-14T14:40:37.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.175+0000 7f8929884640 1 --2- 172.21.15.39:0/4204151165 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f8904076300 0x7f8904078810 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:37.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.175+0000 7f8929884640 1 --2- 172.21.15.39:0/4204151165 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f89241603e0 0x7f89240c97b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:37.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.175+0000 7f8929884640 1 --2- 172.21.15.39:0/4204151165 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f89240d0ac0 0x7f8924162ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:37.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.175+0000 7f8929884640 1 --2- 172.21.15.39:0/4204151165 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f892406df00 0x7f89240cac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:37.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.175+0000 7f8929884640 1 -- 172.21.15.39:0/4204151165 >> 172.21.15.39:0/4204151165 conn(0x7f89240d28e0 msgr2=0x7f89240ba3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:37.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.175+0000 7f8929884640 1 -- 172.21.15.39:0/4204151165 shutdown_connections 2024-05-14T14:40:37.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.175+0000 7f8929884640 1 -- 172.21.15.39:0/4204151165 wait complete. 2024-05-14T14:40:37.574 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-14T14:40:15.320927+0000', 'modified': '2024-05-14T14:40:28.417797+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4278}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4278': {'gid': 4278, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6835/1519798364', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6833', 'nonce': 1519798364}, {'type': 'v1', 'addr': '172.21.15.62:6835', 'nonce': 1519798364}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4278, 'qdb_cluster': [4278]} 2024-05-14T14:40:37.574 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-14T14:40:37.574 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-14T14:40:37.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.708+0000 7f1e3def2640 1 Processor -- start 2024-05-14T14:40:37.692 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.708+0000 7f1e3def2640 1 -- start start 2024-05-14T14:40:37.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.709+0000 7f1e3def2640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1e380bb080 0x7f1e3816afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:37.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.710+0000 7f1e3def2640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e380b9310 con 0x7f1e380d1310 2024-05-14T14:40:37.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.710+0000 7f1e3def2640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e3806dd70 con 0x7f1e38160420 2024-05-14T14:40:37.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.710+0000 7f1e3def2640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f1e380b9590 con 0x7f1e380bb080 2024-05-14T14:40:37.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.710+0000 7f1e37fff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1e380bb080 0x7f1e3816afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:37.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.710+0000 7f1e36ffd640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f1e380d1310 0x7f1e3806d0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:56448/0 (socket says 172.21.15.39:56448) 2024-05-14T14:40:37.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.710+0000 7f1e36ffd640 1 -- 172.21.15.39:0/2768727535 learned_addr learned my addr 172.21.15.39:0/2768727535 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:37.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.710+0000 7f1e37fff640 1 -- 172.21.15.39:0/2768727535 >> v1:172.21.15.62:6789/0 conn(0x7f1e38160420 legacy=0x7f1e380d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:37.694 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.710+0000 7f1e37fff640 1 -- 172.21.15.39:0/2768727535 >> v1:172.21.15.39:6789/0 conn(0x7f1e380d1310 legacy=0x7f1e3806d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:37.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.710+0000 7f1e37fff640 1 -- 172.21.15.39:0/2768727535 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e380b9870 con 0x7f1e380bb080 2024-05-14T14:40:37.695 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.710+0000 7f1e367fc640 1 -- 172.21.15.39:0/2768727535 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3985007375 0 0) 0x7f1e2c001110 con 0x7f1e380d1310 2024-05-14T14:40:37.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.711+0000 7f1e37fff640 1 --2- 172.21.15.39:0/2768727535 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e380bb080 0x7f1e3816afd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1e30009d90 tx=0x7f1e3002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=855b556a491e42f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:37.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.711+0000 7f1e367fc640 1 -- 172.21.15.39:0/2768727535 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e30007740 con 0x7f1e380bb080 2024-05-14T14:40:37.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.711+0000 7f1e367fc640 1 -- 172.21.15.39:0/2768727535 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e300078e0 con 0x7f1e380bb080 2024-05-14T14:40:37.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.711+0000 7f1e367fc640 1 -- 172.21.15.39:0/2768727535 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e30007cb0 con 0x7f1e380bb080 2024-05-14T14:40:37.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.712+0000 7f1e3def2640 1 -- 172.21.15.39:0/2768727535 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e380bb080 msgr2=0x7f1e3816afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:37.696 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.712+0000 7f1e3def2640 1 --2- 172.21.15.39:0/2768727535 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e380bb080 0x7f1e3816afd0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1e30009d90 tx=0x7f1e3002a660 comp rx=0 tx=0).stop 2024-05-14T14:40:37.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.712+0000 7f1e3def2640 1 -- 172.21.15.39:0/2768727535 shutdown_connections 2024-05-14T14:40:37.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.712+0000 7f1e3def2640 1 --2- 172.21.15.39:0/2768727535 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e380bb080 0x7f1e3816afd0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:37.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.712+0000 7f1e3def2640 1 -- 172.21.15.39:0/2768727535 >> 172.21.15.39:0/2768727535 conn(0x7f1e380d27d0 msgr2=0x7f1e380d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:37.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.712+0000 7f1e3def2640 1 -- 172.21.15.39:0/2768727535 shutdown_connections 2024-05-14T14:40:37.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.712+0000 7f1e3def2640 1 -- 172.21.15.39:0/2768727535 wait complete. 2024-05-14T14:40:37.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.714+0000 7f1e3def2640 1 Processor -- start 2024-05-14T14:40:37.697 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.714+0000 7f1e3def2640 1 -- start start 2024-05-14T14:40:37.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.715+0000 7f1e3def2640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1e380bb080 0x7f1e3815b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:37.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.715+0000 7f1e3def2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e38160420 0x7f1e3814efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:37.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.715+0000 7f1e3def2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e38158060 0x7f1e38162f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:37.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.715+0000 7f1e3def2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1e3806d7c0 con 0x7f1e38158060 2024-05-14T14:40:37.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.715+0000 7f1e3def2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1e38160830 con 0x7f1e38160420 2024-05-14T14:40:37.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.715+0000 7f1e3def2640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f1e3806d940 con 0x7f1e380bb080 2024-05-14T14:40:37.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.715+0000 7f1e37fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e38158060 0x7f1e38162f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:37.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.715+0000 7f1e37fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e38158060 0x7f1e38162f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48562/0 (socket says 172.21.15.39:48562) 2024-05-14T14:40:37.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.715+0000 7f1e37fff640 1 -- 172.21.15.39:0/1856924569 learned_addr learned my addr 172.21.15.39:0/1856924569 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:37.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.715+0000 7f1e36ffd640 1 --2- 172.21.15.39:0/1856924569 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e38160420 0x7f1e3814efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:37.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.715+0000 7f1e377fe640 1 --2- 172.21.15.39:0/1856924569 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1e380bb080 0x7f1e3815b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:37.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.716+0000 7f1e37fff640 1 -- 172.21.15.39:0/1856924569 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1e380bb080 msgr2=0x7f1e3815b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:37.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.716+0000 7f1e37fff640 1 --2- 172.21.15.39:0/1856924569 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1e380bb080 0x7f1e3815b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:37.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.716+0000 7f1e37fff640 1 -- 172.21.15.39:0/1856924569 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e38160420 msgr2=0x7f1e3814efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:37.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.716+0000 7f1e37fff640 1 --2- 172.21.15.39:0/1856924569 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e38160420 0x7f1e3814efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:37.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.716+0000 7f1e37fff640 1 -- 172.21.15.39:0/1856924569 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e380ce3a0 con 0x7f1e38158060 2024-05-14T14:40:37.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.716+0000 7f1e37fff640 1 --2- 172.21.15.39:0/1856924569 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e38158060 0x7f1e38162f60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1e30009eb0 tx=0x7f1e30004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:37.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.716+0000 7f1e1ffff640 1 -- 172.21.15.39:0/1856924569 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3003f070 con 0x7f1e38158060 2024-05-14T14:40:37.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.716+0000 7f1e1ffff640 1 -- 172.21.15.39:0/1856924569 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e30031c40 con 0x7f1e38158060 2024-05-14T14:40:37.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.716+0000 7f1e3def2640 1 -- 172.21.15.39:0/1856924569 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e380ce680 con 0x7f1e38158060 2024-05-14T14:40:37.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.716+0000 7f1e1ffff640 1 -- 172.21.15.39:0/1856924569 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e30003990 con 0x7f1e38158060 2024-05-14T14:40:37.702 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.716+0000 7f1e3def2640 1 -- 172.21.15.39:0/1856924569 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e380cec40 con 0x7f1e38158060 2024-05-14T14:40:37.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.718+0000 7f1e1ffff640 1 -- 172.21.15.39:0/1856924569 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1e30003b30 con 0x7f1e38158060 2024-05-14T14:40:37.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.718+0000 7f1e1ffff640 1 --2- 172.21.15.39:0/1856924569 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1e240762d0 0x7f1e240787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:37.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.718+0000 7f1e1ffff640 1 -- 172.21.15.39:0/1856924569 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1e300b8b20 con 0x7f1e38158060 2024-05-14T14:40:37.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.718+0000 7f1e377fe640 1 --2- 172.21.15.39:0/1856924569 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1e240762d0 0x7f1e240787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:37.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.719+0000 7f1e377fe640 1 --2- 172.21.15.39:0/1856924569 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1e240762d0 0x7f1e240787e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1e28000f60 tx=0x7f1e28009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:37.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.719+0000 7f1e44da6740 1 Processor -- start 2024-05-14T14:40:37.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.719+0000 7f1e44da6740 1 -- start start 2024-05-14T14:40:37.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.721+0000 7f1e44da6740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55e5fdbba270 0x55e5fdf87120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:37.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.721+0000 7f1e44da6740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5fdb913b0 0x55e5fdf5c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:37.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.721+0000 7f1e44da6740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e5fdb99590 0x55e5fdfa30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:37.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.721+0000 7f1e44da6740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55e5fdec08d0 con 0x55e5fdb913b0 2024-05-14T14:40:37.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.721+0000 7f1e44da6740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e5fde79c10 con 0x55e5fdb99590 2024-05-14T14:40:37.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.721+0000 7f1e44da6740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x55e5fdebc890 con 0x55e5fdbba270 2024-05-14T14:40:37.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.721+0000 7f1e36ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5fdb913b0 0x55e5fdf5c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:37.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.721+0000 7f1e36ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5fdb913b0 0x55e5fdf5c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48576/0 (socket says 172.21.15.39:48576) 2024-05-14T14:40:37.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.721+0000 7f1e36ffd640 1 -- 172.21.15.39:0/2417123393 learned_addr learned my addr 172.21.15.39:0/2417123393 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:37.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.721+0000 7f1e37fff640 1 --2- 172.21.15.39:0/2417123393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e5fdb99590 0x55e5fdfa30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:37.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.721+0000 7f1e377fe640 1 --2- 172.21.15.39:0/2417123393 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55e5fdbba270 0x55e5fdf87120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:37.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.721+0000 7f1e36ffd640 1 -- 172.21.15.39:0/2417123393 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55e5fdbba270 msgr2=0x55e5fdf87120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:37.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.721+0000 7f1e36ffd640 1 --2- 172.21.15.39:0/2417123393 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55e5fdbba270 0x55e5fdf87120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:37.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.721+0000 7f1e36ffd640 1 -- 172.21.15.39:0/2417123393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e5fdb99590 msgr2=0x55e5fdfa30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:37.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.721+0000 7f1e36ffd640 1 --2- 172.21.15.39:0/2417123393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e5fdb99590 0x55e5fdfa30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:37.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.721+0000 7f1e36ffd640 1 -- 172.21.15.39:0/2417123393 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5fde815d0 con 0x55e5fdb913b0 2024-05-14T14:40:37.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.721+0000 7f1e37fff640 1 --2- 172.21.15.39:0/2417123393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e5fdb99590 0x55e5fdfa30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:40:37.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.721+0000 7f1e36ffd640 1 --2- 172.21.15.39:0/2417123393 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5fdb913b0 0x55e5fdf5c760 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c0076b0 tx=0x7f1e2c004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f901bab05d0c1a13 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:37.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.721+0000 7f1e1d7fa640 1 -- 172.21.15.39:0/2417123393 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c0017e0 con 0x55e5fdb913b0 2024-05-14T14:40:37.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.721+0000 7f1e1d7fa640 1 -- 172.21.15.39:0/2417123393 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e2c018070 con 0x55e5fdb913b0 2024-05-14T14:40:37.707 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.721+0000 7f1e1d7fa640 1 -- 172.21.15.39:0/2417123393 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c001bc0 con 0x55e5fdb913b0 2024-05-14T14:40:37.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.722+0000 7f1e44da6740 1 -- 172.21.15.39:0/2417123393 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5fdb913b0 msgr2=0x55e5fdf5c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:37.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.722+0000 7f1e44da6740 1 --2- 172.21.15.39:0/2417123393 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5fdb913b0 0x55e5fdf5c760 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c0076b0 tx=0x7f1e2c004bb0 comp rx=0 tx=0).stop 2024-05-14T14:40:37.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.722+0000 7f1e44da6740 1 -- 172.21.15.39:0/2417123393 shutdown_connections 2024-05-14T14:40:37.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.722+0000 7f1e44da6740 1 --2- 172.21.15.39:0/2417123393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e5fdb99590 0x55e5fdfa30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:37.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.722+0000 7f1e44da6740 1 --2- 172.21.15.39:0/2417123393 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5fdb913b0 0x55e5fdf5c760 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:37.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.722+0000 7f1e44da6740 1 --2- 172.21.15.39:0/2417123393 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55e5fdbba270 0x55e5fdf87120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:37.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.722+0000 7f1e44da6740 1 -- 172.21.15.39:0/2417123393 >> 172.21.15.39:0/2417123393 conn(0x55e5fdbae3c0 msgr2=0x55e5fdf5bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:37.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.722+0000 7f1e44da6740 1 -- 172.21.15.39:0/2417123393 shutdown_connections 2024-05-14T14:40:37.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.722+0000 7f1e44da6740 1 -- 172.21.15.39:0/2417123393 wait complete. 2024-05-14T14:40:37.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.723+0000 7f1e44da6740 1 -- start start 2024-05-14T14:40:37.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.723+0000 7f1e44da6740 1 Processor -- start 2024-05-14T14:40:37.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.725+0000 7f1e44da6740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e5fdb913b0 0x55e5fdf99f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:37.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.725+0000 7f1e44da6740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55e5fdb99590 0x55e5fdfb0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:37.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.725+0000 7f1e44da6740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5fdbba270 0x55e5fdfa5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:37.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.725+0000 7f1e44da6740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55e5fde7d760 con 0x55e5fdbba270 2024-05-14T14:40:37.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.725+0000 7f1e44da6740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e5fdf86c90 con 0x55e5fdb913b0 2024-05-14T14:40:37.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.725+0000 7f1e44da6740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x55e5fdfb1b20 con 0x55e5fdb99590 2024-05-14T14:40:37.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.725+0000 7f1e44da6740 10 client.0 _ll_register_callbacks cb 0x55e5fdeb6cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T14:40:37.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.725+0000 7f1e37fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5fdbba270 0x55e5fdfa5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:37.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.725+0000 7f1e37fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5fdbba270 0x55e5fdfa5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48586/0 (socket says 172.21.15.39:48586) 2024-05-14T14:40:37.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.725+0000 7f1e37fff640 1 -- 172.21.15.39:0/3381089346 learned_addr learned my addr 172.21.15.39:0/3381089346 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:37.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.725+0000 7f1e377fe640 1 --2- 172.21.15.39:0/3381089346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e5fdb913b0 0x55e5fdf99f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:37.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.725+0000 7f1e36ffd640 1 --2- 172.21.15.39:0/3381089346 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55e5fdb99590 0x55e5fdfb0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:37.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.725+0000 7f1e37fff640 1 -- 172.21.15.39:0/3381089346 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55e5fdb99590 msgr2=0x55e5fdfb0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:37.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.725+0000 7f1e37fff640 1 --2- 172.21.15.39:0/3381089346 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55e5fdb99590 0x55e5fdfb0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:37.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.725+0000 7f1e37fff640 1 -- 172.21.15.39:0/3381089346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e5fdb913b0 msgr2=0x55e5fdf99f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:37.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.725+0000 7f1e37fff640 1 --2- 172.21.15.39:0/3381089346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e5fdb913b0 0x55e5fdf99f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:37.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.725+0000 7f1e37fff640 1 -- 172.21.15.39:0/3381089346 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5fdbd22d0 con 0x55e5fdbba270 2024-05-14T14:40:37.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.725+0000 7f1e37fff640 1 --2- 172.21.15.39:0/3381089346 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5fdbba270 0x55e5fdfa5e50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1e3007db70 tx=0x7f1e30081260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9013e5e7d4a23f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:37.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.725+0000 7f1e167fc640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-05-14T14:40:37.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.726+0000 7f1e167fc640 1 -- 172.21.15.39:0/3381089346 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e30048030 con 0x55e5fdbba270 2024-05-14T14:40:37.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.726+0000 7f1e167fc640 1 -- 172.21.15.39:0/3381089346 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1e30081f60 con 0x55e5fdbba270 2024-05-14T14:40:37.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.726+0000 7f1e44da6740 1 -- 172.21.15.39:0/3381089346 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e2c018070 con 0x55e5fdbba270 2024-05-14T14:40:37.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.726+0000 7f1e167fc640 1 -- 172.21.15.39:0/3381089346 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f1e300b6050 con 0x55e5fdbba270 2024-05-14T14:40:37.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.726+0000 7f1e44da6740 10 client.4692 fetch_fsmap learned FSMap version 9 2024-05-14T14:40:37.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.726+0000 7f1e44da6740 1 -- 172.21.15.39:0/3381089346 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55e5fdc9c6b0 con 0x55e5fdbba270 2024-05-14T14:40:37.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.726+0000 7f1e167fc640 1 -- 172.21.15.39:0/3381089346 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e2c018070 con 0x55e5fdbba270 2024-05-14T14:40:37.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.726+0000 7f1e167fc640 1 -- 172.21.15.39:0/3381089346 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 9) ==== 3502+0+0 (secure 0 0 0) 0x7f1e3009f080 con 0x55e5fdbba270 2024-05-14T14:40:37.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.726+0000 7f1e44da6740 10 client.4692 fetch_fsmap finished waiting for FSMap version 9 2024-05-14T14:40:37.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.726+0000 7f1e44da6740 10 client.4692 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-14T14:40:37.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.726+0000 7f1e44da6740 20 client.4692 populate_metadata read hostname 'smithi039' 2024-05-14T14:40:37.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.726+0000 7f1e44da6740 1 --2- 172.21.15.39:0/3381089346 >> [v2:172.21.15.62:6833/1519798364,v1:172.21.15.62:6835/1519798364] conn(0x55e5fdb78e40 0x55e5fdf87dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:37.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.726+0000 7f1e44da6740 4 client.4692 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T14:40:37.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.726+0000 7f1e44da6740 1 -- 172.21.15.39:0/3381089346 --> [v2:172.21.15.62:6833/1519798364,v1:172.21.15.62:6835/1519798364] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e5fde44760 con 0x55e5fdb78e40 2024-05-14T14:40:37.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.726+0000 7f1e377fe640 1 --2- 172.21.15.39:0/3381089346 >> [v2:172.21.15.62:6833/1519798364,v1:172.21.15.62:6835/1519798364] conn(0x55e5fdb78e40 0x55e5fdf87dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:37.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.727+0000 7f1e167fc640 10 client.4692 ms_handle_connect on v2:172.21.15.62:6833/1519798364 2024-05-14T14:40:37.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.727+0000 7f1e377fe640 1 --2- 172.21.15.39:0/3381089346 >> [v2:172.21.15.62:6833/1519798364,v1:172.21.15.62:6835/1519798364] conn(0x55e5fdb78e40 0x55e5fdf87dd0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=229f864923d4d2ea server_cookie=cac15a278d09a662 in_seq=0 out_seq=0 2024-05-14T14:40:37.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.728+0000 7f1e167fc640 1 -- 172.21.15.39:0/3381089346 <== mds.0 v2:172.21.15.62:6833/1519798364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e5fde44760 con 0x55e5fdb78e40 2024-05-14T14:40:37.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.728+0000 7f1e167fc640 10 client.4692 handle_command_reply: tid=0 2024-05-14T14:40:37.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.728+0000 7f1e44da6740 1 client.4692 shutdown 2024-05-14T14:40:37.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.728+0000 7f1e44da6740 1 -- 172.21.15.39:0/3381089346 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5fdbba270 msgr2=0x55e5fdfa5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:37.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.728+0000 7f1e44da6740 1 --2- 172.21.15.39:0/3381089346 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5fdbba270 0x55e5fdfa5e50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1e3007db70 tx=0x7f1e30081260 comp rx=0 tx=0).stop 2024-05-14T14:40:37.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.728+0000 7f1e44da6740 1 -- 172.21.15.39:0/3381089346 shutdown_connections 2024-05-14T14:40:37.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.728+0000 7f1e44da6740 1 --2- 172.21.15.39:0/3381089346 >> [v2:172.21.15.62:6833/1519798364,v1:172.21.15.62:6835/1519798364] conn(0x55e5fdb78e40 0x55e5fdf87dd0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:37.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.728+0000 7f1e44da6740 1 --2- 172.21.15.39:0/3381089346 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5fdbba270 0x55e5fdfa5e50 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:37.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.728+0000 7f1e44da6740 1 --2- 172.21.15.39:0/3381089346 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55e5fdb99590 0x55e5fdfb0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:37.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.728+0000 7f1e167fc640 0 client.4692 ms_handle_reset on v2:172.21.15.62:6833/1519798364 2024-05-14T14:40:37.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.728+0000 7f1e44da6740 1 --2- 172.21.15.39:0/3381089346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e5fdb913b0 0x55e5fdf99f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:37.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.728+0000 7f1e44da6740 1 -- 172.21.15.39:0/3381089346 >> 172.21.15.39:0/3381089346 conn(0x55e5fdbae3c0 msgr2=0x55e5fdf5c760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:37.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.728+0000 7f1e44da6740 1 -- 172.21.15.39:0/3381089346 shutdown_connections 2024-05-14T14:40:37.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.728+0000 7f1e44da6740 1 -- 172.21.15.39:0/3381089346 wait complete. 2024-05-14T14:40:37.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.728+0000 7f1e44da6740 20 client.4692 trim_cache size 0 max 16384 2024-05-14T14:40:37.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.747+0000 7f1e44da6740 1 Processor -- start 2024-05-14T14:40:37.731 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.747+0000 7f1e44da6740 1 -- start start 2024-05-14T14:40:37.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.749+0000 7f1e44da6740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e5fdb78e40 0x55e5fdf87f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:37.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.749+0000 7f1e44da6740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5fdb913b0 0x55e5fdfc4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:37.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.749+0000 7f1e44da6740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55e5fdb99590 0x55e5fdfc4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:37.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.749+0000 7f1e44da6740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1e382034f0 con 0x55e5fdb913b0 2024-05-14T14:40:37.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.749+0000 7f1e44da6740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1e382028f0 con 0x55e5fdb78e40 2024-05-14T14:40:37.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.749+0000 7f1e44da6740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f1e38202ea0 con 0x55e5fdb99590 2024-05-14T14:40:37.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.749+0000 7f1e36ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5fdb913b0 0x55e5fdfc4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:37.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.749+0000 7f1e36ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5fdb913b0 0x55e5fdfc4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48600/0 (socket says 172.21.15.39:48600) 2024-05-14T14:40:37.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.749+0000 7f1e36ffd640 1 -- 172.21.15.39:0/2835632653 learned_addr learned my addr 172.21.15.39:0/2835632653 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:37.740 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.749+0000 7f1e377fe640 1 --2- 172.21.15.39:0/2835632653 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e5fdb78e40 0x55e5fdf87f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:37.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.749+0000 7f1e37fff640 1 --2- 172.21.15.39:0/2835632653 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55e5fdb99590 0x55e5fdfc4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:37.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.749+0000 7f1e36ffd640 1 -- 172.21.15.39:0/2835632653 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55e5fdb99590 msgr2=0x55e5fdfc4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:37.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.749+0000 7f1e36ffd640 1 --2- 172.21.15.39:0/2835632653 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55e5fdb99590 0x55e5fdfc4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:37.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.749+0000 7f1e36ffd640 1 -- 172.21.15.39:0/2835632653 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e5fdb78e40 msgr2=0x55e5fdf87f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:37.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.749+0000 7f1e36ffd640 1 --2- 172.21.15.39:0/2835632653 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e5fdb78e40 0x55e5fdf87f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:37.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.749+0000 7f1e36ffd640 1 -- 172.21.15.39:0/2835632653 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5fdf56b70 con 0x55e5fdb913b0 2024-05-14T14:40:37.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.749+0000 7f1e377fe640 1 --2- 172.21.15.39:0/2835632653 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e5fdb78e40 0x55e5fdf87f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:40:37.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.749+0000 7f1e36ffd640 1 --2- 172.21.15.39:0/2835632653 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5fdb913b0 0x55e5fdfc4800 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c0015d0 tx=0x7f1e2c00c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12290b8840c81a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:37.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.750+0000 7f1e1cff9640 1 -- 172.21.15.39:0/2835632653 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c0019e0 con 0x55e5fdb913b0 2024-05-14T14:40:37.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.750+0000 7f1e1cff9640 1 -- 172.21.15.39:0/2835632653 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e2c018040 con 0x55e5fdb913b0 2024-05-14T14:40:37.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.750+0000 7f1e1cff9640 1 -- 172.21.15.39:0/2835632653 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e2c01c3f0 con 0x55e5fdb913b0 2024-05-14T14:40:37.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.750+0000 7f1e44da6740 1 -- 172.21.15.39:0/2835632653 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5fdb913b0 msgr2=0x55e5fdfc4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:37.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.750+0000 7f1e44da6740 1 --2- 172.21.15.39:0/2835632653 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5fdb913b0 0x55e5fdfc4800 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c0015d0 tx=0x7f1e2c00c000 comp rx=0 tx=0).stop 2024-05-14T14:40:37.741 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.750+0000 7f1e44da6740 1 -- 172.21.15.39:0/2835632653 shutdown_connections 2024-05-14T14:40:37.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.750+0000 7f1e44da6740 1 --2- 172.21.15.39:0/2835632653 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55e5fdb99590 0x55e5fdfc4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:37.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.750+0000 7f1e44da6740 1 --2- 172.21.15.39:0/2835632653 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5fdb913b0 0x55e5fdfc4800 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:37.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.750+0000 7f1e44da6740 1 --2- 172.21.15.39:0/2835632653 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e5fdb78e40 0x55e5fdf87f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:37.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.750+0000 7f1e44da6740 1 -- 172.21.15.39:0/2835632653 >> 172.21.15.39:0/2835632653 conn(0x55e5fdbae3c0 msgr2=0x55e5fdfa3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:37.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.750+0000 7f1e44da6740 1 -- 172.21.15.39:0/2835632653 shutdown_connections 2024-05-14T14:40:37.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.750+0000 7f1e44da6740 1 -- 172.21.15.39:0/2835632653 wait complete. 2024-05-14T14:40:37.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.751+0000 7f1e44da6740 1 -- start start 2024-05-14T14:40:37.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.751+0000 7f1e44da6740 1 Processor -- start 2024-05-14T14:40:37.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.753+0000 7f1e44da6740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5fdb78e40 0x55e5fdf96ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:37.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.753+0000 7f1e44da6740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e5fdb913b0 0x55e5fdf97420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:37.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.753+0000 7f1e44da6740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55e5fdb99590 0x55e5fdfba400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:37.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.753+0000 7f1e44da6740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x55e5fdf9a4e0 con 0x55e5fdb78e40 2024-05-14T14:40:37.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.753+0000 7f1e44da6740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x55e5fdf83090 con 0x55e5fdb913b0 2024-05-14T14:40:37.742 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.753+0000 7f1e44da6740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x55e5fdf82710 con 0x55e5fdb99590 2024-05-14T14:40:37.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.753+0000 7f1e44da6740 10 client.0 _ll_register_callbacks cb 0x7f1e28007c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T14:40:37.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.753+0000 7f1e377fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5fdb78e40 0x55e5fdf96ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:37.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.753+0000 7f1e377fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5fdb78e40 0x55e5fdf96ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48608/0 (socket says 172.21.15.39:48608) 2024-05-14T14:40:37.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.753+0000 7f1e377fe640 1 -- 172.21.15.39:0/1757387551 learned_addr learned my addr 172.21.15.39:0/1757387551 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:37.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.753+0000 7f1e36ffd640 1 --2- 172.21.15.39:0/1757387551 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e5fdb913b0 0x55e5fdf97420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:37.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.753+0000 7f1e37fff640 1 --2- 172.21.15.39:0/1757387551 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55e5fdb99590 0x55e5fdfba400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:37.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.753+0000 7f1e377fe640 1 -- 172.21.15.39:0/1757387551 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55e5fdb99590 msgr2=0x55e5fdfba400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:37.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.753+0000 7f1e377fe640 1 --2- 172.21.15.39:0/1757387551 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55e5fdb99590 0x55e5fdfba400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:37.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.753+0000 7f1e377fe640 1 -- 172.21.15.39:0/1757387551 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e5fdb913b0 msgr2=0x55e5fdf97420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:37.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.753+0000 7f1e377fe640 1 --2- 172.21.15.39:0/1757387551 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e5fdb913b0 0x55e5fdf97420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:37.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.753+0000 7f1e377fe640 1 -- 172.21.15.39:0/1757387551 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5fdf5d750 con 0x55e5fdb78e40 2024-05-14T14:40:37.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.753+0000 7f1e36ffd640 1 --2- 172.21.15.39:0/1757387551 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e5fdb913b0 0x55e5fdf97420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:40:37.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.753+0000 7f1e37fff640 1 --2- 172.21.15.39:0/1757387551 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55e5fdb99590 0x55e5fdfba400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:40:37.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.753+0000 7f1e377fe640 1 --2- 172.21.15.39:0/1757387551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5fdb78e40 0x55e5fdf96ee0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1e2800f5a0 tx=0x7f1e28001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a4cadd6f71ff3d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:37.743 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.753+0000 7f1e167fc640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-05-14T14:40:37.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.753+0000 7f1e167fc640 1 -- 172.21.15.39:0/1757387551 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e28014450 con 0x55e5fdb78e40 2024-05-14T14:40:37.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.754+0000 7f1e167fc640 1 -- 172.21.15.39:0/1757387551 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1e28010040 con 0x55e5fdb78e40 2024-05-14T14:40:37.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.754+0000 7f1e44da6740 1 -- 172.21.15.39:0/1757387551 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e2c018040 con 0x55e5fdb78e40 2024-05-14T14:40:37.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.754+0000 7f1e167fc640 1 -- 172.21.15.39:0/1757387551 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f1e28039050 con 0x55e5fdb78e40 2024-05-14T14:40:37.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.754+0000 7f1e44da6740 10 client.4698 fetch_fsmap learned FSMap version 9 2024-05-14T14:40:37.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.754+0000 7f1e44da6740 1 -- 172.21.15.39:0/1757387551 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x55e5fdfb3cc0 con 0x55e5fdb78e40 2024-05-14T14:40:37.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.754+0000 7f1e167fc640 1 -- 172.21.15.39:0/1757387551 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e2c018040 con 0x55e5fdb78e40 2024-05-14T14:40:37.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.754+0000 7f1e167fc640 1 -- 172.21.15.39:0/1757387551 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 9) ==== 3502+0+0 (secure 0 0 0) 0x7f1e2803c020 con 0x55e5fdb78e40 2024-05-14T14:40:37.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.754+0000 7f1e44da6740 10 client.4698 fetch_fsmap finished waiting for FSMap version 9 2024-05-14T14:40:37.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.754+0000 7f1e44da6740 10 client.4698 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-14T14:40:37.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.754+0000 7f1e44da6740 20 client.4698 populate_metadata read hostname 'smithi039' 2024-05-14T14:40:37.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.754+0000 7f1e44da6740 1 --2- 172.21.15.39:0/1757387551 >> [v2:172.21.15.62:6833/1519798364,v1:172.21.15.62:6835/1519798364] conn(0x55e5fdb4e280 0x55e5fdf5a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:37.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.754+0000 7f1e44da6740 4 client.4698 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T14:40:37.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.754+0000 7f1e44da6740 1 -- 172.21.15.39:0/1757387551 --> [v2:172.21.15.62:6833/1519798364,v1:172.21.15.62:6835/1519798364] -- command(tid 0: {"prefix": "status"}) -- 0x55e5fdece4e0 con 0x55e5fdb4e280 2024-05-14T14:40:37.744 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.754+0000 7f1e36ffd640 1 --2- 172.21.15.39:0/1757387551 >> [v2:172.21.15.62:6833/1519798364,v1:172.21.15.62:6835/1519798364] conn(0x55e5fdb4e280 0x55e5fdf5a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:37.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.755+0000 7f1e36ffd640 1 --2- 172.21.15.39:0/1757387551 >> [v2:172.21.15.62:6833/1519798364,v1:172.21.15.62:6835/1519798364] conn(0x55e5fdb4e280 0x55e5fdf5a420 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4a3864884ff44a6 server_cookie=c57ecb8ef8d45f68 in_seq=0 out_seq=0 2024-05-14T14:40:37.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.755+0000 7f1e167fc640 10 client.4698 ms_handle_connect on v2:172.21.15.62:6833/1519798364 2024-05-14T14:40:37.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.755+0000 7f1e167fc640 1 -- 172.21.15.39:0/1757387551 <== mds.0 v2:172.21.15.62:6833/1519798364 1 ==== command_reply(tid 0: 0 ) ==== 8+0+323 (crc 0 0 0) 0x55e5fdece4e0 con 0x55e5fdb4e280 2024-05-14T14:40:37.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.755+0000 7f1e167fc640 10 client.4698 handle_command_reply: tid=0 2024-05-14T14:40:37.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.755+0000 7f1e44da6740 1 client.4698 shutdown 2024-05-14T14:40:37.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.755+0000 7f1e44da6740 1 -- 172.21.15.39:0/1757387551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5fdb78e40 msgr2=0x55e5fdf96ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:37.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.755+0000 7f1e44da6740 1 --2- 172.21.15.39:0/1757387551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5fdb78e40 0x55e5fdf96ee0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1e2800f5a0 tx=0x7f1e28001080 comp rx=0 tx=0).stop 2024-05-14T14:40:37.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.755+0000 7f1e44da6740 1 -- 172.21.15.39:0/1757387551 shutdown_connections 2024-05-14T14:40:37.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.755+0000 7f1e44da6740 1 --2- 172.21.15.39:0/1757387551 >> [v2:172.21.15.62:6833/1519798364,v1:172.21.15.62:6835/1519798364] conn(0x55e5fdb4e280 0x55e5fdf5a420 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:37.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.755+0000 7f1e44da6740 1 --2- 172.21.15.39:0/1757387551 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x55e5fdb99590 0x55e5fdfba400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:37.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.755+0000 7f1e44da6740 1 --2- 172.21.15.39:0/1757387551 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55e5fdb913b0 0x55e5fdf97420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:37.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.755+0000 7f1e44da6740 1 --2- 172.21.15.39:0/1757387551 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x55e5fdb78e40 0x55e5fdf96ee0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:37.745 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.755+0000 7f1e167fc640 0 client.4698 ms_handle_reset on v2:172.21.15.62:6833/1519798364 2024-05-14T14:40:37.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.755+0000 7f1e44da6740 1 -- 172.21.15.39:0/1757387551 >> 172.21.15.39:0/1757387551 conn(0x55e5fdbae3c0 msgr2=0x55e5fdfa5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:37.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.755+0000 7f1e44da6740 1 -- 172.21.15.39:0/1757387551 shutdown_connections 2024-05-14T14:40:37.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.755+0000 7f1e44da6740 1 -- 172.21.15.39:0/1757387551 wait complete. 2024-05-14T14:40:37.746 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.755+0000 7f1e44da6740 20 client.4698 trim_cache size 0 max 16384 2024-05-14T14:40:37.746 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-05-14T14:40:37.746 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "d7983fec-79c7-4991-b19c-1aecead64611", 2024-05-14T14:40:37.746 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 0, 2024-05-14T14:40:37.746 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 4278, 2024-05-14T14:40:37.747 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-05-14T14:40:37.747 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-05-14T14:40:37.747 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-05-14T14:40:37.747 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 21.792918071999999, 2024-05-14T14:40:37.747 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 9, 2024-05-14T14:40:37.747 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 24, 2024-05-14T14:40:37.747 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 24, 2024-05-14T14:40:37.747 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 27.29057521 2024-05-14T14:40:37.747 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-05-14T14:40:37.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.756+0000 7f1e3def2640 1 -- 172.21.15.39:0/1856924569 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1e240762d0 msgr2=0x7f1e240787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:37.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.756+0000 7f1e3def2640 1 --2- 172.21.15.39:0/1856924569 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1e240762d0 0x7f1e240787e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1e28000f60 tx=0x7f1e28009040 comp rx=0 tx=0).stop 2024-05-14T14:40:37.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.756+0000 7f1e3def2640 1 -- 172.21.15.39:0/1856924569 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e38158060 msgr2=0x7f1e38162f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:37.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.756+0000 7f1e3def2640 1 --2- 172.21.15.39:0/1856924569 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e38158060 0x7f1e38162f60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1e30009eb0 tx=0x7f1e30004a40 comp rx=0 tx=0).stop 2024-05-14T14:40:37.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.756+0000 7f1e3def2640 1 -- 172.21.15.39:0/1856924569 shutdown_connections 2024-05-14T14:40:37.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.756+0000 7f1e3def2640 1 --2- 172.21.15.39:0/1856924569 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1e240762d0 0x7f1e240787e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:37.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.756+0000 7f1e3def2640 1 --2- 172.21.15.39:0/1856924569 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1e38158060 0x7f1e38162f60 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:37.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.756+0000 7f1e3def2640 1 --2- 172.21.15.39:0/1856924569 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1e38160420 0x7f1e3814efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:37.748 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.756+0000 7f1e3def2640 1 --2- 172.21.15.39:0/1856924569 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1e380bb080 0x7f1e3815b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:37.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.756+0000 7f1e3def2640 1 -- 172.21.15.39:0/1856924569 >> 172.21.15.39:0/1856924569 conn(0x7f1e380d27d0 msgr2=0x7f1e380d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:37.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.756+0000 7f1e3def2640 1 -- 172.21.15.39:0/1856924569 shutdown_connections 2024-05-14T14:40:37.749 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:37.756+0000 7f1e3def2640 1 -- 172.21.15.39:0/1856924569 wait complete. 2024-05-14T14:40:37.751 INFO:teuthology.run_tasks:Running task sequential... 2024-05-14T14:40:37.760 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-14T14:40:37.761 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-14T14:40:37.761 INFO:teuthology.task.print:Enabling mgr modules 2024-05-14T14:40:37.761 INFO:teuthology.run_tasks:Running task kclient... 2024-05-14T14:40:37.797 INFO:tasks.kclient:Mounting kernel clients... 2024-05-14T14:40:37.798 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-05-14T14:40:37.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:37.798 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2024-05-14T14:40:37.814 INFO:teuthology.orchestra.run.smithi039.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-05-14T14:40:37.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:37.815 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-14T14:40:37.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:37.881 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link delete ceph-brx 2024-05-14T14:40:37.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:37.980 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2024-05-14T14:40:37.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:37.996 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link delete ceph-brx 2024-05-14T14:40:38.064 INFO:teuthology.orchestra.run.smithi039.stderr:Cannot find device "ceph-brx" 2024-05-14T14:40:38.066 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T14:40:38.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:38.066 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list 2024-05-14T14:40:38.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:38.087 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link delete ceph-brx 2024-05-14T14:40:38.161 INFO:teuthology.orchestra.run.smithi062.stderr:Cannot find device "ceph-brx" 2024-05-14T14:40:38.162 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T14:40:38.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:38.163 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list 2024-05-14T14:40:38.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:38.221 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link delete ceph-brx 2024-05-14T14:40:38.291 INFO:teuthology.orchestra.run.smithi062.stderr:Cannot find device "ceph-brx" 2024-05-14T14:40:38.292 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T14:40:38.293 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-05-14T14:40:38.293 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-14T14:40:38.293 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-14T14:40:38.293 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-14T14:40:38.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.425+0000 7f9eb1f40640 1 Processor -- start 2024-05-14T14:40:38.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.425+0000 7f9eb1f40640 1 -- start start 2024-05-14T14:40:38.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.427+0000 7f9eb1f40640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9eac0b6580 0x7f9eac161b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:38.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.427+0000 7f9eb1f40640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9eac1620a0 0x7f9eac1624b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:38.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.427+0000 7f9eb1f40640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9eac15e280 0x7f9eac15e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:38.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.427+0000 7f9eb1f40640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f9eac1629f0 con 0x7f9eac15e280 2024-05-14T14:40:38.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.427+0000 7f9eb1f40640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f9eac06d150 con 0x7f9eac1620a0 2024-05-14T14:40:38.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.427+0000 7f9eb1f40640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f9eac06d430 con 0x7f9eac0b6580 2024-05-14T14:40:38.412 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.427+0000 7f9eabfff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9eac15e280 0x7f9eac15e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:38.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.427+0000 7f9eabfff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9eac15e280 0x7f9eac15e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48618/0 (socket says 172.21.15.39:48618) 2024-05-14T14:40:38.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.427+0000 7f9eabfff640 1 -- 172.21.15.39:0/738586820 learned_addr learned my addr 172.21.15.39:0/738586820 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:38.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.427+0000 7f9eaaffd640 1 --2- 172.21.15.39:0/738586820 >> v2:172.21.15.62:3300/0 conn(0x7f9eac1620a0 0x7f9eac1624b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:38.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.427+0000 7f9eab7fe640 1 --2- 172.21.15.39:0/738586820 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9eac0b6580 0x7f9eac161b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:38.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.427+0000 7f9eabfff640 1 -- 172.21.15.39:0/738586820 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9eac0b6580 msgr2=0x7f9eac161b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:38.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.427+0000 7f9eabfff640 1 --2- 172.21.15.39:0/738586820 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9eac0b6580 0x7f9eac161b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:38.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.427+0000 7f9eabfff640 1 -- 172.21.15.39:0/738586820 >> v2:172.21.15.62:3300/0 conn(0x7f9eac1620a0 msgr2=0x7f9eac1624b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:38.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.427+0000 7f9eabfff640 1 --2- 172.21.15.39:0/738586820 >> v2:172.21.15.62:3300/0 conn(0x7f9eac1620a0 0x7f9eac1624b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:38.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.427+0000 7f9eabfff640 1 -- 172.21.15.39:0/738586820 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eac06d710 con 0x7f9eac15e280 2024-05-14T14:40:38.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.428+0000 7f9eab7fe640 1 --2- 172.21.15.39:0/738586820 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9eac0b6580 0x7f9eac161b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:40:38.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.428+0000 7f9eabfff640 1 --2- 172.21.15.39:0/738586820 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9eac15e280 0x7f9eac15e690 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9eac071770 tx=0x7f9ea402a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b825ed20a351389f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:38.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.428+0000 7f9eaa7fc640 1 -- 172.21.15.39:0/738586820 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea4036070 con 0x7f9eac15e280 2024-05-14T14:40:38.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.428+0000 7f9eaa7fc640 1 -- 172.21.15.39:0/738586820 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ea4031600 con 0x7f9eac15e280 2024-05-14T14:40:38.413 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.428+0000 7f9eaa7fc640 1 -- 172.21.15.39:0/738586820 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea40319d0 con 0x7f9eac15e280 2024-05-14T14:40:38.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.429+0000 7f9eb1f40640 1 -- 172.21.15.39:0/738586820 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9eac15e280 msgr2=0x7f9eac15e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:38.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.429+0000 7f9eb1f40640 1 --2- 172.21.15.39:0/738586820 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9eac15e280 0x7f9eac15e690 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9eac071770 tx=0x7f9ea402a570 comp rx=0 tx=0).stop 2024-05-14T14:40:38.414 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.429+0000 7f9eb1f40640 1 -- 172.21.15.39:0/738586820 shutdown_connections 2024-05-14T14:40:38.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.429+0000 7f9eb1f40640 1 --2- 172.21.15.39:0/738586820 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9eac15e280 0x7f9eac15e690 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:38.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.429+0000 7f9eb1f40640 1 --2- 172.21.15.39:0/738586820 >> v2:172.21.15.62:3300/0 conn(0x7f9eac1620a0 0x7f9eac1624b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:38.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.429+0000 7f9eb1f40640 1 --2- 172.21.15.39:0/738586820 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9eac0b6580 0x7f9eac161b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:38.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.429+0000 7f9eb1f40640 1 -- 172.21.15.39:0/738586820 >> 172.21.15.39:0/738586820 conn(0x7f9eac0d1c80 msgr2=0x7f9eac0d2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:38.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.429+0000 7f9eb1f40640 1 -- 172.21.15.39:0/738586820 shutdown_connections 2024-05-14T14:40:38.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.429+0000 7f9eb1f40640 1 -- 172.21.15.39:0/738586820 wait complete. 2024-05-14T14:40:38.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.431+0000 7f9eb1f40640 1 Processor -- start 2024-05-14T14:40:38.415 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.431+0000 7f9eb1f40640 1 -- start start 2024-05-14T14:40:38.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.432+0000 7f9eb1f40640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9eac0b6580 0x7f9eac1593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:38.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.433+0000 7f9eb1f40640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9eac15e280 0x7f9eac15fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:38.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.433+0000 7f9eb1f40640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9eac1620a0 0x7f9eac160360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:38.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.433+0000 7f9eb1f40640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9eac15ebd0 con 0x7f9eac1620a0 2024-05-14T14:40:38.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.433+0000 7f9eb1f40640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9eac0b6cd0 con 0x7f9eac0b6580 2024-05-14T14:40:38.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.433+0000 7f9eb1f40640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f9eac15ed50 con 0x7f9eac15e280 2024-05-14T14:40:38.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.433+0000 7f9eabfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9eac1620a0 0x7f9eac160360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:38.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.433+0000 7f9eabfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9eac1620a0 0x7f9eac160360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48628/0 (socket says 172.21.15.39:48628) 2024-05-14T14:40:38.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.433+0000 7f9eabfff640 1 -- 172.21.15.39:0/35654477 learned_addr learned my addr 172.21.15.39:0/35654477 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:38.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.433+0000 7f9eab7fe640 1 --2- 172.21.15.39:0/35654477 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9eac0b6580 0x7f9eac1593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:38.419 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.433+0000 7f9eaaffd640 1 --2- 172.21.15.39:0/35654477 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9eac15e280 0x7f9eac15fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:38.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.433+0000 7f9eabfff640 1 -- 172.21.15.39:0/35654477 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9eac15e280 msgr2=0x7f9eac15fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:38.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.433+0000 7f9eabfff640 1 --2- 172.21.15.39:0/35654477 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9eac15e280 0x7f9eac15fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:38.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.433+0000 7f9eabfff640 1 -- 172.21.15.39:0/35654477 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9eac0b6580 msgr2=0x7f9eac1593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:38.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.433+0000 7f9eabfff640 1 --2- 172.21.15.39:0/35654477 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9eac0b6580 0x7f9eac1593d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:38.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.433+0000 7f9eabfff640 1 -- 172.21.15.39:0/35654477 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eac09e830 con 0x7f9eac1620a0 2024-05-14T14:40:38.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.433+0000 7f9eabfff640 1 --2- 172.21.15.39:0/35654477 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9eac1620a0 0x7f9eac160360 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4009f40 tx=0x7f9ea4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:38.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.433+0000 7f9e93fff640 1 -- 172.21.15.39:0/35654477 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea4036050 con 0x7f9eac1620a0 2024-05-14T14:40:38.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.433+0000 7f9e93fff640 1 -- 172.21.15.39:0/35654477 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ea4042070 con 0x7f9eac1620a0 2024-05-14T14:40:38.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.433+0000 7f9e93fff640 1 -- 172.21.15.39:0/35654477 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea4009510 con 0x7f9eac1620a0 2024-05-14T14:40:38.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.433+0000 7f9eb1f40640 1 -- 172.21.15.39:0/35654477 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9eac09eb10 con 0x7f9eac1620a0 2024-05-14T14:40:38.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.434+0000 7f9eb1f40640 1 -- 172.21.15.39:0/35654477 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9eac09f0d0 con 0x7f9eac1620a0 2024-05-14T14:40:38.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.434+0000 7f9eb1f40640 1 -- 172.21.15.39:0/35654477 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9eac076aa0 con 0x7f9eac1620a0 2024-05-14T14:40:38.420 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.435+0000 7f9e93fff640 1 -- 172.21.15.39:0/35654477 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9ea4007bf0 con 0x7f9eac1620a0 2024-05-14T14:40:38.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.436+0000 7f9e93fff640 1 --2- 172.21.15.39:0/35654477 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f9e980762d0 0x7f9e980787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:38.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.436+0000 7f9e93fff640 1 -- 172.21.15.39:0/35654477 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9ea40b8660 con 0x7f9eac1620a0 2024-05-14T14:40:38.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.436+0000 7f9eab7fe640 1 --2- 172.21.15.39:0/35654477 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f9e980762d0 0x7f9e980787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:38.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.436+0000 7f9eab7fe640 1 --2- 172.21.15.39:0/35654477 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f9e980762d0 0x7f9e980787e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9eac0b0a50 tx=0x7f9e9c004730 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:38.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.440+0000 7f9e93fff640 1 -- 172.21.15.39:0/35654477 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9ea40815a0 con 0x7f9eac1620a0 2024-05-14T14:40:38.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.675+0000 7f9eb1f40640 1 -- 172.21.15.39:0/35654477 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9eac09e5c0 con 0x7f9eac1620a0 2024-05-14T14:40:38.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.675+0000 7f9e93fff640 1 -- 172.21.15.39:0/35654477 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f9ea40858a0 con 0x7f9eac1620a0 2024-05-14T14:40:38.659 INFO:teuthology.orchestra.run.smithi039.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-14T14:40:38.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.677+0000 7f9eb1f40640 1 -- 172.21.15.39:0/35654477 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f9e980762d0 msgr2=0x7f9e980787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:38.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.677+0000 7f9eb1f40640 1 --2- 172.21.15.39:0/35654477 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f9e980762d0 0x7f9e980787e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9eac0b0a50 tx=0x7f9e9c004730 comp rx=0 tx=0).stop 2024-05-14T14:40:38.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.677+0000 7f9eb1f40640 1 -- 172.21.15.39:0/35654477 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9eac1620a0 msgr2=0x7f9eac160360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:38.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.677+0000 7f9eb1f40640 1 --2- 172.21.15.39:0/35654477 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9eac1620a0 0x7f9eac160360 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4009f40 tx=0x7f9ea4004a40 comp rx=0 tx=0).stop 2024-05-14T14:40:38.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.677+0000 7f9eb1f40640 1 -- 172.21.15.39:0/35654477 shutdown_connections 2024-05-14T14:40:38.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.677+0000 7f9eb1f40640 1 --2- 172.21.15.39:0/35654477 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f9e980762d0 0x7f9e980787e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:38.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.677+0000 7f9eb1f40640 1 --2- 172.21.15.39:0/35654477 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9eac1620a0 0x7f9eac160360 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:38.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.677+0000 7f9eb1f40640 1 --2- 172.21.15.39:0/35654477 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9eac15e280 0x7f9eac15fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:38.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.677+0000 7f9eb1f40640 1 --2- 172.21.15.39:0/35654477 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9eac0b6580 0x7f9eac1593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:38.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.677+0000 7f9eb1f40640 1 -- 172.21.15.39:0/35654477 >> 172.21.15.39:0/35654477 conn(0x7f9eac0d1c80 msgr2=0x7f9eac068610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:38.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.678+0000 7f9eb1f40640 1 -- 172.21.15.39:0/35654477 shutdown_connections 2024-05-14T14:40:38.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38.678+0000 7f9eb1f40640 1 -- 172.21.15.39:0/35654477 wait complete. 2024-05-14T14:40:38.673 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-14T14:40:38.673 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-14T14:40:38.673 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi039.front.sepia.ceph.com 2024-05-14T14:40:38.673 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-14T14:40:38.673 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-14T14:40:38.673 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-14T14:40:38.673 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-14T14:40:38.673 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-14T14:40:38.673 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-14T14:40:38.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:38.674 DEBUG:teuthology.orchestra.run.smithi039:> ip addr 2024-05-14T14:40:38.690 INFO:teuthology.orchestra.run.smithi039.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-14T14:40:38.690 INFO:teuthology.orchestra.run.smithi039.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-14T14:40:38.690 INFO:teuthology.orchestra.run.smithi039.stdout: inet 127.0.0.1/8 scope host lo 2024-05-14T14:40:38.690 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:40:38.690 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 ::1/128 scope host 2024-05-14T14:40:38.691 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:40:38.691 INFO:teuthology.orchestra.run.smithi039.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T14:40:38.691 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c6 brd ff:ff:ff:ff:ff:ff 2024-05-14T14:40:38.691 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f0 2024-05-14T14:40:38.691 INFO:teuthology.orchestra.run.smithi039.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T14:40:38.691 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c7 brd ff:ff:ff:ff:ff:ff 2024-05-14T14:40:38.691 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f1 2024-05-14T14:40:38.691 INFO:teuthology.orchestra.run.smithi039.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-14T14:40:38.691 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:70 brd ff:ff:ff:ff:ff:ff 2024-05-14T14:40:38.691 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f0 2024-05-14T14:40:38.691 INFO:teuthology.orchestra.run.smithi039.stdout: inet 172.21.15.39/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-14T14:40:38.692 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft 42697sec preferred_lft 42697sec 2024-05-14T14:40:38.692 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::ec4:7aff:febd:1370/64 scope link noprefixroute 2024-05-14T14:40:38.692 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:40:38.692 INFO:teuthology.orchestra.run.smithi039.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T14:40:38.692 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:71 brd ff:ff:ff:ff:ff:ff 2024-05-14T14:40:38.692 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f1 2024-05-14T14:40:38.692 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-14T14:40:38.692 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T14:40:38.692 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-05-14T14:40:38.693 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link add name ceph-brx type bridge 2024-05-14T14:40:38.693 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip addr flush dev ceph-brx 2024-05-14T14:40:38.693 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set ceph-brx up 2024-05-14T14:40:38.693 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-14T14:40:38.693 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-05-14T14:40:38.781 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T14:40:38.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:40:38.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:38.833 DEBUG:teuthology.orchestra.run.smithi039:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-14T14:40:38.858 INFO:teuthology.orchestra.run.smithi039.stdout:1 2024-05-14T14:40:38.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:38.859 DEBUG:teuthology.orchestra.run.smithi039:> route 2024-05-14T14:40:38.916 INFO:teuthology.orchestra.run.smithi039.stdout:Kernel IP routing table 2024-05-14T14:40:38.917 INFO:teuthology.orchestra.run.smithi039.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-14T14:40:38.917 INFO:teuthology.orchestra.run.smithi039.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-14T14:40:38.917 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-14T14:40:38.917 INFO:teuthology.orchestra.run.smithi039.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-14T14:40:38.917 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T14:40:38.917 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-05-14T14:40:38.917 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-14T14:40:38.917 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-14T14:40:38.918 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-14T14:40:38.918 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-05-14T14:40:39.007 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T14:40:39.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:40:39.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:39.047 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2024-05-14T14:40:39.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:39.066 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list-id 2024-05-14T14:40:39.122 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T14:40:39.122 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-05-14T14:40:39.122 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T14:40:39.122 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-14T14:40:39.122 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-05-14T14:40:39.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T14:40:39.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:40:39.242 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-14T14:40:39.243 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T14:40:39.243 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-05-14T14:40:39.243 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-14T14:40:39.243 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-14T14:40:39.243 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-14T14:40:39.244 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-14T14:40:39.244 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-14T14:40:39.244 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-05-14T14:40:39.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T14:40:39.355 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:40:39.361 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T14:40:39.361 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-05-14T14:40:39.361 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set brx.0 up 2024-05-14T14:40:39.361 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set dev brx.0 master ceph-brx 2024-05-14T14:40:39.361 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-05-14T14:40:39.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T14:40:39.434 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:40:39.441 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T14:40:39.441 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-14T14:40:39.456 INFO:teuthology.orchestra.run.smithi039.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-14T14:40:39.457 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T14:40:39.457 DEBUG:teuthology.orchestra.run.smithi039:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-14T14:40:39.512 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-05-14T14:40:39.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:39.512 DEBUG:teuthology.orchestra.run.smithi039:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-14T14:40:39.608 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-14T14:40:39.609 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-14T14:40:39.725 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-14T14:40:39.725 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-14T14:40:39.725 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.62:3300,172.21.15.62:3301" 2024-05-14T14:40:39.726 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: trying mount with new device syntax: 0@d7983fec-79c7-4991-b19c-1aecead64611.cephfs=/ 2024-05-14T14:40:39.726 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.39:3300/172.21.15.62:3300/172.21.15.62:3301" will pass to kernel 2024-05-14T14:40:39.727 INFO:teuthology.orchestra.run.smithi039.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-14T14:40:39.727 INFO:teuthology.orchestra.run.smithi039.stdout: You just mounted a file system that supports labels which does not 2024-05-14T14:40:39.727 INFO:teuthology.orchestra.run.smithi039.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-14T14:40:39.727 INFO:teuthology.orchestra.run.smithi039.stdout: applications will generate AVC messages and not be allowed access to 2024-05-14T14:40:39.727 INFO:teuthology.orchestra.run.smithi039.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-14T14:40:39.728 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-14T14:40:39.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:39.728 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-14T14:40:39.754 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-14T14:40:39.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-14T14:40:39.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:40:39.852 INFO:teuthology.orchestra.run.smithi039.stdout:client4517 2024-05-14T14:40:39.853 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T14:40:39.853 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T14:40:39.869 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-14T14:40:39.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:39 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-14T14:40:39.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:40:39.969 INFO:teuthology.orchestra.run.smithi039.stdout:client4517 2024-05-14T14:40:39.969 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-14T14:40:40.020 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-14T14:40:40.022 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:40:40.027 INFO:teuthology.orchestra.run.smithi039.stdout:client4517 2024-05-14T14:40:40.028 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/d7983fec-79c7-4991-b19c-1aecead64611.client4517/status') 2024-05-14T14:40:40.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T14:40:40.088 INFO:teuthology.orchestra.run.smithi039.stdout:instance: client.4517 (3)172.21.15.39:0/1136475618 2024-05-14T14:40:40.088 INFO:teuthology.orchestra.run.smithi039.stdout:blocklisted: false 2024-05-14T14:40:40.089 INFO:teuthology.orchestra.run.smithi039.stderr:0+1 records in 2024-05-14T14:40:40.089 INFO:teuthology.orchestra.run.smithi039.stderr:0+1 records out 2024-05-14T14:40:40.089 INFO:teuthology.orchestra.run.smithi039.stderr:70 bytes copied, 2.4892e-05 s, 2.8 MB/s 2024-05-14T14:40:40.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:40:40.096 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-05-14T14:40:40.096 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-14T14:40:40.096 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-14T14:40:40.096 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-14T14:40:40.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.227+0000 7f51cb301640 1 Processor -- start 2024-05-14T14:40:40.211 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.227+0000 7f51cb301640 1 -- start start 2024-05-14T14:40:40.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.228+0000 7f51cb301640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f51c40b4ec0 0x7f51c41602d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:40.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.228+0000 7f51cb301640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f51c40d15f0 0x7f51c406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:40.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.228+0000 7f51cb301640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51c40d5840 con 0x7f51c40d0ad0 2024-05-14T14:40:40.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.228+0000 7f51cb301640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f51c40d4d50 con 0x7f51c40d15f0 2024-05-14T14:40:40.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.228+0000 7f51cb301640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f51c406c840 con 0x7f51c40b4ec0 2024-05-14T14:40:40.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.228+0000 7f51c989e640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f51c40d15f0 0x7f51c406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:40.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.229+0000 7f51c989e640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f51c40d15f0 0x7f51c406ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51438/0 (socket says 172.21.15.39:51438) 2024-05-14T14:40:40.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.229+0000 7f51c989e640 1 -- 172.21.15.39:0/2571024285 learned_addr learned my addr 172.21.15.39:0/2571024285 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:40.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.229+0000 7f51c909d640 1 --2- 172.21.15.39:0/2571024285 >> v2:172.21.15.62:3300/0 conn(0x7f51c40b4ec0 0x7f51c41602d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:40.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.229+0000 7f51c989e640 1 -- 172.21.15.39:0/2571024285 >> v2:172.21.15.62:3300/0 conn(0x7f51c40b4ec0 msgr2=0x7f51c41602d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:40.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.229+0000 7f51c989e640 1 --2- 172.21.15.39:0/2571024285 >> v2:172.21.15.62:3300/0 conn(0x7f51c40b4ec0 0x7f51c41602d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:40.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.229+0000 7f51c989e640 1 -- 172.21.15.39:0/2571024285 >> v1:172.21.15.62:6789/0 conn(0x7f51c40d0ad0 legacy=0x7f51c40d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:40.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.229+0000 7f51c989e640 1 -- 172.21.15.39:0/2571024285 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51c40d4fa0 con 0x7f51c40d15f0 2024-05-14T14:40:40.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.229+0000 7f51c909d640 1 --2- 172.21.15.39:0/2571024285 >> v2:172.21.15.62:3300/0 conn(0x7f51c40b4ec0 0x7f51c41602d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:40:40.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.230+0000 7f51c989e640 1 --2- 172.21.15.39:0/2571024285 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51c40d15f0 0x7f51c406ccd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f51c40d66c0 tx=0x7f51bc02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff6ca5dbee4b5dbb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:40.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.230+0000 7f51bbfff640 1 -- 172.21.15.39:0/2571024285 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51bc036070 con 0x7f51c40d15f0 2024-05-14T14:40:40.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.230+0000 7f51bbfff640 1 -- 172.21.15.39:0/2571024285 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51bc031600 con 0x7f51c40d15f0 2024-05-14T14:40:40.215 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.230+0000 7f51bbfff640 1 -- 172.21.15.39:0/2571024285 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51bc0319d0 con 0x7f51c40d15f0 2024-05-14T14:40:40.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.230+0000 7f51cb301640 1 -- 172.21.15.39:0/2571024285 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51c40d15f0 msgr2=0x7f51c406ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:40.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.230+0000 7f51cb301640 1 --2- 172.21.15.39:0/2571024285 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51c40d15f0 0x7f51c406ccd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f51c40d66c0 tx=0x7f51bc02a730 comp rx=0 tx=0).stop 2024-05-14T14:40:40.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.231+0000 7f51cb301640 1 -- 172.21.15.39:0/2571024285 shutdown_connections 2024-05-14T14:40:40.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.231+0000 7f51cb301640 1 --2- 172.21.15.39:0/2571024285 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51c40d15f0 0x7f51c406ccd0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:40.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.231+0000 7f51cb301640 1 --2- 172.21.15.39:0/2571024285 >> v2:172.21.15.62:3300/0 conn(0x7f51c40b4ec0 0x7f51c41602d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:40.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.231+0000 7f51cb301640 1 -- 172.21.15.39:0/2571024285 >> 172.21.15.39:0/2571024285 conn(0x7f51c406f270 msgr2=0x7f51c40d5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:40.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.231+0000 7f51cb301640 1 -- 172.21.15.39:0/2571024285 shutdown_connections 2024-05-14T14:40:40.216 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.231+0000 7f51cb301640 1 -- 172.21.15.39:0/2571024285 wait complete. 2024-05-14T14:40:40.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.232+0000 7f51cb301640 1 Processor -- start 2024-05-14T14:40:40.217 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.233+0000 7f51cb301640 1 -- start start 2024-05-14T14:40:40.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.234+0000 7f51cb301640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51c40b4ec0 0x7f51c41e9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:40.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.234+0000 7f51cb301640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51c40d0ad0 0x7f51c4161c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:40.219 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.234+0000 7f51cb301640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f51c40d15f0 0x7f51c414ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:40.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.234+0000 7f51cb301640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f51c40b5480 con 0x7f51c40d0ad0 2024-05-14T14:40:40.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.234+0000 7f51cb301640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f51c40d5560 con 0x7f51c40b4ec0 2024-05-14T14:40:40.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.234+0000 7f51cb301640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f51c406d210 con 0x7f51c40d15f0 2024-05-14T14:40:40.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.234+0000 7f51c889c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51c40d0ad0 0x7f51c4161c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:40.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.234+0000 7f51c889c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51c40d0ad0 0x7f51c4161c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51446/0 (socket says 172.21.15.39:51446) 2024-05-14T14:40:40.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.234+0000 7f51c889c640 1 -- 172.21.15.39:0/1942613929 learned_addr learned my addr 172.21.15.39:0/1942613929 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:40.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.234+0000 7f51c909d640 1 --2- 172.21.15.39:0/1942613929 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51c40b4ec0 0x7f51c41e9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:40.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.234+0000 7f51c989e640 1 --2- 172.21.15.39:0/1942613929 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f51c40d15f0 0x7f51c414ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:40.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.234+0000 7f51c889c640 1 -- 172.21.15.39:0/1942613929 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f51c40d15f0 msgr2=0x7f51c414ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:40.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.234+0000 7f51c889c640 1 --2- 172.21.15.39:0/1942613929 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f51c40d15f0 0x7f51c414ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:40.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.234+0000 7f51c889c640 1 -- 172.21.15.39:0/1942613929 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51c40b4ec0 msgr2=0x7f51c41e9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:40.220 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.234+0000 7f51c889c640 1 --2- 172.21.15.39:0/1942613929 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51c40b4ec0 0x7f51c41e9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:40.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.234+0000 7f51c889c640 1 -- 172.21.15.39:0/1942613929 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51c415f020 con 0x7f51c40d0ad0 2024-05-14T14:40:40.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.234+0000 7f51c989e640 1 --2- 172.21.15.39:0/1942613929 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f51c40d15f0 0x7f51c414ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:40:40.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.235+0000 7f51c889c640 1 --2- 172.21.15.39:0/1942613929 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51c40d0ad0 0x7f51c4161c30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f51b400c400 tx=0x7f51b400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:40.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.235+0000 7f51b9ffb640 1 -- 172.21.15.39:0/1942613929 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b4017070 con 0x7f51c40d0ad0 2024-05-14T14:40:40.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.235+0000 7f51b9ffb640 1 -- 172.21.15.39:0/1942613929 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51b40052d0 con 0x7f51c40d0ad0 2024-05-14T14:40:40.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.235+0000 7f51cb301640 1 -- 172.21.15.39:0/1942613929 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51c41e8e90 con 0x7f51c40d0ad0 2024-05-14T14:40:40.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.235+0000 7f51b9ffb640 1 -- 172.21.15.39:0/1942613929 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b4003830 con 0x7f51c40d0ad0 2024-05-14T14:40:40.221 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.235+0000 7f51cb301640 1 -- 172.21.15.39:0/1942613929 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51c40cb8c0 con 0x7f51c40d0ad0 2024-05-14T14:40:40.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.236+0000 7f51cb301640 1 -- 172.21.15.39:0/1942613929 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51c4076aa0 con 0x7f51c40d0ad0 2024-05-14T14:40:40.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.237+0000 7f51b9ffb640 1 -- 172.21.15.39:0/1942613929 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f51b401a070 con 0x7f51c40d0ad0 2024-05-14T14:40:40.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.237+0000 7f51b9ffb640 1 --2- 172.21.15.39:0/1942613929 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f51a80762d0 0x7f51a80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:40.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.237+0000 7f51b9ffb640 1 -- 172.21.15.39:0/1942613929 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f51b4096dc0 con 0x7f51c40d0ad0 2024-05-14T14:40:40.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.237+0000 7f51c909d640 1 --2- 172.21.15.39:0/1942613929 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f51a80762d0 0x7f51a80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:40.222 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.238+0000 7f51c909d640 1 --2- 172.21.15.39:0/1942613929 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f51a80762d0 0x7f51a80787e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f51c0006fd0 tx=0x7f51c0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:40.226 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.242+0000 7f51b9ffb640 1 -- 172.21.15.39:0/1942613929 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f51c415f020 con 0x7f51c40d0ad0 2024-05-14T14:40:40.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.473+0000 7f51cb301640 1 -- 172.21.15.39:0/1942613929 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f51c40d4120 con 0x7f51c40d0ad0 2024-05-14T14:40:40.457 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.473+0000 7f51b9ffb640 1 -- 172.21.15.39:0/1942613929 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f51b4060360 con 0x7f51c40d0ad0 2024-05-14T14:40:40.457 INFO:teuthology.orchestra.run.smithi039.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-14T14:40:40.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.476+0000 7f51cb301640 1 -- 172.21.15.39:0/1942613929 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f51a80762d0 msgr2=0x7f51a80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:40.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.476+0000 7f51cb301640 1 --2- 172.21.15.39:0/1942613929 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f51a80762d0 0x7f51a80787e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f51c0006fd0 tx=0x7f51c0008040 comp rx=0 tx=0).stop 2024-05-14T14:40:40.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.476+0000 7f51cb301640 1 -- 172.21.15.39:0/1942613929 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51c40d0ad0 msgr2=0x7f51c4161c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:40.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.476+0000 7f51cb301640 1 --2- 172.21.15.39:0/1942613929 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51c40d0ad0 0x7f51c4161c30 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f51b400c400 tx=0x7f51b400c8c0 comp rx=0 tx=0).stop 2024-05-14T14:40:40.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.476+0000 7f51cb301640 1 -- 172.21.15.39:0/1942613929 shutdown_connections 2024-05-14T14:40:40.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.476+0000 7f51cb301640 1 --2- 172.21.15.39:0/1942613929 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f51a80762d0 0x7f51a80787e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:40.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.476+0000 7f51cb301640 1 --2- 172.21.15.39:0/1942613929 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f51c40d15f0 0x7f51c414ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:40.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.476+0000 7f51cb301640 1 --2- 172.21.15.39:0/1942613929 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f51c40d0ad0 0x7f51c4161c30 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:40.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.476+0000 7f51cb301640 1 --2- 172.21.15.39:0/1942613929 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f51c40b4ec0 0x7f51c41e9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:40.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.476+0000 7f51cb301640 1 -- 172.21.15.39:0/1942613929 >> 172.21.15.39:0/1942613929 conn(0x7f51c406f270 msgr2=0x7f51c4068610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:40.460 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.476+0000 7f51cb301640 1 -- 172.21.15.39:0/1942613929 shutdown_connections 2024-05-14T14:40:40.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40.476+0000 7f51cb301640 1 -- 172.21.15.39:0/1942613929 wait complete. 2024-05-14T14:40:40.471 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-14T14:40:40.471 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-14T14:40:40.471 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi039.front.sepia.ceph.com 2024-05-14T14:40:40.471 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-05-14T14:40:40.471 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-05-14T14:40:40.471 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-14T14:40:40.471 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-14T14:40:40.471 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-14T14:40:40.471 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-05-14T14:40:40.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:40.471 DEBUG:teuthology.orchestra.run.smithi039:> ip addr 2024-05-14T14:40:40.488 INFO:teuthology.orchestra.run.smithi039.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-14T14:40:40.488 INFO:teuthology.orchestra.run.smithi039.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-14T14:40:40.488 INFO:teuthology.orchestra.run.smithi039.stdout: inet 127.0.0.1/8 scope host lo 2024-05-14T14:40:40.488 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:40:40.488 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 ::1/128 scope host 2024-05-14T14:40:40.488 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:40:40.488 INFO:teuthology.orchestra.run.smithi039.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T14:40:40.489 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c6 brd ff:ff:ff:ff:ff:ff 2024-05-14T14:40:40.489 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f0 2024-05-14T14:40:40.489 INFO:teuthology.orchestra.run.smithi039.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T14:40:40.489 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c7 brd ff:ff:ff:ff:ff:ff 2024-05-14T14:40:40.489 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f1 2024-05-14T14:40:40.489 INFO:teuthology.orchestra.run.smithi039.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-14T14:40:40.489 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:70 brd ff:ff:ff:ff:ff:ff 2024-05-14T14:40:40.489 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f0 2024-05-14T14:40:40.489 INFO:teuthology.orchestra.run.smithi039.stdout: inet 172.21.15.39/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-14T14:40:40.489 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft 42695sec preferred_lft 42695sec 2024-05-14T14:40:40.489 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::ec4:7aff:febd:1370/64 scope link noprefixroute 2024-05-14T14:40:40.489 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:40:40.489 INFO:teuthology.orchestra.run.smithi039.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T14:40:40.489 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:71 brd ff:ff:ff:ff:ff:ff 2024-05-14T14:40:40.489 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f1 2024-05-14T14:40:40.489 INFO:teuthology.orchestra.run.smithi039.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-14T14:40:40.489 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether e2:d7:c3:91:1f:99 brd ff:ff:ff:ff:ff:ff 2024-05-14T14:40:40.490 INFO:teuthology.orchestra.run.smithi039.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-14T14:40:40.490 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:40:40.490 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::54b2:efff:fe0a:f860/64 scope link 2024-05-14T14:40:40.490 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:40:40.490 INFO:teuthology.orchestra.run.smithi039.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-14T14:40:40.490 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether e2:d7:c3:91:1f:99 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T14:40:40.490 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::e0d7:c3ff:fe91:1f99/64 scope link tentative 2024-05-14T14:40:40.490 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:40:40.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:40.490 DEBUG:teuthology.orchestra.run.smithi039:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-14T14:40:40.553 INFO:teuthology.orchestra.run.smithi039.stdout:1 2024-05-14T14:40:40.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:40.555 DEBUG:teuthology.orchestra.run.smithi039:> route 2024-05-14T14:40:40.612 INFO:teuthology.orchestra.run.smithi039.stdout:Kernel IP routing table 2024-05-14T14:40:40.612 INFO:teuthology.orchestra.run.smithi039.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-14T14:40:40.612 INFO:teuthology.orchestra.run.smithi039.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-14T14:40:40.612 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-14T14:40:40.613 INFO:teuthology.orchestra.run.smithi039.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-14T14:40:40.613 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T14:40:40.613 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-05-14T14:40:40.613 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-14T14:40:40.613 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-14T14:40:40.613 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-14T14:40:40.613 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-05-14T14:40:40.703 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T14:40:40.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:40:40.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:40.743 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2024-05-14T14:40:40.759 INFO:teuthology.orchestra.run.smithi039.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-14T14:40:40.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:40.759 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list-id 2024-05-14T14:40:40.814 INFO:teuthology.orchestra.run.smithi039.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-05-14T14:40:40.815 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T14:40:40.815 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-05-14T14:40:40.815 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-14T14:40:40.815 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-05-14T14:40:40.815 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-05-14T14:40:40.904 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T14:40:40.927 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:40:40.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:40.934 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-14T14:40:40.959 INFO:teuthology.orchestra.run.smithi039.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-14T14:40:40.959 INFO:teuthology.orchestra.run.smithi039.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-14T14:40:40.959 INFO:teuthology.orchestra.run.smithi039.stdout: inet 127.0.0.1/8 scope host lo 2024-05-14T14:40:40.959 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:40:40.959 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 ::1/128 scope host 2024-05-14T14:40:40.959 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:40:40.959 INFO:teuthology.orchestra.run.smithi039.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-14T14:40:40.960 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether d6:d1:ff:35:17:90 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-14T14:40:40.960 INFO:teuthology.orchestra.run.smithi039.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-14T14:40:40.960 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:40:40.960 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::d4d1:ffff:fe35:1790/64 scope link tentative 2024-05-14T14:40:40.960 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:40:40.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:40.961 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-05-14T14:40:41.026 INFO:teuthology.orchestra.run.smithi039.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-14T14:40:41.026 INFO:teuthology.orchestra.run.smithi039.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-14T14:40:41.027 INFO:teuthology.orchestra.run.smithi039.stdout: inet 127.0.0.1/8 scope host lo 2024-05-14T14:40:41.027 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:40:41.027 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 ::1/128 scope host 2024-05-14T14:40:41.027 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:40:41.027 INFO:teuthology.orchestra.run.smithi039.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-14T14:40:41.027 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether d6:d1:ff:35:17:90 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-14T14:40:41.027 INFO:teuthology.orchestra.run.smithi039.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-14T14:40:41.027 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:40:41.027 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::d4d1:ffff:fe35:1790/64 scope link tentative 2024-05-14T14:40:41.027 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:40:41.028 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-05-14T14:40:41.029 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T14:40:41.029 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-05-14T14:40:41.029 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-05-14T14:40:41.029 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-14T14:40:41.029 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-05-14T14:40:41.029 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-05-14T14:40:41.029 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-05-14T14:40:41.029 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-05-14T14:40:41.119 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T14:40:41.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:40:41.185 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T14:40:41.186 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-05-14T14:40:41.186 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set brx.1 up 2024-05-14T14:40:41.186 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set dev brx.1 master ceph-brx 2024-05-14T14:40:41.186 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-05-14T14:40:41.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T14:40:41.259 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:40:41.265 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T14:40:41.265 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-05-14T14:40:41.282 INFO:teuthology.orchestra.run.smithi039.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-05-14T14:40:41.282 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T14:40:41.282 DEBUG:teuthology.orchestra.run.smithi039:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-05-14T14:40:41.338 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-05-14T14:40:41.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:41.339 DEBUG:teuthology.orchestra.run.smithi039:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-14T14:40:41.434 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-14T14:40:41.434 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-14T14:40:41.443 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-14T14:40:41.443 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-14T14:40:41.443 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.62:3300,172.21.15.62:3301" 2024-05-14T14:40:41.443 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: trying mount with new device syntax: 2@d7983fec-79c7-4991-b19c-1aecead64611.cephfs=/ 2024-05-14T14:40:41.443 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.39:3300/172.21.15.62:3300/172.21.15.62:3301" will pass to kernel 2024-05-14T14:40:41.443 INFO:teuthology.orchestra.run.smithi039.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-05-14T14:40:41.444 INFO:teuthology.orchestra.run.smithi039.stdout: You just mounted a file system that supports labels which does not 2024-05-14T14:40:41.444 INFO:teuthology.orchestra.run.smithi039.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-14T14:40:41.444 INFO:teuthology.orchestra.run.smithi039.stdout: applications will generate AVC messages and not be allowed access to 2024-05-14T14:40:41.444 INFO:teuthology.orchestra.run.smithi039.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-14T14:40:41.446 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-14T14:40:41.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:41.446 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-05-14T14:40:41.471 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-14T14:40:41.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-14T14:40:41.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:40:41.571 INFO:teuthology.orchestra.run.smithi039.stdout:client4713 2024-05-14T14:40:41.571 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T14:40:41.572 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T14:40:41.587 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-14T14:40:41.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-14T14:40:41.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:40:41.685 INFO:teuthology.orchestra.run.smithi039.stdout:client4713 2024-05-14T14:40:41.685 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-14T14:40:41.735 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-14T14:40:41.737 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:40:41.743 INFO:teuthology.orchestra.run.smithi039.stdout:client4713 2024-05-14T14:40:41.743 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/d7983fec-79c7-4991-b19c-1aecead64611.client4713/status') 2024-05-14T14:40:41.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T14:40:41.804 INFO:teuthology.orchestra.run.smithi039.stdout:instance: client.4713 (3)192.168.0.2:0/3686602661 2024-05-14T14:40:41.804 INFO:teuthology.orchestra.run.smithi039.stdout:blocklisted: false 2024-05-14T14:40:41.804 INFO:teuthology.orchestra.run.smithi039.stderr:0+1 records in 2024-05-14T14:40:41.804 INFO:teuthology.orchestra.run.smithi039.stderr:0+1 records out 2024-05-14T14:40:41.804 INFO:teuthology.orchestra.run.smithi039.stderr:69 bytes copied, 2.4678e-05 s, 2.8 MB/s 2024-05-14T14:40:41.805 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:40:41.811 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-05-14T14:40:41.811 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-14T14:40:41.811 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-14T14:40:41.811 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-14T14:40:41.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.942+0000 7efd03dce640 1 Processor -- start 2024-05-14T14:40:41.926 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.942+0000 7efd03dce640 1 -- start start 2024-05-14T14:40:41.928 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.944+0000 7efd03dce640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7efcfc0cf690 0x7efcfc0d1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:41.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.944+0000 7efd03dce640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7efcfc0cdfc0 0x7efcfc0b43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:41.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.944+0000 7efd03dce640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcfc160810 con 0x7efcfc0d2140 2024-05-14T14:40:41.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.944+0000 7efd03dce640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7efcfc0cfaa0 con 0x7efcfc0cdfc0 2024-05-14T14:40:41.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.944+0000 7efd03dce640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7efcfc0d29b0 con 0x7efcfc0cf690 2024-05-14T14:40:41.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.944+0000 7efd0236b640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7efcfc0cdfc0 0x7efcfc0b43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:41.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.944+0000 7efd0236b640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7efcfc0cdfc0 0x7efcfc0b43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51462/0 (socket says 172.21.15.39:51462) 2024-05-14T14:40:41.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.944+0000 7efd0236b640 1 -- 172.21.15.39:0/2660419359 learned_addr learned my addr 172.21.15.39:0/2660419359 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:41.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.944+0000 7efd01b6a640 1 --2- 172.21.15.39:0/2660419359 >> v2:172.21.15.62:3300/0 conn(0x7efcfc0cf690 0x7efcfc0d1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:41.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.944+0000 7efd0236b640 1 -- 172.21.15.39:0/2660419359 >> v2:172.21.15.62:3300/0 conn(0x7efcfc0cf690 msgr2=0x7efcfc0d1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:41.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.944+0000 7efd0236b640 1 --2- 172.21.15.39:0/2660419359 >> v2:172.21.15.62:3300/0 conn(0x7efcfc0cf690 0x7efcfc0d1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:41.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.944+0000 7efd0236b640 1 -- 172.21.15.39:0/2660419359 >> v1:172.21.15.62:6789/0 conn(0x7efcfc0d2140 legacy=0x7efcfc0b3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:41.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.944+0000 7efd0236b640 1 -- 172.21.15.39:0/2660419359 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcfc0d2c50 con 0x7efcfc0cdfc0 2024-05-14T14:40:41.929 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.945+0000 7efd0236b640 1 --2- 172.21.15.39:0/2660419359 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcfc0cdfc0 0x7efcfc0b43a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efcfc09c600 tx=0x7efcf402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d3fbd605255e185 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:41.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.945+0000 7efd00b68640 1 -- 172.21.15.39:0/2660419359 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf4037070 con 0x7efcfc0cdfc0 2024-05-14T14:40:41.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.945+0000 7efd00b68640 1 -- 172.21.15.39:0/2660419359 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcf4032440 con 0x7efcfc0cdfc0 2024-05-14T14:40:41.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.945+0000 7efd00b68640 1 -- 172.21.15.39:0/2660419359 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf4032810 con 0x7efcfc0cdfc0 2024-05-14T14:40:41.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.946+0000 7efd03dce640 1 -- 172.21.15.39:0/2660419359 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcfc0cdfc0 msgr2=0x7efcfc0b43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:41.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.946+0000 7efd03dce640 1 --2- 172.21.15.39:0/2660419359 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcfc0cdfc0 0x7efcfc0b43a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efcfc09c600 tx=0x7efcf402a1e0 comp rx=0 tx=0).stop 2024-05-14T14:40:41.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.946+0000 7efd03dce640 1 -- 172.21.15.39:0/2660419359 shutdown_connections 2024-05-14T14:40:41.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.946+0000 7efd03dce640 1 --2- 172.21.15.39:0/2660419359 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcfc0cdfc0 0x7efcfc0b43a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:41.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.946+0000 7efd03dce640 1 --2- 172.21.15.39:0/2660419359 >> v2:172.21.15.62:3300/0 conn(0x7efcfc0cf690 0x7efcfc0d1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:41.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.946+0000 7efd03dce640 1 -- 172.21.15.39:0/2660419359 >> 172.21.15.39:0/2660419359 conn(0x7efcfc09b5f0 msgr2=0x7efcfc09ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:41.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.946+0000 7efd03dce640 1 -- 172.21.15.39:0/2660419359 shutdown_connections 2024-05-14T14:40:41.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.946+0000 7efd03dce640 1 -- 172.21.15.39:0/2660419359 wait complete. 2024-05-14T14:40:41.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.948+0000 7efd03dce640 1 Processor -- start 2024-05-14T14:40:41.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.948+0000 7efd03dce640 1 -- start start 2024-05-14T14:40:41.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.949+0000 7efd03dce640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efcfc0cdfc0 0x7efcfc1490c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:41.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.949+0000 7efd03dce640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcfc0cf690 0x7efcfc0b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:41.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.949+0000 7efd03dce640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efcfc0d2140 0x7efcfc15abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:41.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.949+0000 7efd03dce640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7efcfc0ce3d0 con 0x7efcfc0cf690 2024-05-14T14:40:41.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.949+0000 7efd03dce640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7efcfc0d3210 con 0x7efcfc0cdfc0 2024-05-14T14:40:41.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.949+0000 7efd03dce640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7efcfc0b3360 con 0x7efcfc0d2140 2024-05-14T14:40:41.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.949+0000 7efd01369640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcfc0cf690 0x7efcfc0b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:41.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.949+0000 7efd01369640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcfc0cf690 0x7efcfc0b1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51472/0 (socket says 172.21.15.39:51472) 2024-05-14T14:40:41.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.949+0000 7efd01369640 1 -- 172.21.15.39:0/3429572069 learned_addr learned my addr 172.21.15.39:0/3429572069 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:41.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.949+0000 7efd01b6a640 1 --2- 172.21.15.39:0/3429572069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efcfc0cdfc0 0x7efcfc1490c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:41.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.949+0000 7efd0236b640 1 --2- 172.21.15.39:0/3429572069 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efcfc0d2140 0x7efcfc15abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:41.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.950+0000 7efd01369640 1 -- 172.21.15.39:0/3429572069 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efcfc0d2140 msgr2=0x7efcfc15abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:41.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.950+0000 7efd01369640 1 --2- 172.21.15.39:0/3429572069 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efcfc0d2140 0x7efcfc15abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:41.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.950+0000 7efd01369640 1 -- 172.21.15.39:0/3429572069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efcfc0cdfc0 msgr2=0x7efcfc1490c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:41.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.950+0000 7efd01369640 1 --2- 172.21.15.39:0/3429572069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efcfc0cdfc0 0x7efcfc1490c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:41.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.950+0000 7efd01369640 1 -- 172.21.15.39:0/3429572069 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcfc0b0a20 con 0x7efcfc0cf690 2024-05-14T14:40:41.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.950+0000 7efd01369640 1 --2- 172.21.15.39:0/3429572069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcfc0cf690 0x7efcfc0b1ac0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7efcec00c390 tx=0x7efcec00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:41.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.950+0000 7efcf27fc640 1 -- 172.21.15.39:0/3429572069 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcec011790 con 0x7efcfc0cf690 2024-05-14T14:40:41.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.950+0000 7efcf27fc640 1 -- 172.21.15.39:0/3429572069 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcec017070 con 0x7efcfc0cf690 2024-05-14T14:40:41.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.950+0000 7efd03dce640 1 -- 172.21.15.39:0/3429572069 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcfc0b0d00 con 0x7efcfc0cf690 2024-05-14T14:40:41.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.950+0000 7efcf27fc640 1 -- 172.21.15.39:0/3429572069 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcec011b70 con 0x7efcfc0cf690 2024-05-14T14:40:41.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.950+0000 7efd03dce640 1 -- 172.21.15.39:0/3429572069 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcfc0b12c0 con 0x7efcfc0cf690 2024-05-14T14:40:41.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.951+0000 7efd03dce640 1 -- 172.21.15.39:0/3429572069 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcfc0d1500 con 0x7efcfc0cf690 2024-05-14T14:40:41.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.952+0000 7efcf27fc640 1 -- 172.21.15.39:0/3429572069 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efcec011d10 con 0x7efcfc0cf690 2024-05-14T14:40:41.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.952+0000 7efcf27fc640 1 --2- 172.21.15.39:0/3429572069 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7efce0076300 0x7efce0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:41.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.952+0000 7efcf27fc640 1 -- 172.21.15.39:0/3429572069 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7efcec0975a0 con 0x7efcfc0cf690 2024-05-14T14:40:41.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.952+0000 7efd01b6a640 1 --2- 172.21.15.39:0/3429572069 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7efce0076300 0x7efce0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:41.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.953+0000 7efd01b6a640 1 --2- 172.21.15.39:0/3429572069 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7efce0076300 0x7efce0078810 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efcf8003aa0 tx=0x7efcf8009830 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:41.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:41.957+0000 7efcf27fc640 1 -- 172.21.15.39:0/3429572069 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7efcfc0d1500 con 0x7efcfc0cf690 2024-05-14T14:40:42.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:42.191+0000 7efd03dce640 1 -- 172.21.15.39:0/3429572069 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7efcfc076aa0 con 0x7efcfc0cf690 2024-05-14T14:40:42.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:42.192+0000 7efcf27fc640 1 -- 172.21.15.39:0/3429572069 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7efcec0604e0 con 0x7efcfc0cf690 2024-05-14T14:40:42.176 INFO:teuthology.orchestra.run.smithi039.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-14T14:40:42.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:42.194+0000 7efd03dce640 1 -- 172.21.15.39:0/3429572069 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7efce0076300 msgr2=0x7efce0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:42.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:42.194+0000 7efd03dce640 1 --2- 172.21.15.39:0/3429572069 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7efce0076300 0x7efce0078810 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efcf8003aa0 tx=0x7efcf8009830 comp rx=0 tx=0).stop 2024-05-14T14:40:42.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:42.194+0000 7efd03dce640 1 -- 172.21.15.39:0/3429572069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcfc0cf690 msgr2=0x7efcfc0b1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:42.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:42.194+0000 7efd03dce640 1 --2- 172.21.15.39:0/3429572069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcfc0cf690 0x7efcfc0b1ac0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7efcec00c390 tx=0x7efcec00c850 comp rx=0 tx=0).stop 2024-05-14T14:40:42.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:42.194+0000 7efd03dce640 1 -- 172.21.15.39:0/3429572069 shutdown_connections 2024-05-14T14:40:42.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:42.194+0000 7efd03dce640 1 --2- 172.21.15.39:0/3429572069 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7efce0076300 0x7efce0078810 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:42.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:42.194+0000 7efd03dce640 1 --2- 172.21.15.39:0/3429572069 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efcfc0d2140 0x7efcfc15abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:42.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:42.194+0000 7efd03dce640 1 --2- 172.21.15.39:0/3429572069 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efcfc0cf690 0x7efcfc0b1ac0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:42.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:42.194+0000 7efd03dce640 1 --2- 172.21.15.39:0/3429572069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efcfc0cdfc0 0x7efcfc1490c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:42.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:42.194+0000 7efd03dce640 1 -- 172.21.15.39:0/3429572069 >> 172.21.15.39:0/3429572069 conn(0x7efcfc09b5f0 msgr2=0x7efcfc0b4810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:42.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:42.194+0000 7efd03dce640 1 -- 172.21.15.39:0/3429572069 shutdown_connections 2024-05-14T14:40:42.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:42.194+0000 7efd03dce640 1 -- 172.21.15.39:0/3429572069 wait complete. 2024-05-14T14:40:42.189 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-14T14:40:42.189 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-14T14:40:42.189 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi062.front.sepia.ceph.com 2024-05-14T14:40:42.189 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-14T14:40:42.189 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-14T14:40:42.189 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-14T14:40:42.189 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-14T14:40:42.189 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-14T14:40:42.189 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-14T14:40:42.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:42.189 DEBUG:teuthology.orchestra.run.smithi062:> ip addr 2024-05-14T14:40:42.210 INFO:teuthology.orchestra.run.smithi062.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-14T14:40:42.210 INFO:teuthology.orchestra.run.smithi062.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-14T14:40:42.211 INFO:teuthology.orchestra.run.smithi062.stdout: inet 127.0.0.1/8 scope host lo 2024-05-14T14:40:42.211 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:40:42.211 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 ::1/128 scope host 2024-05-14T14:40:42.211 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:40:42.211 INFO:teuthology.orchestra.run.smithi062.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T14:40:42.211 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:14 brd ff:ff:ff:ff:ff:ff 2024-05-14T14:40:42.211 INFO:teuthology.orchestra.run.smithi062.stdout: altname enp7s0f0 2024-05-14T14:40:42.211 INFO:teuthology.orchestra.run.smithi062.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T14:40:42.211 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:15 brd ff:ff:ff:ff:ff:ff 2024-05-14T14:40:42.211 INFO:teuthology.orchestra.run.smithi062.stdout: altname enp7s0f1 2024-05-14T14:40:42.211 INFO:teuthology.orchestra.run.smithi062.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T14:40:42.211 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c2 brd ff:ff:ff:ff:ff:ff 2024-05-14T14:40:42.211 INFO:teuthology.orchestra.run.smithi062.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-14T14:40:42.211 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c3 brd ff:ff:ff:ff:ff:ff 2024-05-14T14:40:42.212 INFO:teuthology.orchestra.run.smithi062.stdout: inet 172.21.15.62/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-14T14:40:42.212 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft 42663sec preferred_lft 42663sec 2024-05-14T14:40:42.212 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::ec4:7aff:febb:d1c3/64 scope link 2024-05-14T14:40:42.212 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:40:42.212 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-14T14:40:42.212 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T14:40:42.212 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2024-05-14T14:40:42.212 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link add name ceph-brx type bridge 2024-05-14T14:40:42.212 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip addr flush dev ceph-brx 2024-05-14T14:40:42.212 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set ceph-brx up 2024-05-14T14:40:42.212 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-14T14:40:42.213 DEBUG:teuthology.orchestra.run.smithi062:> ') 2024-05-14T14:40:42.297 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:40:42.299 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:40:42.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:40:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T14:40:42.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:40:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:40:42.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:42.445 DEBUG:teuthology.orchestra.run.smithi062:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-14T14:40:42.472 INFO:teuthology.orchestra.run.smithi062.stdout:1 2024-05-14T14:40:42.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:42.473 DEBUG:teuthology.orchestra.run.smithi062:> route 2024-05-14T14:40:42.550 INFO:teuthology.orchestra.run.smithi062.stdout:Kernel IP routing table 2024-05-14T14:40:42.551 INFO:teuthology.orchestra.run.smithi062.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-14T14:40:42.551 INFO:teuthology.orchestra.run.smithi062.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-14T14:40:42.551 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-14T14:40:42.551 INFO:teuthology.orchestra.run.smithi062.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-14T14:40:42.552 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T14:40:42.552 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2024-05-14T14:40:42.552 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-14T14:40:42.552 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-14T14:40:42.552 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-14T14:40:42.552 DEBUG:teuthology.orchestra.run.smithi062:> ') 2024-05-14T14:40:42.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:40:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T14:40:42.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:40:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:40:42.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:42.838 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list 2024-05-14T14:40:42.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:42.854 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list-id 2024-05-14T14:40:42.911 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T14:40:42.911 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2024-05-14T14:40:42.911 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-14T14:40:42.911 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-05-14T14:40:42.911 DEBUG:teuthology.orchestra.run.smithi062:> ') 2024-05-14T14:40:43.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:40:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T14:40:43.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:40:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:40:43.032 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-05-14T14:40:43.032 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T14:40:43.032 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2024-05-14T14:40:43.032 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-05-14T14:40:43.032 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-14T14:40:43.032 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-05-14T14:40:43.032 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-05-14T14:40:43.032 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-05-14T14:40:43.032 DEBUG:teuthology.orchestra.run.smithi062:> ') 2024-05-14T14:40:43.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:40:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T14:40:43.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:40:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:40:43.165 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T14:40:43.165 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2024-05-14T14:40:43.165 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set brx.0 up 2024-05-14T14:40:43.165 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set dev brx.0 master ceph-brx 2024-05-14T14:40:43.165 DEBUG:teuthology.orchestra.run.smithi062:> ') 2024-05-14T14:40:43.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:40:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T14:40:43.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:40:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:40:43.244 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T14:40:43.245 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-14T14:40:43.260 INFO:teuthology.orchestra.run.smithi062.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-14T14:40:43.260 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T14:40:43.260 DEBUG:teuthology.orchestra.run.smithi062:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-14T14:40:43.317 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-05-14T14:40:43.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:43.317 DEBUG:teuthology.orchestra.run.smithi062:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-14T14:40:43.420 INFO:teuthology.orchestra.run.smithi062.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-14T14:40:43.420 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-14T14:40:43.551 INFO:teuthology.orchestra.run.smithi062.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-14T14:40:43.551 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-14T14:40:43.551 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.62:3300,172.21.15.62:3301" 2024-05-14T14:40:43.551 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: trying mount with new device syntax: 1@d7983fec-79c7-4991-b19c-1aecead64611.cephfs=/ 2024-05-14T14:40:43.551 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.39:3300/172.21.15.62:3300/172.21.15.62:3301" will pass to kernel 2024-05-14T14:40:43.552 INFO:teuthology.orchestra.run.smithi062.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-05-14T14:40:43.552 INFO:teuthology.orchestra.run.smithi062.stdout: You just mounted a file system that supports labels which does not 2024-05-14T14:40:43.552 INFO:teuthology.orchestra.run.smithi062.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-14T14:40:43.552 INFO:teuthology.orchestra.run.smithi062.stdout: applications will generate AVC messages and not be allowed access to 2024-05-14T14:40:43.552 INFO:teuthology.orchestra.run.smithi062.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-14T14:40:43.554 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-14T14:40:43.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:43.554 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-14T14:40:43.580 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-14T14:40:43.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:40:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-14T14:40:43.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:40:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:40:43.678 INFO:teuthology.orchestra.run.smithi062.stdout:client4666 2024-05-14T14:40:43.679 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-14T14:40:43.679 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T14:40:43.695 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-14T14:40:43.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:40:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-14T14:40:43.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:40:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:40:43.793 INFO:teuthology.orchestra.run.smithi062.stdout:client4666 2024-05-14T14:40:43.794 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-14T14:40:43.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:40:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-14T14:40:43.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:40:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:40:43.851 INFO:teuthology.orchestra.run.smithi062.stdout:client4666 2024-05-14T14:40:43.852 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/d7983fec-79c7-4991-b19c-1aecead64611.client4666/status') 2024-05-14T14:40:43.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:40:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T14:40:43.912 INFO:teuthology.orchestra.run.smithi062.stdout:instance: client.4666 (3)192.168.0.1:0/2185027824 2024-05-14T14:40:43.912 INFO:teuthology.orchestra.run.smithi062.stdout:blocklisted: false 2024-05-14T14:40:43.912 INFO:teuthology.orchestra.run.smithi062.stderr:0+1 records in 2024-05-14T14:40:43.913 INFO:teuthology.orchestra.run.smithi062.stderr:0+1 records out 2024-05-14T14:40:43.913 INFO:teuthology.orchestra.run.smithi062.stderr:69 bytes copied, 2.5922e-05 s, 2.7 MB/s 2024-05-14T14:40:43.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:40:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:40:43.919 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-05-14T14:40:43.920 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-14T14:40:43.920 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-14T14:40:43.920 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-14T14:40:44.049 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.065+0000 7f4d0978d640 1 Processor -- start 2024-05-14T14:40:44.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.066+0000 7f4d0978d640 1 -- start start 2024-05-14T14:40:44.051 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.067+0000 7f4d0978d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4d0406dc70 0x7f4d0416b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:44.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.067+0000 7f4d0978d640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d04164bc0 con 0x7f4d041602f0 2024-05-14T14:40:44.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.067+0000 7f4d0978d640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d040b4fc0 con 0x7f4d040b4820 2024-05-14T14:40:44.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.067+0000 7f4d0978d640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f4d040b4d70 con 0x7f4d0406dc70 2024-05-14T14:40:44.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.067+0000 7f4d027fc640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f4d041602f0 0x7f4d041644b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:50476/0 (socket says 172.21.15.39:50476) 2024-05-14T14:40:44.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.067+0000 7f4d027fc640 1 -- 172.21.15.39:0/1683584052 learned_addr learned my addr 172.21.15.39:0/1683584052 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:44.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.067+0000 7f4d037fe640 1 --2- 172.21.15.39:0/1683584052 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4d0406dc70 0x7f4d0416b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:44.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.067+0000 7f4d01ffb640 1 -- 172.21.15.39:0/1683584052 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3321654348 0 0) 0x7f4d04164bc0 con 0x7f4d041602f0 2024-05-14T14:40:44.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.067+0000 7f4d01ffb640 1 -- 172.21.15.39:0/1683584052 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cec003520 con 0x7f4d041602f0 2024-05-14T14:40:44.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.068+0000 7f4d01ffb640 1 -- 172.21.15.39:0/1683584052 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3187758088 0 0) 0x7f4d040b4fc0 con 0x7f4d040b4820 2024-05-14T14:40:44.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.068+0000 7f4d01ffb640 1 -- 172.21.15.39:0/1683584052 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d04164bc0 con 0x7f4d040b4820 2024-05-14T14:40:44.052 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.068+0000 7f4d01ffb640 1 -- 172.21.15.39:0/1683584052 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2461569138 0 0) 0x7f4cec003520 con 0x7f4d041602f0 2024-05-14T14:40:44.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.068+0000 7f4d037fe640 1 -- 172.21.15.39:0/1683584052 >> v1:172.21.15.62:6789/0 conn(0x7f4d040b4820 legacy=0x7f4d04163da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:44.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.068+0000 7f4d037fe640 1 -- 172.21.15.39:0/1683584052 >> v1:172.21.15.39:6789/0 conn(0x7f4d041602f0 legacy=0x7f4d041644b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:44.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.068+0000 7f4d037fe640 1 -- 172.21.15.39:0/1683584052 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d040d4fc0 con 0x7f4d0406dc70 2024-05-14T14:40:44.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.068+0000 7f4d037fe640 1 --2- 172.21.15.39:0/1683584052 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4d0406dc70 0x7f4d0416b130 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc009dc0 tx=0x7f4cfc02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=598025b3725722ca server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:44.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.069+0000 7f4d01ffb640 1 -- 172.21.15.39:0/1683584052 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf80016f0 con 0x7f4d0406dc70 2024-05-14T14:40:44.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.069+0000 7f4d01ffb640 1 -- 172.21.15.39:0/1683584052 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cfc007540 con 0x7f4d0406dc70 2024-05-14T14:40:44.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.069+0000 7f4d01ffb640 1 -- 172.21.15.39:0/1683584052 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc0078f0 con 0x7f4d0406dc70 2024-05-14T14:40:44.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.069+0000 7f4d0978d640 1 -- 172.21.15.39:0/1683584052 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4d0406dc70 msgr2=0x7f4d0416b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:44.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.069+0000 7f4d0978d640 1 --2- 172.21.15.39:0/1683584052 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4d0406dc70 0x7f4d0416b130 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc009dc0 tx=0x7f4cfc02a660 comp rx=0 tx=0).stop 2024-05-14T14:40:44.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.069+0000 7f4d0978d640 1 -- 172.21.15.39:0/1683584052 shutdown_connections 2024-05-14T14:40:44.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.069+0000 7f4d0978d640 1 --2- 172.21.15.39:0/1683584052 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4d0406dc70 0x7f4d0416b130 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:44.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.069+0000 7f4d0978d640 1 -- 172.21.15.39:0/1683584052 >> 172.21.15.39:0/1683584052 conn(0x7f4d040d6670 msgr2=0x7f4d040d2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:44.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.069+0000 7f4d0978d640 1 -- 172.21.15.39:0/1683584052 shutdown_connections 2024-05-14T14:40:44.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.070+0000 7f4d0978d640 1 -- 172.21.15.39:0/1683584052 wait complete. 2024-05-14T14:40:44.055 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.071+0000 7f4d0978d640 1 Processor -- start 2024-05-14T14:40:44.056 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.072+0000 7f4d0978d640 1 -- start start 2024-05-14T14:40:44.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.073+0000 7f4d0978d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4d0406dc70 0x7f4d04160700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:44.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.073+0000 7f4d0978d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d040b4820 0x7f4d04150e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:44.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.073+0000 7f4d0978d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d041602f0 0x7f4d04154500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:44.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.073+0000 7f4d0978d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4d040d5580 con 0x7f4d041602f0 2024-05-14T14:40:44.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.073+0000 7f4d0978d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0406c7d0 con 0x7f4d040b4820 2024-05-14T14:40:44.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.073+0000 7f4d0978d640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f4d0416b670 con 0x7f4d0406dc70 2024-05-14T14:40:44.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.073+0000 7f4d037fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d041602f0 0x7f4d04154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:44.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.073+0000 7f4d037fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d041602f0 0x7f4d04154500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51484/0 (socket says 172.21.15.39:51484) 2024-05-14T14:40:44.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.073+0000 7f4d037fe640 1 -- 172.21.15.39:0/3167079345 learned_addr learned my addr 172.21.15.39:0/3167079345 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:44.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.073+0000 7f4d02ffd640 1 --2- 172.21.15.39:0/3167079345 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4d0406dc70 0x7f4d04160700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:44.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.073+0000 7f4d027fc640 1 --2- 172.21.15.39:0/3167079345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d040b4820 0x7f4d04150e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:44.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.073+0000 7f4d037fe640 1 -- 172.21.15.39:0/3167079345 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4d0406dc70 msgr2=0x7f4d04160700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:44.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.073+0000 7f4d037fe640 1 --2- 172.21.15.39:0/3167079345 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4d0406dc70 0x7f4d04160700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:44.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.073+0000 7f4d037fe640 1 -- 172.21.15.39:0/3167079345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d040b4820 msgr2=0x7f4d04150e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:44.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.073+0000 7f4d037fe640 1 --2- 172.21.15.39:0/3167079345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d040b4820 0x7f4d04150e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:44.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.073+0000 7f4d037fe640 1 -- 172.21.15.39:0/3167079345 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d04160f50 con 0x7f4d041602f0 2024-05-14T14:40:44.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.074+0000 7f4d037fe640 1 --2- 172.21.15.39:0/3167079345 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d041602f0 0x7f4d04154500 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc009ee0 tx=0x7f4cfc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:44.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.074+0000 7f4ceb7fe640 1 -- 172.21.15.39:0/3167079345 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc009450 con 0x7f4d041602f0 2024-05-14T14:40:44.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.074+0000 7f4ceb7fe640 1 -- 172.21.15.39:0/3167079345 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cfc004240 con 0x7f4d041602f0 2024-05-14T14:40:44.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.074+0000 7f4d0978d640 1 -- 172.21.15.39:0/3167079345 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d04161230 con 0x7f4d041602f0 2024-05-14T14:40:44.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.074+0000 7f4ceb7fe640 1 -- 172.21.15.39:0/3167079345 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc0045f0 con 0x7f4d041602f0 2024-05-14T14:40:44.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.074+0000 7f4d0978d640 1 -- 172.21.15.39:0/3167079345 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d041617f0 con 0x7f4d041602f0 2024-05-14T14:40:44.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.075+0000 7f4d0978d640 1 -- 172.21.15.39:0/3167079345 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d04076aa0 con 0x7f4d041602f0 2024-05-14T14:40:44.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.076+0000 7f4ceb7fe640 1 -- 172.21.15.39:0/3167079345 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4cfc039040 con 0x7f4d041602f0 2024-05-14T14:40:44.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.076+0000 7f4ceb7fe640 1 --2- 172.21.15.39:0/3167079345 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4cf00762d0 0x7f4cf00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:44.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.076+0000 7f4ceb7fe640 1 -- 172.21.15.39:0/3167079345 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4cfc0b8e90 con 0x7f4d041602f0 2024-05-14T14:40:44.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.076+0000 7f4d02ffd640 1 --2- 172.21.15.39:0/3167079345 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4cf00762d0 0x7f4cf00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:44.061 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.077+0000 7f4d02ffd640 1 --2- 172.21.15.39:0/3167079345 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4cf00762d0 0x7f4cf00787e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4001120 tx=0x7f4cf4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:44.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.081+0000 7f4ceb7fe640 1 -- 172.21.15.39:0/3167079345 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4cfc040030 con 0x7f4d041602f0 2024-05-14T14:40:44.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.314+0000 7f4d0978d640 1 -- 172.21.15.39:0/3167079345 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4d04160ce0 con 0x7f4d041602f0 2024-05-14T14:40:44.298 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.315+0000 7f4ceb7fe640 1 -- 172.21.15.39:0/3167079345 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f4cfc082420 con 0x7f4d041602f0 2024-05-14T14:40:44.299 INFO:teuthology.orchestra.run.smithi039.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-14T14:40:44.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.317+0000 7f4d0978d640 1 -- 172.21.15.39:0/3167079345 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4cf00762d0 msgr2=0x7f4cf00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:44.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.317+0000 7f4d0978d640 1 --2- 172.21.15.39:0/3167079345 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4cf00762d0 0x7f4cf00787e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4001120 tx=0x7f4cf4009040 comp rx=0 tx=0).stop 2024-05-14T14:40:44.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.317+0000 7f4d0978d640 1 -- 172.21.15.39:0/3167079345 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d041602f0 msgr2=0x7f4d04154500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:44.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.317+0000 7f4d0978d640 1 --2- 172.21.15.39:0/3167079345 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d041602f0 0x7f4d04154500 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc009ee0 tx=0x7f4cfc004a40 comp rx=0 tx=0).stop 2024-05-14T14:40:44.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.317+0000 7f4d0978d640 1 -- 172.21.15.39:0/3167079345 shutdown_connections 2024-05-14T14:40:44.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.317+0000 7f4d0978d640 1 --2- 172.21.15.39:0/3167079345 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4cf00762d0 0x7f4cf00787e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:44.301 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.317+0000 7f4d0978d640 1 --2- 172.21.15.39:0/3167079345 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4d041602f0 0x7f4d04154500 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:44.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.317+0000 7f4d0978d640 1 --2- 172.21.15.39:0/3167079345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4d040b4820 0x7f4d04150e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:44.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.317+0000 7f4d0978d640 1 --2- 172.21.15.39:0/3167079345 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4d0406dc70 0x7f4d04160700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:44.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.317+0000 7f4d0978d640 1 -- 172.21.15.39:0/3167079345 >> 172.21.15.39:0/3167079345 conn(0x7f4d040d6670 msgr2=0x7f4d040d0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:44.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.317+0000 7f4d0978d640 1 -- 172.21.15.39:0/3167079345 shutdown_connections 2024-05-14T14:40:44.302 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:44.317+0000 7f4d0978d640 1 -- 172.21.15.39:0/3167079345 wait complete. 2024-05-14T14:40:44.312 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-14T14:40:44.312 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-14T14:40:44.312 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi062.front.sepia.ceph.com 2024-05-14T14:40:44.312 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-05-14T14:40:44.312 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-05-14T14:40:44.312 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-14T14:40:44.312 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-14T14:40:44.312 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-14T14:40:44.312 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-05-14T14:40:44.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:44.313 DEBUG:teuthology.orchestra.run.smithi062:> ip addr 2024-05-14T14:40:44.330 INFO:teuthology.orchestra.run.smithi062.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-14T14:40:44.330 INFO:teuthology.orchestra.run.smithi062.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-14T14:40:44.330 INFO:teuthology.orchestra.run.smithi062.stdout: inet 127.0.0.1/8 scope host lo 2024-05-14T14:40:44.330 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:40:44.330 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 ::1/128 scope host 2024-05-14T14:40:44.330 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:40:44.331 INFO:teuthology.orchestra.run.smithi062.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T14:40:44.331 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:14 brd ff:ff:ff:ff:ff:ff 2024-05-14T14:40:44.331 INFO:teuthology.orchestra.run.smithi062.stdout: altname enp7s0f0 2024-05-14T14:40:44.331 INFO:teuthology.orchestra.run.smithi062.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T14:40:44.331 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:15 brd ff:ff:ff:ff:ff:ff 2024-05-14T14:40:44.331 INFO:teuthology.orchestra.run.smithi062.stdout: altname enp7s0f1 2024-05-14T14:40:44.331 INFO:teuthology.orchestra.run.smithi062.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T14:40:44.331 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c2 brd ff:ff:ff:ff:ff:ff 2024-05-14T14:40:44.331 INFO:teuthology.orchestra.run.smithi062.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-14T14:40:44.331 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c3 brd ff:ff:ff:ff:ff:ff 2024-05-14T14:40:44.331 INFO:teuthology.orchestra.run.smithi062.stdout: inet 172.21.15.62/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-05-14T14:40:44.331 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft 42661sec preferred_lft 42661sec 2024-05-14T14:40:44.331 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::ec4:7aff:febb:d1c3/64 scope link 2024-05-14T14:40:44.331 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:40:44.331 INFO:teuthology.orchestra.run.smithi062.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-14T14:40:44.332 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether d6:1b:f7:73:56:af brd ff:ff:ff:ff:ff:ff 2024-05-14T14:40:44.332 INFO:teuthology.orchestra.run.smithi062.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-14T14:40:44.332 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:40:44.332 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::d4be:e4ff:fe0d:5a48/64 scope link 2024-05-14T14:40:44.332 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:40:44.332 INFO:teuthology.orchestra.run.smithi062.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-14T14:40:44.332 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether d6:1b:f7:73:56:af brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-14T14:40:44.332 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::d41b:f7ff:fe73:56af/64 scope link tentative 2024-05-14T14:40:44.332 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:40:44.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:44.333 DEBUG:teuthology.orchestra.run.smithi062:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-14T14:40:44.395 INFO:teuthology.orchestra.run.smithi062.stdout:1 2024-05-14T14:40:44.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:44.397 DEBUG:teuthology.orchestra.run.smithi062:> route 2024-05-14T14:40:44.454 INFO:teuthology.orchestra.run.smithi062.stdout:Kernel IP routing table 2024-05-14T14:40:44.454 INFO:teuthology.orchestra.run.smithi062.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-14T14:40:44.454 INFO:teuthology.orchestra.run.smithi062.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-14T14:40:44.454 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-14T14:40:44.454 INFO:teuthology.orchestra.run.smithi062.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-14T14:40:44.455 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T14:40:44.455 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2024-05-14T14:40:44.455 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-14T14:40:44.455 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-14T14:40:44.455 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-14T14:40:44.455 DEBUG:teuthology.orchestra.run.smithi062:> ') 2024-05-14T14:40:44.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:40:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T14:40:44.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:40:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:40:44.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:44.584 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list 2024-05-14T14:40:44.600 INFO:teuthology.orchestra.run.smithi062.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-14T14:40:44.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:44.600 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list-id 2024-05-14T14:40:44.656 INFO:teuthology.orchestra.run.smithi062.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-05-14T14:40:44.656 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T14:40:44.656 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2024-05-14T14:40:44.656 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-05-14T14:40:44.656 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-05-14T14:40:44.657 DEBUG:teuthology.orchestra.run.smithi062:> ') 2024-05-14T14:40:44.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:40:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T14:40:44.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:40:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:40:44.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:44.776 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-14T14:40:44.802 INFO:teuthology.orchestra.run.smithi062.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-14T14:40:44.802 INFO:teuthology.orchestra.run.smithi062.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-14T14:40:44.802 INFO:teuthology.orchestra.run.smithi062.stdout: inet 127.0.0.1/8 scope host lo 2024-05-14T14:40:44.802 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:40:44.803 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 ::1/128 scope host 2024-05-14T14:40:44.803 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:40:44.803 INFO:teuthology.orchestra.run.smithi062.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-14T14:40:44.803 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 12:48:bc:8c:bf:31 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-14T14:40:44.803 INFO:teuthology.orchestra.run.smithi062.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-14T14:40:44.803 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:40:44.804 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::1048:bcff:fe8c:bf31/64 scope link 2024-05-14T14:40:44.804 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:40:44.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:44.805 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-05-14T14:40:44.870 INFO:teuthology.orchestra.run.smithi062.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-14T14:40:44.871 INFO:teuthology.orchestra.run.smithi062.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-14T14:40:44.871 INFO:teuthology.orchestra.run.smithi062.stdout: inet 127.0.0.1/8 scope host lo 2024-05-14T14:40:44.871 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:40:44.871 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 ::1/128 scope host 2024-05-14T14:40:44.871 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:40:44.871 INFO:teuthology.orchestra.run.smithi062.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-14T14:40:44.871 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 12:48:bc:8c:bf:31 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-05-14T14:40:44.871 INFO:teuthology.orchestra.run.smithi062.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-05-14T14:40:44.871 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:40:44.871 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::1048:bcff:fe8c:bf31/64 scope link 2024-05-14T14:40:44.871 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:40:44.872 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-05-14T14:40:44.872 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T14:40:44.873 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2024-05-14T14:40:44.873 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-05-14T14:40:44.873 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-05-14T14:40:44.873 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-05-14T14:40:44.873 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-05-14T14:40:44.873 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-05-14T14:40:44.873 DEBUG:teuthology.orchestra.run.smithi062:> ') 2024-05-14T14:40:44.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:40:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T14:40:45.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:40:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:40:45.030 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T14:40:45.031 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2024-05-14T14:40:45.031 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set brx.1 up 2024-05-14T14:40:45.031 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set dev brx.1 master ceph-brx 2024-05-14T14:40:45.031 DEBUG:teuthology.orchestra.run.smithi062:> ') 2024-05-14T14:40:45.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:40:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T14:40:45.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:40:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:40:45.112 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T14:40:45.112 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-05-14T14:40:45.128 INFO:teuthology.orchestra.run.smithi062.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-05-14T14:40:45.128 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T14:40:45.128 DEBUG:teuthology.orchestra.run.smithi062:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-05-14T14:40:45.184 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-05-14T14:40:45.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:45.184 DEBUG:teuthology.orchestra.run.smithi062:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-14T14:40:45.280 INFO:teuthology.orchestra.run.smithi062.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-14T14:40:45.280 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-14T14:40:45.291 INFO:teuthology.orchestra.run.smithi062.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-14T14:40:45.291 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-14T14:40:45.291 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.62:3300,172.21.15.62:3301" 2024-05-14T14:40:45.291 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: trying mount with new device syntax: 3@d7983fec-79c7-4991-b19c-1aecead64611.cephfs=/ 2024-05-14T14:40:45.292 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.39:3300/172.21.15.62:3300/172.21.15.62:3301" will pass to kernel 2024-05-14T14:40:45.292 INFO:teuthology.orchestra.run.smithi062.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-05-14T14:40:45.292 INFO:teuthology.orchestra.run.smithi062.stdout: You just mounted a file system that supports labels which does not 2024-05-14T14:40:45.292 INFO:teuthology.orchestra.run.smithi062.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-14T14:40:45.292 INFO:teuthology.orchestra.run.smithi062.stdout: applications will generate AVC messages and not be allowed access to 2024-05-14T14:40:45.292 INFO:teuthology.orchestra.run.smithi062.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-14T14:40:45.293 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-14T14:40:45.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:45.294 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-05-14T14:40:45.319 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-14T14:40:45.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:40:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-14T14:40:45.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:40:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:40:45.418 INFO:teuthology.orchestra.run.smithi062.stdout:client4728 2024-05-14T14:40:45.419 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-14T14:40:45.419 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T14:40:45.436 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-14T14:40:45.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:40:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-14T14:40:45.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:40:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:40:45.534 INFO:teuthology.orchestra.run.smithi062.stdout:client4728 2024-05-14T14:40:45.534 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-14T14:40:45.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:40:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-14T14:40:45.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:40:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:40:45.592 INFO:teuthology.orchestra.run.smithi062.stdout:client4728 2024-05-14T14:40:45.592 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/d7983fec-79c7-4991-b19c-1aecead64611.client4728/status') 2024-05-14T14:40:45.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:40:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T14:40:45.654 INFO:teuthology.orchestra.run.smithi062.stdout:instance: client.4728 (3)172.21.15.62:0/380393474 2024-05-14T14:40:45.654 INFO:teuthology.orchestra.run.smithi062.stdout:blocklisted: false 2024-05-14T14:40:45.654 INFO:teuthology.orchestra.run.smithi062.stderr:0+1 records in 2024-05-14T14:40:45.654 INFO:teuthology.orchestra.run.smithi062.stderr:0+1 records out 2024-05-14T14:40:45.654 INFO:teuthology.orchestra.run.smithi062.stderr:69 bytes copied, 2.8672e-05 s, 2.4 MB/s 2024-05-14T14:40:45.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-05-14T14:40:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:40:45.661 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-05-14T14:40:45.694 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-05-14T14:40:45.694 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T14:40:45.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.840+0000 7f30bb0e9640 1 Processor -- start 2024-05-14T14:40:45.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.840+0000 7f30bb0e9640 1 -- start start 2024-05-14T14:40:45.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.841+0000 7f30bb0e9640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f30b40ce590 0x7f30b415e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:45.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.841+0000 7f30bb0e9640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30b4161c20 0x7f30b40b6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:45.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.842+0000 7f30bb0e9640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30b40b7420 con 0x7f30b40d0200 2024-05-14T14:40:45.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.842+0000 7f30bb0e9640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f30b40d2490 con 0x7f30b40ce590 2024-05-14T14:40:45.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.842+0000 7f30bb0e9640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f30b40d2770 con 0x7f30b4161c20 2024-05-14T14:40:45.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.842+0000 7f30b8e85640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f30b40ce590 0x7f30b415e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:45.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.842+0000 7f30b8e85640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f30b40ce590 0x7f30b415e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51500/0 (socket says 172.21.15.39:51500) 2024-05-14T14:40:45.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.842+0000 7f30b8e85640 1 -- 172.21.15.39:0/1929679798 learned_addr learned my addr 172.21.15.39:0/1929679798 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:45.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.842+0000 7f30b3fff640 1 --2- 172.21.15.39:0/1929679798 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30b4161c20 0x7f30b40b6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:45.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.842+0000 7f30b8e85640 1 -- 172.21.15.39:0/1929679798 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30b4161c20 msgr2=0x7f30b40b6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:45.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.842+0000 7f30b8e85640 1 --2- 172.21.15.39:0/1929679798 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30b4161c20 0x7f30b40b6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:45.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.842+0000 7f30b8e85640 1 -- 172.21.15.39:0/1929679798 >> v1:172.21.15.62:6789/0 conn(0x7f30b40d0200 legacy=0x7f30b40d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:45.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.842+0000 7f30b8e85640 1 -- 172.21.15.39:0/1929679798 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b4162400 con 0x7f30b40ce590 2024-05-14T14:40:45.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.842+0000 7f30b3fff640 1 --2- 172.21.15.39:0/1929679798 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30b4161c20 0x7f30b40b6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:40:45.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.843+0000 7f30b8e85640 1 --2- 172.21.15.39:0/1929679798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30b40ce590 0x7f30b415e030 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f30a4009870 tx=0x7f30a402a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d42f9affb2173824 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:45.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.843+0000 7f30b37fe640 1 -- 172.21.15.39:0/1929679798 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4037070 con 0x7f30b40ce590 2024-05-14T14:40:45.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.843+0000 7f30b37fe640 1 -- 172.21.15.39:0/1929679798 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a4032440 con 0x7f30b40ce590 2024-05-14T14:40:45.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.843+0000 7f30b37fe640 1 -- 172.21.15.39:0/1929679798 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4032810 con 0x7f30b40ce590 2024-05-14T14:40:45.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.844+0000 7f30bb0e9640 1 -- 172.21.15.39:0/1929679798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30b40ce590 msgr2=0x7f30b415e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:45.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.844+0000 7f30bb0e9640 1 --2- 172.21.15.39:0/1929679798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30b40ce590 0x7f30b415e030 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f30a4009870 tx=0x7f30a402a130 comp rx=0 tx=0).stop 2024-05-14T14:40:45.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.844+0000 7f30bb0e9640 1 -- 172.21.15.39:0/1929679798 shutdown_connections 2024-05-14T14:40:45.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.844+0000 7f30bb0e9640 1 --2- 172.21.15.39:0/1929679798 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30b4161c20 0x7f30b40b6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:45.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.844+0000 7f30bb0e9640 1 --2- 172.21.15.39:0/1929679798 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30b40ce590 0x7f30b415e030 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:45.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.844+0000 7f30bb0e9640 1 -- 172.21.15.39:0/1929679798 >> 172.21.15.39:0/1929679798 conn(0x7f30b4071660 msgr2=0x7f30b4071a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:45.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.844+0000 7f30bb0e9640 1 -- 172.21.15.39:0/1929679798 shutdown_connections 2024-05-14T14:40:45.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.844+0000 7f30bb0e9640 1 -- 172.21.15.39:0/1929679798 wait complete. 2024-05-14T14:40:45.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.846+0000 7f30bb0e9640 1 Processor -- start 2024-05-14T14:40:45.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.846+0000 7f30bb0e9640 1 -- start start 2024-05-14T14:40:45.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.847+0000 7f30bb0e9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30b40ce590 0x7f30b41e9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:45.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.847+0000 7f30bb0e9640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30b40d0200 0x7f30b40c6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:45.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.847+0000 7f30bb0e9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30b4161c20 0x7f30b4155120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:45.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.847+0000 7f30bb0e9640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f30b41629c0 con 0x7f30b4161c20 2024-05-14T14:40:45.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.847+0000 7f30bb0e9640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f30b415e570 con 0x7f30b40ce590 2024-05-14T14:40:45.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.847+0000 7f30bb0e9640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f30b4162030 con 0x7f30b40d0200 2024-05-14T14:40:45.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.847+0000 7f30b9686640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30b4161c20 0x7f30b4155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:45.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.847+0000 7f30b9686640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30b4161c20 0x7f30b4155120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51512/0 (socket says 172.21.15.39:51512) 2024-05-14T14:40:45.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.847+0000 7f30b9686640 1 -- 172.21.15.39:0/4128670732 learned_addr learned my addr 172.21.15.39:0/4128670732 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:45.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.848+0000 7f30b3fff640 1 --2- 172.21.15.39:0/4128670732 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30b40d0200 0x7f30b40c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:45.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.848+0000 7f30b8e85640 1 --2- 172.21.15.39:0/4128670732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30b40ce590 0x7f30b41e9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:45.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.848+0000 7f30b9686640 1 -- 172.21.15.39:0/4128670732 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30b40d0200 msgr2=0x7f30b40c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:45.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.848+0000 7f30b9686640 1 --2- 172.21.15.39:0/4128670732 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30b40d0200 0x7f30b40c6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:45.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.848+0000 7f30b9686640 1 -- 172.21.15.39:0/4128670732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30b40ce590 msgr2=0x7f30b41e9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:45.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.848+0000 7f30b9686640 1 --2- 172.21.15.39:0/4128670732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30b40ce590 0x7f30b41e9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:45.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.848+0000 7f30b9686640 1 -- 172.21.15.39:0/4128670732 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b41e99c0 con 0x7f30b4161c20 2024-05-14T14:40:45.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.848+0000 7f30b9686640 1 --2- 172.21.15.39:0/4128670732 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30b4161c20 0x7f30b4155120 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f30ac00b9a0 tx=0x7f30ac00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:45.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.848+0000 7f30b17fa640 1 -- 172.21.15.39:0/4128670732 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ac019070 con 0x7f30b4161c20 2024-05-14T14:40:45.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.848+0000 7f30b17fa640 1 -- 172.21.15.39:0/4128670732 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30ac00cba0 con 0x7f30b4161c20 2024-05-14T14:40:45.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.848+0000 7f30b17fa640 1 -- 172.21.15.39:0/4128670732 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ac014440 con 0x7f30b4161c20 2024-05-14T14:40:45.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.848+0000 7f30bb0e9640 1 -- 172.21.15.39:0/4128670732 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30b40c6c70 con 0x7f30b4161c20 2024-05-14T14:40:45.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.848+0000 7f30bb0e9640 1 -- 172.21.15.39:0/4128670732 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30b4157f30 con 0x7f30b4161c20 2024-05-14T14:40:45.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.849+0000 7f30bb0e9640 1 -- 172.21.15.39:0/4128670732 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30b41579a0 con 0x7f30b4161c20 2024-05-14T14:40:45.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.850+0000 7f30b17fa640 1 -- 172.21.15.39:0/4128670732 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f30ac01c070 con 0x7f30b4161c20 2024-05-14T14:40:45.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.851+0000 7f30b17fa640 1 --2- 172.21.15.39:0/4128670732 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f30a0076300 0x7f30a0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:45.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.851+0000 7f30b8e85640 1 --2- 172.21.15.39:0/4128670732 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f30a0076300 0x7f30a0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:45.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.851+0000 7f30b17fa640 1 -- 172.21.15.39:0/4128670732 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f30ac097560 con 0x7f30b4161c20 2024-05-14T14:40:45.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.851+0000 7f30b8e85640 1 --2- 172.21.15.39:0/4128670732 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f30a0076300 0x7f30a0078810 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f30a4034000 tx=0x7f30a402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:45.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:45.855+0000 7f30b17fa640 1 -- 172.21.15.39:0/4128670732 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f30ac060b80 con 0x7f30b4161c20 2024-05-14T14:40:46.031 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.048+0000 7f30bb0e9640 1 -- 172.21.15.39:0/4128670732 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f30b4076aa0 con 0x7f30b4161c20 2024-05-14T14:40:46.033 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.049+0000 7f30b17fa640 1 -- 172.21.15.39:0/4128670732 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18454 (secure 0 0 0) 0x7f30ac060480 con 0x7f30b4161c20 2024-05-14T14:40:46.033 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:40:46.033 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"fsid":"d7983fec-79c7-4991-b19c-1aecead64611","created":"2024-05-14T14:39:52.157167+0000","modified":"2024-05-14T14:40:20.397684+0000","last_up_change":"2024-05-14T14:40:03.848608+0000","last_in_change":"2024-05-14T14:39:54.591920+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T14:40:04.692846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T14:40:13.794415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T14:40:14.273154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T14:40:17.979457+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c4ec4534-6301-4dd7-b4d6-d560b096d442","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6801","nonce":4023478848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6803","nonce":4023478848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6807","nonce":4023478848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6805","nonce":4023478848}]},"public_addr":"172.21.15.39:6801/4023478848","cluster_addr":"172.21.15.39:6803/4023478848","heartbeat_back_addr":"172.21.15.39:6807/4023478848","heartbeat_front_addr":"172.21.15.39:6805/4023478848","state":["exists","up"]},{"osd":1,"uuid":"93f91b0e-096e-4bdf-aed0-d1136f73f136","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6817","nonce":926357398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6819","nonce":926357398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6823","nonce":926357398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6821","nonce":926357398}]},"public_addr":"172.21.15.39:6817/926357398","cluster_addr":"172.21.15.39:6819/926357398","heartbeat_back_addr":"172.21.15.39:6823/926357398","heartbeat_front_addr":"172.21.15.39:6821/926357398","state":["exists","up"]},{"osd":2,"uuid":"c590b1e0-67eb-452e-8e80-d2208da17d09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6809","nonce":610616754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6811","nonce":610616754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6815","nonce":610616754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6813","nonce":610616754}]},"public_addr":"172.21.15.39:6809/610616754","cluster_addr":"172.21.15.39:6811/610616754","heartbeat_back_addr":"172.21.15.39:6815/610616754","heartbeat_front_addr":"172.21.15.39:6813/610616754","state":["exists","up"]},{"osd":3,"uuid":"d57661b0-44f6-4355-9115-83eceb9b8f71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6825","nonce":1469314579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6827","nonce":1469314579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6831","nonce":1469314579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6829","nonce":1469314579}]},"public_addr":"172.21.15.39:6825/1469314579","cluster_addr":"172.21.15.39:6827/1469314579","heartbeat_back_addr":"172.21.15.39:6831/1469314579","heartbeat_front_addr":"172.21.15.39:6829/1469314579","state":["exists","up"]},{"osd":4,"uuid":"b131436f-f6e1-4d72-a86e-de200afdcebb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6825","nonce":3481507129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6827","nonce":3481507129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6831","nonce":3481507129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6829","nonce":3481507129}]},"public_addr":"172.21.15.62:6825/3481507129","cluster_addr":"172.21.15.62:6827/3481507129","heartbeat_back_addr":"172.21.15.62:6831/3481507129","heartbeat_front_addr":"172.21.15.62:6829/3481507129","state":["exists","up"]},{"osd":5,"uuid":"12e10b40-28b1-410f-9ce0-7b427daa111e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6801","nonce":3291934116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6803","nonce":3291934116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6807","nonce":3291934116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6805","nonce":3291934116}]},"public_addr":"172.21.15.62:6801/3291934116","cluster_addr":"172.21.15.62:6803/3291934116","heartbeat_back_addr":"172.21.15.62:6807/3291934116","heartbeat_front_addr":"172.21.15.62:6805/3291934116","state":["exists","up"]},{"osd":6,"uuid":"ad8950a5-70bd-488c-8f29-010515cc4a04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6817","nonce":3005996101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6819","nonce":3005996101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6823","nonce":3005996101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6821","nonce":3005996101}]},"public_addr":"172.21.15.62:6817/3005996101","cluster_addr":"172.21.15.62:6819/3005996101","heartbeat_back_addr":"172.21.15.62:6823/3005996101","heartbeat_front_addr":"172.21.15.62:6821/3005996101","state":["exists","up"]},{"osd":7,"uuid":"e0d4b8b7-3c80-4760-a342-1d508cdecc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6809","nonce":2800379225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6811","nonce":2800379225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6815","nonce":2800379225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6813","nonce":2800379225}]},"public_addr":"172.21.15.62:6809/2800379225","cluster_addr":"172.21.15.62:6811/2800379225","heartbeat_back_addr":"172.21.15.62:6815/2800379225","heartbeat_front_addr":"172.21.15.62:6813/2800379225","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.773714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.760037+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.811225+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.752810+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.745165+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.700634+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.768477+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.747301+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T14:40:46.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.051+0000 7f30bb0e9640 1 -- 172.21.15.39:0/4128670732 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f30a0076300 msgr2=0x7f30a0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:46.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.051+0000 7f30bb0e9640 1 --2- 172.21.15.39:0/4128670732 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f30a0076300 0x7f30a0078810 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f30a4034000 tx=0x7f30a402e000 comp rx=0 tx=0).stop 2024-05-14T14:40:46.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.051+0000 7f30bb0e9640 1 -- 172.21.15.39:0/4128670732 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30b4161c20 msgr2=0x7f30b4155120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:46.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.051+0000 7f30bb0e9640 1 --2- 172.21.15.39:0/4128670732 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30b4161c20 0x7f30b4155120 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f30ac00b9a0 tx=0x7f30ac00be60 comp rx=0 tx=0).stop 2024-05-14T14:40:46.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.051+0000 7f30bb0e9640 1 -- 172.21.15.39:0/4128670732 shutdown_connections 2024-05-14T14:40:46.035 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.051+0000 7f30bb0e9640 1 --2- 172.21.15.39:0/4128670732 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f30a0076300 0x7f30a0078810 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:46.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.051+0000 7f30bb0e9640 1 --2- 172.21.15.39:0/4128670732 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f30b4161c20 0x7f30b4155120 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:46.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.051+0000 7f30bb0e9640 1 --2- 172.21.15.39:0/4128670732 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f30b40d0200 0x7f30b40c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:46.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.051+0000 7f30bb0e9640 1 --2- 172.21.15.39:0/4128670732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30b40ce590 0x7f30b41e9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:46.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.051+0000 7f30bb0e9640 1 -- 172.21.15.39:0/4128670732 >> 172.21.15.39:0/4128670732 conn(0x7f30b4071660 msgr2=0x7f30b40d0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:46.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.051+0000 7f30bb0e9640 1 -- 172.21.15.39:0/4128670732 shutdown_connections 2024-05-14T14:40:46.036 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.051+0000 7f30bb0e9640 1 -- 172.21.15.39:0/4128670732 wait complete. 2024-05-14T14:40:46.047 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-14T14:40:04.692846+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-14T14:40:13.794415+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-14T14:40:14.273154+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-14T14:40:17.979457+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-14T14:40:46.047 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-14T14:40:46.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.182+0000 7fe590f57640 1 Processor -- start 2024-05-14T14:40:46.166 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.182+0000 7fe590f57640 1 -- start start 2024-05-14T14:40:46.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.184+0000 7fe590f57640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe58c0b2d30 0x7fe58c0ce520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:46.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.184+0000 7fe590f57640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe58c0d3040 0x7fe58c168d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:46.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.184+0000 7fe590f57640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe58c0b3e60 con 0x7fe58c0cea60 2024-05-14T14:40:46.168 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.184+0000 7fe590f57640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fe58c0b4f00 con 0x7fe58c0b2d30 2024-05-14T14:40:46.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.184+0000 7fe590f57640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe58c161b40 con 0x7fe58c0d3040 2024-05-14T14:40:46.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.184+0000 7fe58a59c640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe58c0b2d30 0x7fe58c0ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:46.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.184+0000 7fe58a59c640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe58c0b2d30 0x7fe58c0ce520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51522/0 (socket says 172.21.15.39:51522) 2024-05-14T14:40:46.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.184+0000 7fe58a59c640 1 -- 172.21.15.39:0/1132188814 learned_addr learned my addr 172.21.15.39:0/1132188814 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:46.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.184+0000 7fe58a59c640 1 -- 172.21.15.39:0/1132188814 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe58c0d3040 msgr2=0x7fe58c168d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:46.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.184+0000 7fe58ad9d640 1 --2- 172.21.15.39:0/1132188814 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe58c0d3040 0x7fe58c168d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:46.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.184+0000 7fe58a59c640 1 --2- 172.21.15.39:0/1132188814 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe58c0d3040 0x7fe58c168d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:46.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.184+0000 7fe58a59c640 1 -- 172.21.15.39:0/1132188814 >> v1:172.21.15.62:6789/0 conn(0x7fe58c0cea60 legacy=0x7fe58c0d2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:46.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.184+0000 7fe58a59c640 1 -- 172.21.15.39:0/1132188814 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe58c0b4140 con 0x7fe58c0b2d30 2024-05-14T14:40:46.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.185+0000 7fe58a59c640 1 --2- 172.21.15.39:0/1132188814 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe58c0b2d30 0x7fe58c0ce520 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe58c0b36f0 tx=0x7fe57c02a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b57eaf564a6efc2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:46.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.185+0000 7fe58959a640 1 -- 172.21.15.39:0/1132188814 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57c036070 con 0x7fe58c0b2d30 2024-05-14T14:40:46.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.185+0000 7fe58959a640 1 -- 172.21.15.39:0/1132188814 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe57c031600 con 0x7fe58c0b2d30 2024-05-14T14:40:46.170 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.185+0000 7fe58959a640 1 -- 172.21.15.39:0/1132188814 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57c02ae60 con 0x7fe58c0b2d30 2024-05-14T14:40:46.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.186+0000 7fe590f57640 1 -- 172.21.15.39:0/1132188814 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe58c0b2d30 msgr2=0x7fe58c0ce520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:46.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.186+0000 7fe590f57640 1 --2- 172.21.15.39:0/1132188814 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe58c0b2d30 0x7fe58c0ce520 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe58c0b36f0 tx=0x7fe57c02a640 comp rx=0 tx=0).stop 2024-05-14T14:40:46.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.186+0000 7fe590f57640 1 -- 172.21.15.39:0/1132188814 shutdown_connections 2024-05-14T14:40:46.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.186+0000 7fe590f57640 1 --2- 172.21.15.39:0/1132188814 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe58c0d3040 0x7fe58c168d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:46.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.186+0000 7fe590f57640 1 --2- 172.21.15.39:0/1132188814 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe58c0b2d30 0x7fe58c0ce520 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:46.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.186+0000 7fe590f57640 1 -- 172.21.15.39:0/1132188814 >> 172.21.15.39:0/1132188814 conn(0x7fe58c09b5f0 msgr2=0x7fe58c09ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:46.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.186+0000 7fe590f57640 1 -- 172.21.15.39:0/1132188814 shutdown_connections 2024-05-14T14:40:46.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.186+0000 7fe590f57640 1 -- 172.21.15.39:0/1132188814 wait complete. 2024-05-14T14:40:46.171 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.188+0000 7fe590f57640 1 Processor -- start 2024-05-14T14:40:46.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.188+0000 7fe590f57640 1 -- start start 2024-05-14T14:40:46.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.189+0000 7fe590f57640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe58c0b2d30 0x7fe58c15c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:46.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.189+0000 7fe590f57640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe58c0cea60 0x7fe58c071b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:46.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.189+0000 7fe590f57640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe58c0d3040 0x7fe58c0cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:46.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.189+0000 7fe590f57640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe58c0b4700 con 0x7fe58c0b2d30 2024-05-14T14:40:46.174 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.189+0000 7fe590f57640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe58c0b3c10 con 0x7fe58c0cea60 2024-05-14T14:40:46.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.189+0000 7fe590f57640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe58c0b49e0 con 0x7fe58c0d3040 2024-05-14T14:40:46.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.189+0000 7fe58a59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe58c0b2d30 0x7fe58c15c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:46.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.189+0000 7fe58a59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe58c0b2d30 0x7fe58c15c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51536/0 (socket says 172.21.15.39:51536) 2024-05-14T14:40:46.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.189+0000 7fe58a59c640 1 -- 172.21.15.39:0/1584340888 learned_addr learned my addr 172.21.15.39:0/1584340888 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:46.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.189+0000 7fe58ad9d640 1 --2- 172.21.15.39:0/1584340888 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe58c0d3040 0x7fe58c0cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:46.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.189+0000 7fe589d9b640 1 --2- 172.21.15.39:0/1584340888 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe58c0cea60 0x7fe58c071b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:46.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.190+0000 7fe58a59c640 1 -- 172.21.15.39:0/1584340888 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe58c0d3040 msgr2=0x7fe58c0cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:46.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.190+0000 7fe58a59c640 1 --2- 172.21.15.39:0/1584340888 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe58c0d3040 0x7fe58c0cbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:46.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.190+0000 7fe58a59c640 1 -- 172.21.15.39:0/1584340888 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe58c0cea60 msgr2=0x7fe58c071b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:46.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.190+0000 7fe58a59c640 1 --2- 172.21.15.39:0/1584340888 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe58c0cea60 0x7fe58c071b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:46.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.190+0000 7fe58a59c640 1 -- 172.21.15.39:0/1584340888 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe58c072060 con 0x7fe58c0b2d30 2024-05-14T14:40:46.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.190+0000 7fe589d9b640 1 --2- 172.21.15.39:0/1584340888 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe58c0cea60 0x7fe58c071b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:40:46.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.190+0000 7fe58a59c640 1 --2- 172.21.15.39:0/1584340888 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe58c0b2d30 0x7fe58c15c0c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe57c034040 tx=0x7fe57c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:46.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.190+0000 7fe57affd640 1 -- 172.21.15.39:0/1584340888 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57c041020 con 0x7fe58c0b2d30 2024-05-14T14:40:46.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.190+0000 7fe57affd640 1 -- 172.21.15.39:0/1584340888 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe57c02ae60 con 0x7fe58c0b2d30 2024-05-14T14:40:46.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.190+0000 7fe57affd640 1 -- 172.21.15.39:0/1584340888 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57c036040 con 0x7fe58c0b2d30 2024-05-14T14:40:46.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.190+0000 7fe590f57640 1 -- 172.21.15.39:0/1584340888 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe58c0d0820 con 0x7fe58c0b2d30 2024-05-14T14:40:46.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.190+0000 7fe590f57640 1 -- 172.21.15.39:0/1584340888 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe58c0d0de0 con 0x7fe58c0b2d30 2024-05-14T14:40:46.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.191+0000 7fe590f57640 1 -- 172.21.15.39:0/1584340888 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe58c076aa0 con 0x7fe58c0b2d30 2024-05-14T14:40:46.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.192+0000 7fe57affd640 1 -- 172.21.15.39:0/1584340888 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe57c044020 con 0x7fe58c0b2d30 2024-05-14T14:40:46.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.192+0000 7fe57affd640 1 --2- 172.21.15.39:0/1584340888 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe56c0762d0 0x7fe56c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:46.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.192+0000 7fe57affd640 1 -- 172.21.15.39:0/1584340888 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe57c0b89a0 con 0x7fe58c0b2d30 2024-05-14T14:40:46.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.192+0000 7fe589d9b640 1 --2- 172.21.15.39:0/1584340888 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe56c0762d0 0x7fe56c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:46.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.193+0000 7fe589d9b640 1 --2- 172.21.15.39:0/1584340888 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe56c0762d0 0x7fe56c0787e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe58c0b32b0 tx=0x7fe580008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:46.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.197+0000 7fe57affd640 1 -- 172.21.15.39:0/1584340888 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe57c04b020 con 0x7fe58c0b2d30 2024-05-14T14:40:46.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.386+0000 7fe590f57640 1 -- 172.21.15.39:0/1584340888 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe58c0cfa60 con 0x7fe58c0b2d30 2024-05-14T14:40:46.370 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.386+0000 7fe57affd640 1 -- 172.21.15.39:0/1584340888 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7fe57c082080 con 0x7fe58c0b2d30 2024-05-14T14:40:46.371 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 1 2024-05-14T14:40:46.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.388+0000 7fe590f57640 1 -- 172.21.15.39:0/1584340888 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe56c0762d0 msgr2=0x7fe56c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:46.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.388+0000 7fe590f57640 1 --2- 172.21.15.39:0/1584340888 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe56c0762d0 0x7fe56c0787e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe58c0b32b0 tx=0x7fe580008040 comp rx=0 tx=0).stop 2024-05-14T14:40:46.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.388+0000 7fe590f57640 1 -- 172.21.15.39:0/1584340888 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe58c0b2d30 msgr2=0x7fe58c15c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:46.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.388+0000 7fe590f57640 1 --2- 172.21.15.39:0/1584340888 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe58c0b2d30 0x7fe58c15c0c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe57c034040 tx=0x7fe57c004a40 comp rx=0 tx=0).stop 2024-05-14T14:40:46.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.388+0000 7fe590f57640 1 -- 172.21.15.39:0/1584340888 shutdown_connections 2024-05-14T14:40:46.373 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.388+0000 7fe590f57640 1 --2- 172.21.15.39:0/1584340888 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe56c0762d0 0x7fe56c0787e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:46.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.388+0000 7fe590f57640 1 --2- 172.21.15.39:0/1584340888 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe58c0d3040 0x7fe58c0cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:46.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.388+0000 7fe590f57640 1 --2- 172.21.15.39:0/1584340888 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe58c0cea60 0x7fe58c071b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:46.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.388+0000 7fe590f57640 1 --2- 172.21.15.39:0/1584340888 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe58c0b2d30 0x7fe58c15c0c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:46.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.388+0000 7fe590f57640 1 -- 172.21.15.39:0/1584340888 >> 172.21.15.39:0/1584340888 conn(0x7fe58c09b5f0 msgr2=0x7fe58c06eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:46.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.388+0000 7fe590f57640 1 -- 172.21.15.39:0/1584340888 shutdown_connections 2024-05-14T14:40:46.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.388+0000 7fe590f57640 1 -- 172.21.15.39:0/1584340888 wait complete. 2024-05-14T14:40:46.384 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-14T14:40:46.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.518+0000 7fdead18d640 1 Processor -- start 2024-05-14T14:40:46.502 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.518+0000 7fdead18d640 1 -- start start 2024-05-14T14:40:46.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.519+0000 7fdead18d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdea81603d0 0x7fdea80b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:46.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.519+0000 7fdead18d640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdea8163d70 con 0x7fdea806e760 2024-05-14T14:40:46.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.519+0000 7fdead18d640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdea8164050 con 0x7fdea80d2070 2024-05-14T14:40:46.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.519+0000 7fdead18d640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fdea80b31a0 con 0x7fdea81603d0 2024-05-14T14:40:46.509 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.520+0000 7fdea759e640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fdea806e760 0x7fdea806eb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:50488/0 (socket says 172.21.15.39:50488) 2024-05-14T14:40:46.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.520+0000 7fdea759e640 1 -- 172.21.15.39:0/3207814583 learned_addr learned my addr 172.21.15.39:0/3207814583 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:46.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.520+0000 7fdea6d9d640 1 --2- 172.21.15.39:0/3207814583 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdea81603d0 0x7fdea80b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:46.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.520+0000 7fdea5d9b640 1 -- 172.21.15.39:0/3207814583 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4132146284 0 0) 0x7fdea8163d70 con 0x7fdea806e760 2024-05-14T14:40:46.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.520+0000 7fdea5d9b640 1 -- 172.21.15.39:0/3207814583 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde90003520 con 0x7fdea806e760 2024-05-14T14:40:46.510 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.520+0000 7fdea5d9b640 1 -- 172.21.15.39:0/3207814583 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3985426852 0 0) 0x7fdea8164050 con 0x7fdea80d2070 2024-05-14T14:40:46.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.520+0000 7fdea5d9b640 1 -- 172.21.15.39:0/3207814583 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdea8163d70 con 0x7fdea80d2070 2024-05-14T14:40:46.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.520+0000 7fdea5d9b640 1 -- 172.21.15.39:0/3207814583 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1743401060 0 0) 0x7fde90003520 con 0x7fdea806e760 2024-05-14T14:40:46.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.520+0000 7fdea5d9b640 1 -- 172.21.15.39:0/3207814583 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdea81603d0 msgr2=0x7fdea80b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:46.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.520+0000 7fdea5d9b640 1 --2- 172.21.15.39:0/3207814583 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdea81603d0 0x7fdea80b2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:46.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.520+0000 7fdea5d9b640 1 -- 172.21.15.39:0/3207814583 >> v1:172.21.15.62:6789/0 conn(0x7fdea80d2070 legacy=0x7fdea80d2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:46.511 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.520+0000 7fdea5d9b640 1 -- 172.21.15.39:0/3207814583 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdea8164330 con 0x7fdea806e760 2024-05-14T14:40:46.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.520+0000 7fdea5d9b640 1 -- 172.21.15.39:0/3207814583 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1803005051 0 0) 0x7fdea00019f0 con 0x7fdea806e760 2024-05-14T14:40:46.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.520+0000 7fdea5d9b640 1 -- 172.21.15.39:0/3207814583 >> v1:172.21.15.39:6789/0 conn(0x7fdea806e760 legacy=0x7fdea806eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:46.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.520+0000 7fdea5d9b640 1 --2- 172.21.15.39:0/3207814583 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde90003c60 0x7fde90004070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:46.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.520+0000 7fdea5d9b640 1 --2- 172.21.15.39:0/3207814583 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde90004800 0x7fde90004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:46.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.520+0000 7fdea5d9b640 1 --2- 172.21.15.39:0/3207814583 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde900051c0 0x7fde9000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:46.512 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.520+0000 7fdea5d9b640 1 -- 172.21.15.39:0/3207814583 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fdea80b31a0 con 0x7fde900051c0 2024-05-14T14:40:46.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.520+0000 7fdea5d9b640 1 -- 172.21.15.39:0/3207814583 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fde9000c090 con 0x7fde90004800 2024-05-14T14:40:46.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.520+0000 7fdea5d9b640 1 -- 172.21.15.39:0/3207814583 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fde9000c290 con 0x7fde90003c60 2024-05-14T14:40:46.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.520+0000 7fdea759e640 1 --2- 172.21.15.39:0/3207814583 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde900051c0 0x7fde9000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:46.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.520+0000 7fdea6d9d640 1 --2- 172.21.15.39:0/3207814583 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde90003c60 0x7fde90004070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:46.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.520+0000 7fdea659c640 1 --2- 172.21.15.39:0/3207814583 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde90004800 0x7fde90004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:46.513 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.521+0000 7fdea759e640 1 -- 172.21.15.39:0/3207814583 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde90003c60 msgr2=0x7fde90004070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:46.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.521+0000 7fdea759e640 1 --2- 172.21.15.39:0/3207814583 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde90003c60 0x7fde90004070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:46.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.521+0000 7fdea759e640 1 -- 172.21.15.39:0/3207814583 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde90004800 msgr2=0x7fde90004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:46.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.521+0000 7fdea759e640 1 --2- 172.21.15.39:0/3207814583 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde90004800 0x7fde90004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:46.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.521+0000 7fdea759e640 1 -- 172.21.15.39:0/3207814583 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde90003520 con 0x7fde900051c0 2024-05-14T14:40:46.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.521+0000 7fdea659c640 1 --2- 172.21.15.39:0/3207814583 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde90004800 0x7fde90004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:40:46.514 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.521+0000 7fdea759e640 1 --2- 172.21.15.39:0/3207814583 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde900051c0 0x7fde9000b9c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fdea80d1610 tx=0x7fde90005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22e7f199c7ae09f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:46.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.521+0000 7fdea5d9b640 1 -- 172.21.15.39:0/3207814583 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea000a330 con 0x7fde900051c0 2024-05-14T14:40:46.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.522+0000 7fdea5d9b640 1 -- 172.21.15.39:0/3207814583 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdea002f070 con 0x7fde900051c0 2024-05-14T14:40:46.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.522+0000 7fdea5d9b640 1 -- 172.21.15.39:0/3207814583 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea002ba80 con 0x7fde900051c0 2024-05-14T14:40:46.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.522+0000 7fdead18d640 1 -- 172.21.15.39:0/3207814583 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde900051c0 msgr2=0x7fde9000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:46.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.522+0000 7fdead18d640 1 --2- 172.21.15.39:0/3207814583 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde900051c0 0x7fde9000b9c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fdea80d1610 tx=0x7fde90005830 comp rx=0 tx=0).stop 2024-05-14T14:40:46.515 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.522+0000 7fdea759e640 1 -- 172.21.15.39:0/3207814583 reap_dead start 2024-05-14T14:40:46.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.522+0000 7fdead18d640 1 -- 172.21.15.39:0/3207814583 shutdown_connections 2024-05-14T14:40:46.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.522+0000 7fdead18d640 1 -- 172.21.15.39:0/3207814583 >> 172.21.15.39:0/3207814583 conn(0x7fdea80d0510 msgr2=0x7fdea80d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:46.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.522+0000 7fdead18d640 1 -- 172.21.15.39:0/3207814583 shutdown_connections 2024-05-14T14:40:46.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.522+0000 7fdead18d640 1 -- 172.21.15.39:0/3207814583 wait complete. 2024-05-14T14:40:46.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.524+0000 7fdead18d640 1 Processor -- start 2024-05-14T14:40:46.516 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.524+0000 7fdead18d640 1 -- start start 2024-05-14T14:40:46.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.526+0000 7fdead18d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdea80c9910 0x7fdea80c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:46.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.526+0000 7fdead18d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdea815b160 0x7fdea80b6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:46.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.526+0000 7fdead18d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdea815b570 0x7fdea80b6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:46.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.526+0000 7fdead18d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fdea8164bd0 con 0x7fdea815b160 2024-05-14T14:40:46.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.526+0000 7fdead18d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fdea81648f0 con 0x7fdea80c9910 2024-05-14T14:40:46.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.526+0000 7fdead18d640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fdea80d1c70 con 0x7fdea815b570 2024-05-14T14:40:46.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.526+0000 7fdea659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdea815b160 0x7fdea80b6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:46.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.526+0000 7fdea659c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdea815b160 0x7fdea80b6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51554/0 (socket says 172.21.15.39:51554) 2024-05-14T14:40:46.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.526+0000 7fdea659c640 1 -- 172.21.15.39:0/2567448401 learned_addr learned my addr 172.21.15.39:0/2567448401 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:46.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.526+0000 7fdea759e640 1 --2- 172.21.15.39:0/2567448401 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdea815b570 0x7fdea80b6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:46.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.526+0000 7fdea6d9d640 1 --2- 172.21.15.39:0/2567448401 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdea80c9910 0x7fdea80c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:46.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.526+0000 7fdea659c640 1 -- 172.21.15.39:0/2567448401 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdea815b570 msgr2=0x7fdea80b6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:46.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.526+0000 7fdea659c640 1 --2- 172.21.15.39:0/2567448401 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdea815b570 0x7fdea80b6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:46.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.526+0000 7fdea659c640 1 -- 172.21.15.39:0/2567448401 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdea80c9910 msgr2=0x7fdea80c7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:46.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.526+0000 7fdea659c640 1 --2- 172.21.15.39:0/2567448401 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdea80c9910 0x7fdea80c7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:46.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.526+0000 7fdea659c640 1 -- 172.21.15.39:0/2567448401 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdea80cd440 con 0x7fdea815b160 2024-05-14T14:40:46.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.526+0000 7fdea659c640 1 --2- 172.21.15.39:0/2567448401 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdea815b160 0x7fdea80b6440 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fde9c00e780 tx=0x7fde9c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:46.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.526+0000 7fde8f7fe640 1 -- 172.21.15.39:0/2567448401 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9c00ee30 con 0x7fdea815b160 2024-05-14T14:40:46.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.526+0000 7fde8f7fe640 1 -- 172.21.15.39:0/2567448401 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde9c018070 con 0x7fdea815b160 2024-05-14T14:40:46.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.527+0000 7fdead18d640 1 -- 172.21.15.39:0/2567448401 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdea80c9ef0 con 0x7fdea815b160 2024-05-14T14:40:46.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.527+0000 7fde8f7fe640 1 -- 172.21.15.39:0/2567448401 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9c00c6c0 con 0x7fdea815b160 2024-05-14T14:40:46.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.527+0000 7fdead18d640 1 -- 172.21.15.39:0/2567448401 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdea80b78b0 con 0x7fdea815b160 2024-05-14T14:40:46.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.527+0000 7fdead18d640 1 -- 172.21.15.39:0/2567448401 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdea8076aa0 con 0x7fdea815b160 2024-05-14T14:40:46.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.528+0000 7fde8f7fe640 1 -- 172.21.15.39:0/2567448401 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fde9c00c860 con 0x7fdea815b160 2024-05-14T14:40:46.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.529+0000 7fde8f7fe640 1 --2- 172.21.15.39:0/2567448401 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fde940762d0 0x7fde940787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:46.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.529+0000 7fde8f7fe640 1 -- 172.21.15.39:0/2567448401 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fde9c0977d0 con 0x7fdea815b160 2024-05-14T14:40:46.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.529+0000 7fdea6d9d640 1 --2- 172.21.15.39:0/2567448401 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fde940762d0 0x7fde940787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:46.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.529+0000 7fdea6d9d640 1 --2- 172.21.15.39:0/2567448401 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fde940762d0 0x7fde940787e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdea80ca600 tx=0x7fde98008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:46.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.534+0000 7fde8f7fe640 1 -- 172.21.15.39:0/2567448401 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fde9c060eb0 con 0x7fdea815b160 2024-05-14T14:40:46.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.725+0000 7fdead18d640 1 -- 172.21.15.39:0/2567448401 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fdea8069d80 con 0x7fdea815b160 2024-05-14T14:40:46.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.725+0000 7fde8f7fe640 1 -- 172.21.15.39:0/2567448401 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7fde9c0607b0 con 0x7fdea815b160 2024-05-14T14:40:46.710 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2024-05-14T14:40:46.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.728+0000 7fdead18d640 1 -- 172.21.15.39:0/2567448401 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fde940762d0 msgr2=0x7fde940787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:46.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.728+0000 7fdead18d640 1 --2- 172.21.15.39:0/2567448401 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fde940762d0 0x7fde940787e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fdea80ca600 tx=0x7fde98008040 comp rx=0 tx=0).stop 2024-05-14T14:40:46.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.728+0000 7fdead18d640 1 -- 172.21.15.39:0/2567448401 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdea815b160 msgr2=0x7fdea80b6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:46.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.728+0000 7fdead18d640 1 --2- 172.21.15.39:0/2567448401 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdea815b160 0x7fdea80b6440 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fde9c00e780 tx=0x7fde9c00ec40 comp rx=0 tx=0).stop 2024-05-14T14:40:46.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.728+0000 7fdead18d640 1 -- 172.21.15.39:0/2567448401 shutdown_connections 2024-05-14T14:40:46.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.728+0000 7fdead18d640 1 --2- 172.21.15.39:0/2567448401 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fde940762d0 0x7fde940787e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:46.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.728+0000 7fdead18d640 1 --2- 172.21.15.39:0/2567448401 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdea815b570 0x7fdea80b6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:46.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.728+0000 7fdead18d640 1 --2- 172.21.15.39:0/2567448401 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdea815b160 0x7fdea80b6440 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:46.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.728+0000 7fdead18d640 1 --2- 172.21.15.39:0/2567448401 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdea80c9910 0x7fdea80c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:46.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.728+0000 7fdead18d640 1 -- 172.21.15.39:0/2567448401 >> 172.21.15.39:0/2567448401 conn(0x7fdea80d0510 msgr2=0x7fdea80b34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:46.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.728+0000 7fdead18d640 1 -- 172.21.15.39:0/2567448401 shutdown_connections 2024-05-14T14:40:46.713 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.728+0000 7fdead18d640 1 -- 172.21.15.39:0/2567448401 wait complete. 2024-05-14T14:40:46.723 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-14T14:40:46.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.857+0000 7f1b080f2640 1 Processor -- start 2024-05-14T14:40:46.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.857+0000 7f1b080f2640 1 -- start start 2024-05-14T14:40:46.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.858+0000 7f1b080f2640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1b000bb9a0 0x7f1b0006da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:46.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.858+0000 7f1b080f2640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1b000d4720 0x7f1b000b9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:46.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.858+0000 7f1b080f2640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1b000b9760 0x7f1b000b9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:46.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.858+0000 7f1b080f2640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f1b0006c9b0 con 0x7f1b000b9760 2024-05-14T14:40:46.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.858+0000 7f1b080f2640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f1b0006cc90 con 0x7f1b000d4720 2024-05-14T14:40:46.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.858+0000 7f1b080f2640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f1b0006cf70 con 0x7f1b000bb9a0 2024-05-14T14:40:46.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.859+0000 7f1b0668f640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1b000b9760 0x7f1b000b9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:46.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.859+0000 7f1b0668f640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1b000b9760 0x7f1b000b9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51558/0 (socket says 172.21.15.39:51558) 2024-05-14T14:40:46.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.859+0000 7f1b0668f640 1 -- 172.21.15.39:0/469975140 learned_addr learned my addr 172.21.15.39:0/469975140 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:46.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.859+0000 7f1b05e8e640 1 --2- 172.21.15.39:0/469975140 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1b000bb9a0 0x7f1b0006da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:46.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.859+0000 7f1b0568d640 1 --2- 172.21.15.39:0/469975140 >> v2:172.21.15.62:3300/0 conn(0x7f1b000d4720 0x7f1b000b9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:46.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.859+0000 7f1b0668f640 1 -- 172.21.15.39:0/469975140 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1b000bb9a0 msgr2=0x7f1b0006da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:46.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.859+0000 7f1b0668f640 1 --2- 172.21.15.39:0/469975140 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1b000bb9a0 0x7f1b0006da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:46.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.859+0000 7f1b0668f640 1 -- 172.21.15.39:0/469975140 >> v2:172.21.15.62:3300/0 conn(0x7f1b000d4720 msgr2=0x7f1b000b9220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:46.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.859+0000 7f1b0668f640 1 --2- 172.21.15.39:0/469975140 >> v2:172.21.15.62:3300/0 conn(0x7f1b000d4720 0x7f1b000b9220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:46.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.859+0000 7f1b0668f640 1 -- 172.21.15.39:0/469975140 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b0006d250 con 0x7f1b000b9760 2024-05-14T14:40:46.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.859+0000 7f1b05e8e640 1 --2- 172.21.15.39:0/469975140 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1b000bb9a0 0x7f1b0006da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:40:46.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.860+0000 7f1b0668f640 1 --2- 172.21.15.39:0/469975140 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b000b9760 0x7f1b000b9b70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1b000d63c0 tx=0x7f1af002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8297585831f6e2ef server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:46.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.860+0000 7f1b04e8c640 1 -- 172.21.15.39:0/469975140 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af0036070 con 0x7f1b000b9760 2024-05-14T14:40:46.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.860+0000 7f1b04e8c640 1 -- 172.21.15.39:0/469975140 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1af0031600 con 0x7f1b000b9760 2024-05-14T14:40:46.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.860+0000 7f1b04e8c640 1 -- 172.21.15.39:0/469975140 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af00319d0 con 0x7f1b000b9760 2024-05-14T14:40:46.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.861+0000 7f1b080f2640 1 -- 172.21.15.39:0/469975140 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b000b9760 msgr2=0x7f1b000b9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:46.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.861+0000 7f1b080f2640 1 --2- 172.21.15.39:0/469975140 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b000b9760 0x7f1b000b9b70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1b000d63c0 tx=0x7f1af002a6a0 comp rx=0 tx=0).stop 2024-05-14T14:40:46.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.861+0000 7f1b080f2640 1 -- 172.21.15.39:0/469975140 shutdown_connections 2024-05-14T14:40:46.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.861+0000 7f1b080f2640 1 --2- 172.21.15.39:0/469975140 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b000b9760 0x7f1b000b9b70 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:46.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.861+0000 7f1b080f2640 1 --2- 172.21.15.39:0/469975140 >> v2:172.21.15.62:3300/0 conn(0x7f1b000d4720 0x7f1b000b9220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:46.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.861+0000 7f1b080f2640 1 --2- 172.21.15.39:0/469975140 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1b000bb9a0 0x7f1b0006da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:46.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.861+0000 7f1b080f2640 1 -- 172.21.15.39:0/469975140 >> 172.21.15.39:0/469975140 conn(0x7f1b0006f210 msgr2=0x7f1b000d5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:46.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.861+0000 7f1b080f2640 1 -- 172.21.15.39:0/469975140 shutdown_connections 2024-05-14T14:40:46.847 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.861+0000 7f1b080f2640 1 -- 172.21.15.39:0/469975140 wait complete. 2024-05-14T14:40:46.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.863+0000 7f1b080f2640 1 Processor -- start 2024-05-14T14:40:46.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.863+0000 7f1b080f2640 1 -- start start 2024-05-14T14:40:46.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.864+0000 7f1b080f2640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1b000b9760 0x7f1b00159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:46.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.864+0000 7f1b080f2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b000bb9a0 0x7f1b001f5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:46.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.864+0000 7f1b080f2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b000d4720 0x7f1b001f6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:46.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.864+0000 7f1b080f2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1b000b5530 con 0x7f1b000bb9a0 2024-05-14T14:40:46.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.864+0000 7f1b080f2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1b0006df90 con 0x7f1b000d4720 2024-05-14T14:40:46.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.864+0000 7f1b080f2640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f1b0006c6a0 con 0x7f1b000b9760 2024-05-14T14:40:46.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.864+0000 7f1b0568d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b000bb9a0 0x7f1b001f5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:46.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.864+0000 7f1b0568d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b000bb9a0 0x7f1b001f5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51564/0 (socket says 172.21.15.39:51564) 2024-05-14T14:40:46.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.864+0000 7f1b0568d640 1 -- 172.21.15.39:0/700855522 learned_addr learned my addr 172.21.15.39:0/700855522 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:46.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.864+0000 7f1b05e8e640 1 --2- 172.21.15.39:0/700855522 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1b000b9760 0x7f1b00159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:46.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.864+0000 7f1b0668f640 1 --2- 172.21.15.39:0/700855522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b000d4720 0x7f1b001f6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:46.849 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.864+0000 7f1b0568d640 1 -- 172.21.15.39:0/700855522 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1b000b9760 msgr2=0x7f1b00159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:46.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.864+0000 7f1b0568d640 1 --2- 172.21.15.39:0/700855522 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1b000b9760 0x7f1b00159a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:46.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.864+0000 7f1b0568d640 1 -- 172.21.15.39:0/700855522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b000d4720 msgr2=0x7f1b001f6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:46.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.864+0000 7f1b0568d640 1 --2- 172.21.15.39:0/700855522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b000d4720 0x7f1b001f6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:46.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.864+0000 7f1b0568d640 1 -- 172.21.15.39:0/700855522 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b0015a750 con 0x7f1b000bb9a0 2024-05-14T14:40:46.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.865+0000 7f1b0568d640 1 --2- 172.21.15.39:0/700855522 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b000bb9a0 0x7f1b001f5f00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1af400d5f0 tx=0x7f1af400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:46.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.865+0000 7f1afe7fc640 1 -- 172.21.15.39:0/700855522 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af40125f0 con 0x7f1b000bb9a0 2024-05-14T14:40:46.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.865+0000 7f1afe7fc640 1 -- 172.21.15.39:0/700855522 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1af4019070 con 0x7f1b000bb9a0 2024-05-14T14:40:46.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.865+0000 7f1b080f2640 1 -- 172.21.15.39:0/700855522 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b001f6a80 con 0x7f1b000bb9a0 2024-05-14T14:40:46.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.865+0000 7f1afe7fc640 1 -- 172.21.15.39:0/700855522 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1af40129d0 con 0x7f1b000bb9a0 2024-05-14T14:40:46.850 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.865+0000 7f1b080f2640 1 -- 172.21.15.39:0/700855522 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b001f85e0 con 0x7f1b000bb9a0 2024-05-14T14:40:46.851 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.866+0000 7f1b080f2640 1 -- 172.21.15.39:0/700855522 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b0015a4c0 con 0x7f1b000bb9a0 2024-05-14T14:40:46.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.867+0000 7f1afe7fc640 1 -- 172.21.15.39:0/700855522 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1af4012b70 con 0x7f1b000bb9a0 2024-05-14T14:40:46.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.867+0000 7f1afe7fc640 1 --2- 172.21.15.39:0/700855522 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1aec0762d0 0x7f1aec0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:46.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.867+0000 7f1afe7fc640 1 -- 172.21.15.39:0/700855522 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1af4097bd0 con 0x7f1b000bb9a0 2024-05-14T14:40:46.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.867+0000 7f1b05e8e640 1 --2- 172.21.15.39:0/700855522 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1aec0762d0 0x7f1aec0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:46.852 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.868+0000 7f1b05e8e640 1 --2- 172.21.15.39:0/700855522 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1aec0762d0 0x7f1aec0787e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1af8003610 tx=0x7f1af8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:46.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:46.872+0000 7f1afe7fc640 1 -- 172.21.15.39:0/700855522 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1af4060ba0 con 0x7f1b000bb9a0 2024-05-14T14:40:47.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.066+0000 7f1b080f2640 1 -- 172.21.15.39:0/700855522 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1b00076aa0 con 0x7f1b000bb9a0 2024-05-14T14:40:47.050 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.066+0000 7f1afe7fc640 1 -- 172.21.15.39:0/700855522 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f1af4064ea0 con 0x7f1b000bb9a0 2024-05-14T14:40:47.050 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 64 2024-05-14T14:40:47.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.069+0000 7f1b080f2640 1 -- 172.21.15.39:0/700855522 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1aec0762d0 msgr2=0x7f1aec0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:47.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.069+0000 7f1b080f2640 1 --2- 172.21.15.39:0/700855522 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1aec0762d0 0x7f1aec0787e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1af8003610 tx=0x7f1af8008040 comp rx=0 tx=0).stop 2024-05-14T14:40:47.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.069+0000 7f1b080f2640 1 -- 172.21.15.39:0/700855522 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b000bb9a0 msgr2=0x7f1b001f5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:47.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.069+0000 7f1b080f2640 1 --2- 172.21.15.39:0/700855522 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b000bb9a0 0x7f1b001f5f00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1af400d5f0 tx=0x7f1af400dab0 comp rx=0 tx=0).stop 2024-05-14T14:40:47.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.069+0000 7f1b080f2640 1 -- 172.21.15.39:0/700855522 shutdown_connections 2024-05-14T14:40:47.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.069+0000 7f1b080f2640 1 --2- 172.21.15.39:0/700855522 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1aec0762d0 0x7f1aec0787e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:47.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.069+0000 7f1b080f2640 1 --2- 172.21.15.39:0/700855522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b000d4720 0x7f1b001f6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:47.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.069+0000 7f1b080f2640 1 --2- 172.21.15.39:0/700855522 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b000bb9a0 0x7f1b001f5f00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:47.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.069+0000 7f1b080f2640 1 --2- 172.21.15.39:0/700855522 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1b000b9760 0x7f1b00159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:47.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.069+0000 7f1b080f2640 1 -- 172.21.15.39:0/700855522 >> 172.21.15.39:0/700855522 conn(0x7f1b0006f210 msgr2=0x7f1b00068610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:47.053 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.069+0000 7f1b080f2640 1 -- 172.21.15.39:0/700855522 shutdown_connections 2024-05-14T14:40:47.054 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.069+0000 7f1b080f2640 1 -- 172.21.15.39:0/700855522 wait complete. 2024-05-14T14:40:47.064 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-14T14:40:47.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.199+0000 7f9f85957640 1 Processor -- start 2024-05-14T14:40:47.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.199+0000 7f9f85957640 1 -- start start 2024-05-14T14:40:47.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.201+0000 7f9f85957640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9f800bb9a0 0x7f9f8006da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:47.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.201+0000 7f9f85957640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9f800d4720 0x7f9f800b9220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:47.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.201+0000 7f9f85957640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f8006c9b0 con 0x7f9f800b9760 2024-05-14T14:40:47.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.201+0000 7f9f85957640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f9f8006cc90 con 0x7f9f800d4720 2024-05-14T14:40:47.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.201+0000 7f9f85957640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f9f8006cf70 con 0x7f9f800bb9a0 2024-05-14T14:40:47.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.201+0000 7f9f7e7fc640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9f800d4720 0x7f9f800b9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:47.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.201+0000 7f9f7f7fe640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f9f800b9760 0x7f9f800d0af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:50496/0 (socket says 172.21.15.39:50496) 2024-05-14T14:40:47.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.201+0000 7f9f7f7fe640 1 -- 172.21.15.39:0/4037353099 learned_addr learned my addr 172.21.15.39:0/4037353099 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:47.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.201+0000 7f9f7e7fc640 1 -- 172.21.15.39:0/4037353099 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9f800bb9a0 msgr2=0x7f9f8006da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:47.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.201+0000 7f9f7e7fc640 1 --2- 172.21.15.39:0/4037353099 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9f800bb9a0 0x7f9f8006da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:47.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.201+0000 7f9f7e7fc640 1 -- 172.21.15.39:0/4037353099 >> v1:172.21.15.39:6789/0 conn(0x7f9f800b9760 legacy=0x7f9f800d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:47.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.201+0000 7f9f7e7fc640 1 -- 172.21.15.39:0/4037353099 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f8006d250 con 0x7f9f800d4720 2024-05-14T14:40:47.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.202+0000 7f9f7e7fc640 1 --2- 172.21.15.39:0/4037353099 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f800d4720 0x7f9f800b9220 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9f680097a0 tx=0x7f9f6802a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce1f97a5bfc1bc7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:47.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.202+0000 7f9f7dffb640 1 -- 172.21.15.39:0/4037353099 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f68037070 con 0x7f9f800d4720 2024-05-14T14:40:47.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.202+0000 7f9f7dffb640 1 -- 172.21.15.39:0/4037353099 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f6802ad10 con 0x7f9f800d4720 2024-05-14T14:40:47.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.202+0000 7f9f7dffb640 1 -- 172.21.15.39:0/4037353099 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f68032660 con 0x7f9f800d4720 2024-05-14T14:40:47.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.203+0000 7f9f85957640 1 -- 172.21.15.39:0/4037353099 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f800d4720 msgr2=0x7f9f800b9220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:47.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.203+0000 7f9f85957640 1 --2- 172.21.15.39:0/4037353099 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f800d4720 0x7f9f800b9220 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9f680097a0 tx=0x7f9f6802a080 comp rx=0 tx=0).stop 2024-05-14T14:40:47.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.203+0000 7f9f85957640 1 -- 172.21.15.39:0/4037353099 shutdown_connections 2024-05-14T14:40:47.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.203+0000 7f9f85957640 1 --2- 172.21.15.39:0/4037353099 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f800d4720 0x7f9f800b9220 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:47.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.203+0000 7f9f85957640 1 --2- 172.21.15.39:0/4037353099 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9f800bb9a0 0x7f9f8006da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:47.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.203+0000 7f9f85957640 1 -- 172.21.15.39:0/4037353099 >> 172.21.15.39:0/4037353099 conn(0x7f9f8006f210 msgr2=0x7f9f800d5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:47.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.203+0000 7f9f85957640 1 -- 172.21.15.39:0/4037353099 shutdown_connections 2024-05-14T14:40:47.188 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.203+0000 7f9f85957640 1 -- 172.21.15.39:0/4037353099 wait complete. 2024-05-14T14:40:47.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.205+0000 7f9f85957640 1 Processor -- start 2024-05-14T14:40:47.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.205+0000 7f9f85957640 1 -- start start 2024-05-14T14:40:47.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.206+0000 7f9f85957640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9f800b9760 0x7f9f801509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:47.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.206+0000 7f9f85957640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f800bb9a0 0x7f9f801eb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:47.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.206+0000 7f9f85957640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f800d4720 0x7f9f800afc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:47.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.206+0000 7f9f85957640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f9f800b5530 con 0x7f9f800bb9a0 2024-05-14T14:40:47.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.206+0000 7f9f85957640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f9f8006df90 con 0x7f9f800d4720 2024-05-14T14:40:47.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.206+0000 7f9f85957640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f9f8006c6a0 con 0x7f9f800b9760 2024-05-14T14:40:47.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.206+0000 7f9f7e7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f800bb9a0 0x7f9f801eb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:47.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.206+0000 7f9f7e7fc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f800bb9a0 0x7f9f801eb9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51580/0 (socket says 172.21.15.39:51580) 2024-05-14T14:40:47.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.206+0000 7f9f7e7fc640 1 -- 172.21.15.39:0/3035228544 learned_addr learned my addr 172.21.15.39:0/3035228544 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:47.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.207+0000 7f9f7f7fe640 1 --2- 172.21.15.39:0/3035228544 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f800d4720 0x7f9f800afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:47.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.207+0000 7f9f7effd640 1 --2- 172.21.15.39:0/3035228544 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9f800b9760 0x7f9f801509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:47.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.207+0000 7f9f7e7fc640 1 -- 172.21.15.39:0/3035228544 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9f800b9760 msgr2=0x7f9f801509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:47.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.207+0000 7f9f7e7fc640 1 --2- 172.21.15.39:0/3035228544 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9f800b9760 0x7f9f801509f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:47.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.207+0000 7f9f7e7fc640 1 -- 172.21.15.39:0/3035228544 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f800d4720 msgr2=0x7f9f800afc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:47.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.207+0000 7f9f7e7fc640 1 --2- 172.21.15.39:0/3035228544 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f800d4720 0x7f9f800afc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:47.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.207+0000 7f9f7e7fc640 1 -- 172.21.15.39:0/3035228544 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f801ec5e0 con 0x7f9f800bb9a0 2024-05-14T14:40:47.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.207+0000 7f9f7effd640 1 --2- 172.21.15.39:0/3035228544 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9f800b9760 0x7f9f801509f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:40:47.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.207+0000 7f9f7e7fc640 1 --2- 172.21.15.39:0/3035228544 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f800bb9a0 0x7f9f801eb9a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9f680097a0 tx=0x7f9f680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:47.192 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.207+0000 7f9f77fff640 1 -- 172.21.15.39:0/3035228544 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f68037040 con 0x7f9f800bb9a0 2024-05-14T14:40:47.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.207+0000 7f9f77fff640 1 -- 172.21.15.39:0/3035228544 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f68004030 con 0x7f9f800bb9a0 2024-05-14T14:40:47.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.207+0000 7f9f77fff640 1 -- 172.21.15.39:0/3035228544 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f68004420 con 0x7f9f800bb9a0 2024-05-14T14:40:47.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.207+0000 7f9f85957640 1 -- 172.21.15.39:0/3035228544 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f801ec8c0 con 0x7f9f800bb9a0 2024-05-14T14:40:47.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.207+0000 7f9f85957640 1 -- 172.21.15.39:0/3035228544 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f800aeec0 con 0x7f9f800bb9a0 2024-05-14T14:40:47.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.208+0000 7f9f85957640 1 -- 172.21.15.39:0/3035228544 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f80076aa0 con 0x7f9f800bb9a0 2024-05-14T14:40:47.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.209+0000 7f9f77fff640 1 -- 172.21.15.39:0/3035228544 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9f6803a070 con 0x7f9f800bb9a0 2024-05-14T14:40:47.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.209+0000 7f9f77fff640 1 --2- 172.21.15.39:0/3035228544 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f9f60076300 0x7f9f60078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:47.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.210+0000 7f9f77fff640 1 -- 172.21.15.39:0/3035228544 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9f680b7b60 con 0x7f9f800bb9a0 2024-05-14T14:40:47.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.210+0000 7f9f7effd640 1 --2- 172.21.15.39:0/3035228544 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f9f60076300 0x7f9f60078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:47.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.210+0000 7f9f7effd640 1 --2- 172.21.15.39:0/3035228544 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f9f60076300 0x7f9f60078810 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9f7000a870 tx=0x7f9f70008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:47.198 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.214+0000 7f9f77fff640 1 -- 172.21.15.39:0/3035228544 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f9f68041020 con 0x7f9f800bb9a0 2024-05-14T14:40:47.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.404+0000 7f9f85957640 1 -- 172.21.15.39:0/3035228544 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f9f801ec370 con 0x7f9f800bb9a0 2024-05-14T14:40:47.388 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.405+0000 7f9f77fff640 1 -- 172.21.15.39:0/3035228544 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7f9f68089030 con 0x7f9f800bb9a0 2024-05-14T14:40:47.389 INFO:teuthology.orchestra.run.smithi039.stdout:pg_num: 32 2024-05-14T14:40:47.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.407+0000 7f9f85957640 1 -- 172.21.15.39:0/3035228544 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f9f60076300 msgr2=0x7f9f60078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:47.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.407+0000 7f9f85957640 1 --2- 172.21.15.39:0/3035228544 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f9f60076300 0x7f9f60078810 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9f7000a870 tx=0x7f9f70008040 comp rx=0 tx=0).stop 2024-05-14T14:40:47.392 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.407+0000 7f9f85957640 1 -- 172.21.15.39:0/3035228544 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f800bb9a0 msgr2=0x7f9f801eb9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:47.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.407+0000 7f9f85957640 1 --2- 172.21.15.39:0/3035228544 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f800bb9a0 0x7f9f801eb9a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9f680097a0 tx=0x7f9f680046c0 comp rx=0 tx=0).stop 2024-05-14T14:40:47.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.407+0000 7f9f85957640 1 -- 172.21.15.39:0/3035228544 shutdown_connections 2024-05-14T14:40:47.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.407+0000 7f9f85957640 1 --2- 172.21.15.39:0/3035228544 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f9f60076300 0x7f9f60078810 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:47.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.407+0000 7f9f85957640 1 --2- 172.21.15.39:0/3035228544 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f800d4720 0x7f9f800afc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:47.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.407+0000 7f9f85957640 1 --2- 172.21.15.39:0/3035228544 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9f800bb9a0 0x7f9f801eb9a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:47.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.407+0000 7f9f85957640 1 --2- 172.21.15.39:0/3035228544 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9f800b9760 0x7f9f801509f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:47.393 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.407+0000 7f9f85957640 1 -- 172.21.15.39:0/3035228544 >> 172.21.15.39:0/3035228544 conn(0x7f9f8006f210 msgr2=0x7f9f800ba6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:47.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.407+0000 7f9f85957640 1 -- 172.21.15.39:0/3035228544 shutdown_connections 2024-05-14T14:40:47.394 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.407+0000 7f9f85957640 1 -- 172.21.15.39:0/3035228544 wait complete. 2024-05-14T14:40:47.403 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2024-05-14T14:40:47.518 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.534+0000 7fec951e3640 1 Processor -- start 2024-05-14T14:40:47.519 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.534+0000 7fec951e3640 1 -- start start 2024-05-14T14:40:47.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.536+0000 7fec951e3640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fec9006dc70 0x7fec9016b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:47.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.536+0000 7fec951e3640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec90164bc0 con 0x7fec901602f0 2024-05-14T14:40:47.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.536+0000 7fec951e3640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec900b4fc0 con 0x7fec900b4820 2024-05-14T14:40:47.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.536+0000 7fec951e3640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fec900b4d70 con 0x7fec9006dc70 2024-05-14T14:40:47.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.536+0000 7fec8f59e640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fec9006dc70 0x7fec9016b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:47.520 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.536+0000 7fec8e59c640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fec901602f0 0x7fec901644b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:50510/0 (socket says 172.21.15.39:50510) 2024-05-14T14:40:47.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.536+0000 7fec8e59c640 1 -- 172.21.15.39:0/2540225744 learned_addr learned my addr 172.21.15.39:0/2540225744 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:47.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.536+0000 7fec8f59e640 1 -- 172.21.15.39:0/2540225744 >> v1:172.21.15.62:6789/0 conn(0x7fec900b4820 legacy=0x7fec90163da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:47.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.536+0000 7fec8f59e640 1 -- 172.21.15.39:0/2540225744 >> v1:172.21.15.39:6789/0 conn(0x7fec901602f0 legacy=0x7fec901644b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:47.521 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.536+0000 7fec8f59e640 1 -- 172.21.15.39:0/2540225744 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec900d4fc0 con 0x7fec9006dc70 2024-05-14T14:40:47.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.537+0000 7fec8f59e640 1 --2- 172.21.15.39:0/2540225744 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec9006dc70 0x7fec9016b130 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fec880097a0 tx=0x7fec8802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17ded808eef767bd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:47.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.537+0000 7fec8dd9b640 1 -- 172.21.15.39:0/2540225744 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec88037070 con 0x7fec9006dc70 2024-05-14T14:40:47.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.537+0000 7fec8dd9b640 1 -- 172.21.15.39:0/2540225744 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec88032440 con 0x7fec9006dc70 2024-05-14T14:40:47.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.537+0000 7fec8dd9b640 1 -- 172.21.15.39:0/2540225744 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec88032810 con 0x7fec9006dc70 2024-05-14T14:40:47.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.538+0000 7fec951e3640 1 -- 172.21.15.39:0/2540225744 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec9006dc70 msgr2=0x7fec9016b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:47.522 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.538+0000 7fec951e3640 1 --2- 172.21.15.39:0/2540225744 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec9006dc70 0x7fec9016b130 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fec880097a0 tx=0x7fec8802a230 comp rx=0 tx=0).stop 2024-05-14T14:40:47.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.538+0000 7fec951e3640 1 -- 172.21.15.39:0/2540225744 shutdown_connections 2024-05-14T14:40:47.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.538+0000 7fec951e3640 1 --2- 172.21.15.39:0/2540225744 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec9006dc70 0x7fec9016b130 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:47.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.538+0000 7fec951e3640 1 -- 172.21.15.39:0/2540225744 >> 172.21.15.39:0/2540225744 conn(0x7fec900d6670 msgr2=0x7fec900d2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:47.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.538+0000 7fec951e3640 1 -- 172.21.15.39:0/2540225744 shutdown_connections 2024-05-14T14:40:47.523 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.538+0000 7fec951e3640 1 -- 172.21.15.39:0/2540225744 wait complete. 2024-05-14T14:40:47.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.540+0000 7fec951e3640 1 Processor -- start 2024-05-14T14:40:47.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.540+0000 7fec951e3640 1 -- start start 2024-05-14T14:40:47.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.542+0000 7fec951e3640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec9006dc70 0x7fec90158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:47.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.542+0000 7fec951e3640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec900b4820 0x7fec90154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:47.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.542+0000 7fec951e3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec901602f0 0x7fec9015c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:47.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.542+0000 7fec951e3640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fec900d5580 con 0x7fec9006dc70 2024-05-14T14:40:47.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.542+0000 7fec951e3640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fec9006c7d0 con 0x7fec901602f0 2024-05-14T14:40:47.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.542+0000 7fec951e3640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fec9016b670 con 0x7fec900b4820 2024-05-14T14:40:47.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.542+0000 7fec8ed9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec9006dc70 0x7fec90158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:47.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.542+0000 7fec8ed9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec9006dc70 0x7fec90158af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51592/0 (socket says 172.21.15.39:51592) 2024-05-14T14:40:47.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.542+0000 7fec8ed9d640 1 -- 172.21.15.39:0/498274946 learned_addr learned my addr 172.21.15.39:0/498274946 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:47.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.542+0000 7fec8f59e640 1 --2- 172.21.15.39:0/498274946 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec901602f0 0x7fec9015c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:47.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.542+0000 7fec8e59c640 1 --2- 172.21.15.39:0/498274946 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec900b4820 0x7fec90154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:47.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.542+0000 7fec8ed9d640 1 -- 172.21.15.39:0/498274946 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec900b4820 msgr2=0x7fec90154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:47.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.542+0000 7fec8ed9d640 1 --2- 172.21.15.39:0/498274946 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec900b4820 0x7fec90154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:47.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.542+0000 7fec8ed9d640 1 -- 172.21.15.39:0/498274946 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec901602f0 msgr2=0x7fec9015c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:47.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.542+0000 7fec8ed9d640 1 --2- 172.21.15.39:0/498274946 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec901602f0 0x7fec9015c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:47.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.542+0000 7fec8ed9d640 1 -- 172.21.15.39:0/498274946 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec90159030 con 0x7fec9006dc70 2024-05-14T14:40:47.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.542+0000 7fec8ed9d640 1 --2- 172.21.15.39:0/498274946 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec9006dc70 0x7fec90158af0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fec8000c760 tx=0x7fec8000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:47.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.542+0000 7fec777fe640 1 -- 172.21.15.39:0/498274946 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec80003b70 con 0x7fec9006dc70 2024-05-14T14:40:47.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.542+0000 7fec777fe640 1 -- 172.21.15.39:0/498274946 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec80003d10 con 0x7fec9006dc70 2024-05-14T14:40:47.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.542+0000 7fec951e3640 1 -- 172.21.15.39:0/498274946 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec9015cda0 con 0x7fec9006dc70 2024-05-14T14:40:47.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.543+0000 7fec777fe640 1 -- 172.21.15.39:0/498274946 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8000aa50 con 0x7fec9006dc70 2024-05-14T14:40:47.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.543+0000 7fec951e3640 1 -- 172.21.15.39:0/498274946 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec9015d910 con 0x7fec9006dc70 2024-05-14T14:40:47.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.543+0000 7fec951e3640 1 -- 172.21.15.39:0/498274946 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec90076aa0 con 0x7fec9006dc70 2024-05-14T14:40:47.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.544+0000 7fec777fe640 1 -- 172.21.15.39:0/498274946 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fec8000abf0 con 0x7fec9006dc70 2024-05-14T14:40:47.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.545+0000 7fec777fe640 1 --2- 172.21.15.39:0/498274946 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fec7c0762d0 0x7fec7c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:47.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.545+0000 7fec777fe640 1 -- 172.21.15.39:0/498274946 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fec80097850 con 0x7fec9006dc70 2024-05-14T14:40:47.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.545+0000 7fec8e59c640 1 --2- 172.21.15.39:0/498274946 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fec7c0762d0 0x7fec7c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:47.530 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.545+0000 7fec8e59c640 1 --2- 172.21.15.39:0/498274946 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fec7c0762d0 0x7fec7c0787e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fec901634f0 tx=0x7fec84009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:47.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.549+0000 7fec777fe640 1 -- 172.21.15.39:0/498274946 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fec80060de0 con 0x7fec9006dc70 2024-05-14T14:40:47.797 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:47.813+0000 7fec951e3640 1 -- 172.21.15.39:0/498274946 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) -- 0x7fec900d40d0 con 0x7fec9006dc70 2024-05-14T14:40:48.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.141+0000 7fec777fe640 1 -- 172.21.15.39:0/498274946 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v54) ==== 147+0+0 (secure 0 0 0) 0x7fec800606e0 con 0x7fec9006dc70 2024-05-14T14:40:48.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.144+0000 7fec951e3640 1 -- 172.21.15.39:0/498274946 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fec7c0762d0 msgr2=0x7fec7c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:48.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.144+0000 7fec951e3640 1 --2- 172.21.15.39:0/498274946 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fec7c0762d0 0x7fec7c0787e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fec901634f0 tx=0x7fec84009040 comp rx=0 tx=0).stop 2024-05-14T14:40:48.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.144+0000 7fec951e3640 1 -- 172.21.15.39:0/498274946 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec9006dc70 msgr2=0x7fec90158af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:48.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.144+0000 7fec951e3640 1 --2- 172.21.15.39:0/498274946 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec9006dc70 0x7fec90158af0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fec8000c760 tx=0x7fec8000cc20 comp rx=0 tx=0).stop 2024-05-14T14:40:48.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.144+0000 7fec951e3640 1 -- 172.21.15.39:0/498274946 shutdown_connections 2024-05-14T14:40:48.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.144+0000 7fec951e3640 1 --2- 172.21.15.39:0/498274946 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fec7c0762d0 0x7fec7c0787e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:48.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.144+0000 7fec951e3640 1 --2- 172.21.15.39:0/498274946 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec901602f0 0x7fec9015c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:48.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.144+0000 7fec951e3640 1 --2- 172.21.15.39:0/498274946 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fec900b4820 0x7fec90154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:48.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.144+0000 7fec951e3640 1 --2- 172.21.15.39:0/498274946 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fec9006dc70 0x7fec90158af0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:48.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.144+0000 7fec951e3640 1 -- 172.21.15.39:0/498274946 >> 172.21.15.39:0/498274946 conn(0x7fec900d6670 msgr2=0x7fec900cf850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:48.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.144+0000 7fec951e3640 1 -- 172.21.15.39:0/498274946 shutdown_connections 2024-05-14T14:40:48.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.144+0000 7fec951e3640 1 -- 172.21.15.39:0/498274946 wait complete. 2024-05-14T14:40:48.141 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-05-14T14:40:48.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.275+0000 7f338691c640 1 Processor -- start 2024-05-14T14:40:48.260 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.275+0000 7f338691c640 1 -- start start 2024-05-14T14:40:48.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.276+0000 7f338691c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f33800d1020 0x7f33800b5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:48.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.276+0000 7f338691c640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33800d4a00 con 0x7f33800d14f0 2024-05-14T14:40:48.263 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.276+0000 7f338691c640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33800d4ce0 con 0x7f338015f8b0 2024-05-14T14:40:48.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.276+0000 7f338691c640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f33800d5610 con 0x7f33800d1020 2024-05-14T14:40:48.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.276+0000 7f337ffff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f33800d14f0 0x7f33800d0910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:50518/0 (socket says 172.21.15.39:50518) 2024-05-14T14:40:48.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.276+0000 7f337ffff640 1 -- 172.21.15.39:0/1640563167 learned_addr learned my addr 172.21.15.39:0/1640563167 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:48.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.277+0000 7f337effd640 1 -- 172.21.15.39:0/1640563167 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 473326734 0 0) 0x7f33800d4a00 con 0x7f33800d14f0 2024-05-14T14:40:48.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.277+0000 7f337f7fe640 1 --2- 172.21.15.39:0/1640563167 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f33800d1020 0x7f33800b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:48.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.277+0000 7f337effd640 1 -- 172.21.15.39:0/1640563167 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3368003520 con 0x7f33800d14f0 2024-05-14T14:40:48.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.277+0000 7f337effd640 1 -- 172.21.15.39:0/1640563167 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 175051817 0 0) 0x7f3368003520 con 0x7f33800d14f0 2024-05-14T14:40:48.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.277+0000 7f337effd640 1 -- 172.21.15.39:0/1640563167 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f33800d1020 msgr2=0x7f33800b5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:48.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.277+0000 7f337effd640 1 --2- 172.21.15.39:0/1640563167 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f33800d1020 0x7f33800b5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:48.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.277+0000 7f337effd640 1 -- 172.21.15.39:0/1640563167 >> v1:172.21.15.62:6789/0 conn(0x7f338015f8b0 legacy=0x7f338015fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:48.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.277+0000 7f337effd640 1 -- 172.21.15.39:0/1640563167 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33800d4fc0 con 0x7f33800d14f0 2024-05-14T14:40:48.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.277+0000 7f337effd640 1 -- 172.21.15.39:0/1640563167 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1803005051 0 0) 0x7f33700016f0 con 0x7f33800d14f0 2024-05-14T14:40:48.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.277+0000 7f337effd640 1 -- 172.21.15.39:0/1640563167 >> v1:172.21.15.39:6789/0 conn(0x7f33800d14f0 legacy=0x7f33800d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:48.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.277+0000 7f337effd640 1 --2- 172.21.15.39:0/1640563167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3368003a30 0x7f3368003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:48.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.277+0000 7f337effd640 1 --2- 172.21.15.39:0/1640563167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3368004800 0x7f3368004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:48.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.277+0000 7f337effd640 1 --2- 172.21.15.39:0/1640563167 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3368005270 0x7f336800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:48.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.277+0000 7f337effd640 1 -- 172.21.15.39:0/1640563167 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f33800d5610 con 0x7f3368004800 2024-05-14T14:40:48.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.277+0000 7f337effd640 1 -- 172.21.15.39:0/1640563167 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f336800bfb0 con 0x7f3368003a30 2024-05-14T14:40:48.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.277+0000 7f337effd640 1 -- 172.21.15.39:0/1640563167 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f336800c1b0 con 0x7f3368005270 2024-05-14T14:40:48.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.277+0000 7f337f7fe640 1 --2- 172.21.15.39:0/1640563167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3368004800 0x7f3368004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:48.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.277+0000 7f337ffff640 1 --2- 172.21.15.39:0/1640563167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3368003a30 0x7f3368003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:48.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.277+0000 7f3384eb9640 1 --2- 172.21.15.39:0/1640563167 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3368005270 0x7f336800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:48.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.278+0000 7f337f7fe640 1 -- 172.21.15.39:0/1640563167 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3368005270 msgr2=0x7f336800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:48.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.278+0000 7f337f7fe640 1 --2- 172.21.15.39:0/1640563167 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3368005270 0x7f336800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:48.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.278+0000 7f337f7fe640 1 -- 172.21.15.39:0/1640563167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3368003a30 msgr2=0x7f3368003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:48.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.278+0000 7f337f7fe640 1 --2- 172.21.15.39:0/1640563167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3368003a30 0x7f3368003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:48.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.278+0000 7f337f7fe640 1 -- 172.21.15.39:0/1640563167 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3368003520 con 0x7f3368004800 2024-05-14T14:40:48.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.278+0000 7f337f7fe640 1 --2- 172.21.15.39:0/1640563167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3368004800 0x7f3368004c10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3374009ac0 tx=0x7f3368005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a4e6f84bdbfb545 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:48.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.278+0000 7f337effd640 1 -- 172.21.15.39:0/1640563167 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3374036070 con 0x7f3368004800 2024-05-14T14:40:48.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.278+0000 7f337effd640 1 -- 172.21.15.39:0/1640563167 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3374031400 con 0x7f3368004800 2024-05-14T14:40:48.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.278+0000 7f337effd640 1 -- 172.21.15.39:0/1640563167 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3374009690 con 0x7f3368004800 2024-05-14T14:40:48.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.279+0000 7f338691c640 1 -- 172.21.15.39:0/1640563167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3368004800 msgr2=0x7f3368004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:48.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.279+0000 7f338691c640 1 --2- 172.21.15.39:0/1640563167 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3368004800 0x7f3368004c10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3374009ac0 tx=0x7f3368005830 comp rx=0 tx=0).stop 2024-05-14T14:40:48.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.279+0000 7f3384eb9640 1 -- 172.21.15.39:0/1640563167 reap_dead start 2024-05-14T14:40:48.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.279+0000 7f338691c640 1 -- 172.21.15.39:0/1640563167 shutdown_connections 2024-05-14T14:40:48.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.279+0000 7f338691c640 1 -- 172.21.15.39:0/1640563167 >> 172.21.15.39:0/1640563167 conn(0x7f33800d65f0 msgr2=0x7f33800b7750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:48.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.279+0000 7f338691c640 1 -- 172.21.15.39:0/1640563167 shutdown_connections 2024-05-14T14:40:48.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.279+0000 7f338691c640 1 -- 172.21.15.39:0/1640563167 wait complete. 2024-05-14T14:40:48.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.281+0000 7f338691c640 1 Processor -- start 2024-05-14T14:40:48.267 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.281+0000 7f338691c640 1 -- start start 2024-05-14T14:40:48.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.282+0000 7f338691c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3368004800 0x7f338014ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:48.269 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.282+0000 7f338691c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f33800ca840 0x7f33800cac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:48.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.283+0000 7f338691c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f338015fd30 0x7f3380160140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:48.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.283+0000 7f338691c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f33800d4710 con 0x7f3368004800 2024-05-14T14:40:48.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.283+0000 7f338691c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f33800d4590 con 0x7f338015fd30 2024-05-14T14:40:48.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.283+0000 7f338691c640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f33800d1020 con 0x7f33800ca840 2024-05-14T14:40:48.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.283+0000 7f337ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3368004800 0x7f338014ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:48.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.283+0000 7f337ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3368004800 0x7f338014ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:51610/0 (socket says 172.21.15.39:51610) 2024-05-14T14:40:48.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.283+0000 7f337ffff640 1 -- 172.21.15.39:0/3873769729 learned_addr learned my addr 172.21.15.39:0/3873769729 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:48.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.283+0000 7f337f7fe640 1 --2- 172.21.15.39:0/3873769729 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f33800ca840 0x7f33800cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:48.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.283+0000 7f3384eb9640 1 --2- 172.21.15.39:0/3873769729 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f338015fd30 0x7f3380160140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:48.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.283+0000 7f337ffff640 1 -- 172.21.15.39:0/3873769729 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f33800ca840 msgr2=0x7f33800cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:48.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.283+0000 7f337ffff640 1 --2- 172.21.15.39:0/3873769729 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f33800ca840 0x7f33800cac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:48.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.283+0000 7f337ffff640 1 -- 172.21.15.39:0/3873769729 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f338015fd30 msgr2=0x7f3380160140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:48.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.283+0000 7f337ffff640 1 --2- 172.21.15.39:0/3873769729 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f338015fd30 0x7f3380160140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:48.270 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.283+0000 7f337ffff640 1 -- 172.21.15.39:0/3873769729 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3380160680 con 0x7f3368004800 2024-05-14T14:40:48.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.283+0000 7f337ffff640 1 --2- 172.21.15.39:0/3873769729 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3368004800 0x7f338014ef70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3370007340 tx=0x7f3370007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:48.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.283+0000 7f337cff9640 1 -- 172.21.15.39:0/3873769729 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337000f9c0 con 0x7f3368004800 2024-05-14T14:40:48.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.283+0000 7f337cff9640 1 -- 172.21.15.39:0/3873769729 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3370018070 con 0x7f3368004800 2024-05-14T14:40:48.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.283+0000 7f338691c640 1 -- 172.21.15.39:0/3873769729 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33800cba90 con 0x7f3368004800 2024-05-14T14:40:48.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.283+0000 7f337cff9640 1 -- 172.21.15.39:0/3873769729 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337000fdc0 con 0x7f3368004800 2024-05-14T14:40:48.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.283+0000 7f338691c640 1 -- 172.21.15.39:0/3873769729 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33800cc050 con 0x7f3368004800 2024-05-14T14:40:48.271 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.284+0000 7f338691c640 1 -- 172.21.15.39:0/3873769729 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3380076aa0 con 0x7f3368004800 2024-05-14T14:40:48.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.285+0000 7f337cff9640 1 -- 172.21.15.39:0/3873769729 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f337001d460 con 0x7f3368004800 2024-05-14T14:40:48.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.286+0000 7f337cff9640 1 --2- 172.21.15.39:0/3873769729 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f336c0762d0 0x7f336c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:48.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.286+0000 7f337f7fe640 1 --2- 172.21.15.39:0/3873769729 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f336c0762d0 0x7f336c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:48.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.286+0000 7f337cff9640 1 -- 172.21.15.39:0/3873769729 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f33700977f0 con 0x7f3368004800 2024-05-14T14:40:48.272 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.286+0000 7f337f7fe640 1 --2- 172.21.15.39:0/3873769729 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f336c0762d0 0x7f336c0787e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3374033000 tx=0x7f3374008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:48.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.291+0000 7f337cff9640 1 -- 172.21.15.39:0/3873769729 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3380160680 con 0x7f3368004800 2024-05-14T14:40:48.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.480+0000 7f338691c640 1 -- 172.21.15.39:0/3873769729 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f33800b8ad0 con 0x7f3368004800 2024-05-14T14:40:48.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.484+0000 7f337cff9640 1 -- 172.21.15.39:0/3873769729 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f3370060730 con 0x7f3368004800 2024-05-14T14:40:48.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.486+0000 7f338691c640 1 -- 172.21.15.39:0/3873769729 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f336c0762d0 msgr2=0x7f336c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:48.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.486+0000 7f338691c640 1 --2- 172.21.15.39:0/3873769729 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f336c0762d0 0x7f336c0787e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3374033000 tx=0x7f3374008030 comp rx=0 tx=0).stop 2024-05-14T14:40:48.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.486+0000 7f338691c640 1 -- 172.21.15.39:0/3873769729 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3368004800 msgr2=0x7f338014ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:48.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.486+0000 7f338691c640 1 --2- 172.21.15.39:0/3873769729 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3368004800 0x7f338014ef70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3370007340 tx=0x7f3370007800 comp rx=0 tx=0).stop 2024-05-14T14:40:48.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.486+0000 7f338691c640 1 -- 172.21.15.39:0/3873769729 shutdown_connections 2024-05-14T14:40:48.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.486+0000 7f338691c640 1 --2- 172.21.15.39:0/3873769729 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f336c0762d0 0x7f336c0787e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:48.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.486+0000 7f338691c640 1 --2- 172.21.15.39:0/3873769729 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f338015fd30 0x7f3380160140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:48.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.486+0000 7f338691c640 1 --2- 172.21.15.39:0/3873769729 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f33800ca840 0x7f33800cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:48.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.486+0000 7f338691c640 1 --2- 172.21.15.39:0/3873769729 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3368004800 0x7f338014ef70 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:48.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.486+0000 7f338691c640 1 -- 172.21.15.39:0/3873769729 >> 172.21.15.39:0/3873769729 conn(0x7f33800d65f0 msgr2=0x7f3380161b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:48.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.486+0000 7f338691c640 1 -- 172.21.15.39:0/3873769729 shutdown_connections 2024-05-14T14:40:48.472 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.486+0000 7f338691c640 1 -- 172.21.15.39:0/3873769729 wait complete. 2024-05-14T14:40:48.483 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-05-14T14:40:48.483 DEBUG:teuthology.orchestra.run.smithi039:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-14T14:40:48.521 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-05-14T14:40:48.571 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-05-14T14:40:48.571 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T14:40:48.571 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T14:40:48.588 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T14:40:48.588 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T14:40:48.644 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T14:40:48.644 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T14:40:48.702 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-14T14:40:48.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.873+0000 7fd7044aa640 1 Processor -- start 2024-05-14T14:40:48.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.873+0000 7fd7044aa640 1 -- start start 2024-05-14T14:40:48.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.874+0000 7fd7044aa640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd6fc0b4ec0 0x7fd6fc1602d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:48.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.874+0000 7fd7044aa640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd6fc0d0ad0 0x7fd6fc0d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:48.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.875+0000 7fd7044aa640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6fc0d5840 con 0x7fd6fc0d1420 2024-05-14T14:40:48.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.875+0000 7fd7044aa640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fd6fc0d4d50 con 0x7fd6fc0b4ec0 2024-05-14T14:40:48.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.875+0000 7fd7044aa640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fd6fc06c840 con 0x7fd6fc0d0ad0 2024-05-14T14:40:48.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.875+0000 7fd702a47640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fd6fc0d1420 0x7fd6fc163e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:32938/0 (socket says 172.21.15.39:32938) 2024-05-14T14:40:48.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.875+0000 7fd702a47640 1 -- 172.21.15.39:0/4205182169 learned_addr learned my addr 172.21.15.39:0/4205182169 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:48.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.875+0000 7fd701a45640 1 --2- 172.21.15.39:0/4205182169 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd6fc0d0ad0 0x7fd6fc0d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:48.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.875+0000 7fd702246640 1 --2- 172.21.15.39:0/4205182169 >> v2:172.21.15.62:3300/0 conn(0x7fd6fc0b4ec0 0x7fd6fc1602d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:48.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.875+0000 7fd701244640 1 -- 172.21.15.39:0/4205182169 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2617475487 0 0) 0x7fd6fc0d5840 con 0x7fd6fc0d1420 2024-05-14T14:40:48.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.875+0000 7fd701244640 1 -- 172.21.15.39:0/4205182169 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6e4003520 con 0x7fd6fc0d1420 2024-05-14T14:40:48.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.875+0000 7fd701244640 1 -- 172.21.15.39:0/4205182169 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 305057625 0 0) 0x7fd6e4003520 con 0x7fd6fc0d1420 2024-05-14T14:40:48.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.875+0000 7fd701244640 1 -- 172.21.15.39:0/4205182169 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd6fc0d0ad0 msgr2=0x7fd6fc0d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:48.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.875+0000 7fd701244640 1 --2- 172.21.15.39:0/4205182169 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd6fc0d0ad0 0x7fd6fc0d0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:48.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.875+0000 7fd701244640 1 -- 172.21.15.39:0/4205182169 >> v2:172.21.15.62:3300/0 conn(0x7fd6fc0b4ec0 msgr2=0x7fd6fc1602d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:48.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.875+0000 7fd701244640 1 --2- 172.21.15.39:0/4205182169 >> v2:172.21.15.62:3300/0 conn(0x7fd6fc0b4ec0 0x7fd6fc1602d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:48.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.875+0000 7fd701244640 1 -- 172.21.15.39:0/4205182169 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6fc0d1830 con 0x7fd6fc0d1420 2024-05-14T14:40:48.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.875+0000 7fd701244640 1 -- 172.21.15.39:0/4205182169 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1803005051 0 0) 0x7fd6f40016f0 con 0x7fd6fc0d1420 2024-05-14T14:40:48.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.875+0000 7fd701244640 1 -- 172.21.15.39:0/4205182169 >> v1:172.21.15.39:6789/0 conn(0x7fd6fc0d1420 legacy=0x7fd6fc163e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:48.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.875+0000 7fd701244640 1 --2- 172.21.15.39:0/4205182169 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd6fc0d0ad0 0x7fd6e4003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:48.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.875+0000 7fd701244640 1 --2- 172.21.15.39:0/4205182169 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6e4003fd0 0x7fd6e4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:48.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.875+0000 7fd701244640 1 --2- 172.21.15.39:0/4205182169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6e4004d40 0x7fd6e4005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:48.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.875+0000 7fd701244640 1 -- 172.21.15.39:0/4205182169 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd6fc0d4d50 con 0x7fd6e4003fd0 2024-05-14T14:40:48.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.875+0000 7fd701244640 1 -- 172.21.15.39:0/4205182169 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd6fc06c840 con 0x7fd6e4004d40 2024-05-14T14:40:48.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.875+0000 7fd701244640 1 -- 172.21.15.39:0/4205182169 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fd6e400bac0 con 0x7fd6fc0d0ad0 2024-05-14T14:40:48.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.876+0000 7fd701a45640 1 --2- 172.21.15.39:0/4205182169 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6e4003fd0 0x7fd6e4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:48.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.876+0000 7fd702246640 1 --2- 172.21.15.39:0/4205182169 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd6fc0d0ad0 0x7fd6e4003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:48.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.876+0000 7fd702a47640 1 --2- 172.21.15.39:0/4205182169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6e4004d40 0x7fd6e4005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:48.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.876+0000 7fd701a45640 1 -- 172.21.15.39:0/4205182169 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd6fc0d0ad0 msgr2=0x7fd6e4003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:48.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.876+0000 7fd701a45640 1 --2- 172.21.15.39:0/4205182169 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd6fc0d0ad0 0x7fd6e4003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:48.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.876+0000 7fd701a45640 1 -- 172.21.15.39:0/4205182169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6e4004d40 msgr2=0x7fd6e4005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:48.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.876+0000 7fd701a45640 1 --2- 172.21.15.39:0/4205182169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6e4004d40 0x7fd6e4005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:48.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.876+0000 7fd701a45640 1 -- 172.21.15.39:0/4205182169 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6e4003520 con 0x7fd6e4003fd0 2024-05-14T14:40:48.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.876+0000 7fd702a47640 1 --2- 172.21.15.39:0/4205182169 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6e4004d40 0x7fd6e4005150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:40:48.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.877+0000 7fd701a45640 1 --2- 172.21.15.39:0/4205182169 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6e4003fd0 0x7fd6e4004800 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0009fc0 tx=0x7fd6e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bed5c2ee8ca0711 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:48.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.877+0000 7fd701244640 1 -- 172.21.15.39:0/4205182169 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f0034020 con 0x7fd6e4003fd0 2024-05-14T14:40:48.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.877+0000 7fd701244640 1 -- 172.21.15.39:0/4205182169 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6f00305f0 con 0x7fd6e4003fd0 2024-05-14T14:40:48.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.877+0000 7fd701244640 1 -- 172.21.15.39:0/4205182169 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f0009c10 con 0x7fd6e4003fd0 2024-05-14T14:40:48.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.877+0000 7fd7044aa640 1 -- 172.21.15.39:0/4205182169 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6e4003fd0 msgr2=0x7fd6e4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:48.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.877+0000 7fd7044aa640 1 --2- 172.21.15.39:0/4205182169 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6e4003fd0 0x7fd6e4004800 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0009fc0 tx=0x7fd6e4005830 comp rx=0 tx=0).stop 2024-05-14T14:40:48.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.877+0000 7fd702a47640 1 -- 172.21.15.39:0/4205182169 reap_dead start 2024-05-14T14:40:48.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.878+0000 7fd7044aa640 1 -- 172.21.15.39:0/4205182169 shutdown_connections 2024-05-14T14:40:48.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.878+0000 7fd7044aa640 1 -- 172.21.15.39:0/4205182169 >> 172.21.15.39:0/4205182169 conn(0x7fd6fc06f270 msgr2=0x7fd6fc0d5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:48.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.878+0000 7fd7044aa640 1 -- 172.21.15.39:0/4205182169 shutdown_connections 2024-05-14T14:40:48.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.878+0000 7fd7044aa640 1 -- 172.21.15.39:0/4205182169 wait complete. 2024-05-14T14:40:48.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.879+0000 7fd7044aa640 1 Processor -- start 2024-05-14T14:40:48.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.880+0000 7fd7044aa640 1 -- start start 2024-05-14T14:40:48.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.881+0000 7fd7044aa640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd6e4003fd0 0x7fd6fc157e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:48.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.881+0000 7fd7044aa640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6fc1602d0 0x7fd6fc1f6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:48.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.881+0000 7fd7044aa640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6fc0ce880 0x7fd6fc0cec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:48.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.881+0000 7fd7044aa640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fd6fc0d5560 con 0x7fd6fc0ce880 2024-05-14T14:40:48.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.881+0000 7fd7044aa640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fd6fc0d5280 con 0x7fd6fc1602d0 2024-05-14T14:40:48.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.881+0000 7fd7044aa640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fd6fc0b5480 con 0x7fd6e4003fd0 2024-05-14T14:40:48.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.881+0000 7fd702a47640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6fc0ce880 0x7fd6fc0cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:48.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.881+0000 7fd702a47640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6fc0ce880 0x7fd6fc0cec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36624/0 (socket says 172.21.15.39:36624) 2024-05-14T14:40:48.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.881+0000 7fd702a47640 1 -- 172.21.15.39:0/3021115250 learned_addr learned my addr 172.21.15.39:0/3021115250 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:48.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.881+0000 7fd701a45640 1 --2- 172.21.15.39:0/3021115250 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6fc1602d0 0x7fd6fc1f6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:48.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.881+0000 7fd702246640 1 --2- 172.21.15.39:0/3021115250 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd6e4003fd0 0x7fd6fc157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:48.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.881+0000 7fd702a47640 1 -- 172.21.15.39:0/3021115250 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd6e4003fd0 msgr2=0x7fd6fc157e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:48.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.881+0000 7fd702a47640 1 --2- 172.21.15.39:0/3021115250 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd6e4003fd0 0x7fd6fc157e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:48.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.881+0000 7fd702a47640 1 -- 172.21.15.39:0/3021115250 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6fc1602d0 msgr2=0x7fd6fc1f6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:48.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.881+0000 7fd702a47640 1 --2- 172.21.15.39:0/3021115250 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6fc1602d0 0x7fd6fc1f6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:48.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.881+0000 7fd702a47640 1 -- 172.21.15.39:0/3021115250 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6fc0cf1d0 con 0x7fd6fc0ce880 2024-05-14T14:40:48.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.882+0000 7fd702a47640 1 --2- 172.21.15.39:0/3021115250 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6fc0ce880 0x7fd6fc0cec90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc08e6f0 tx=0x7fd6f400ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:48.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.882+0000 7fd6faffd640 1 -- 172.21.15.39:0/3021115250 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f4019070 con 0x7fd6fc0ce880 2024-05-14T14:40:48.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.882+0000 7fd6faffd640 1 -- 172.21.15.39:0/3021115250 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6f4010510 con 0x7fd6fc0ce880 2024-05-14T14:40:48.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.882+0000 7fd6faffd640 1 -- 172.21.15.39:0/3021115250 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f4010920 con 0x7fd6fc0ce880 2024-05-14T14:40:48.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.882+0000 7fd7044aa640 1 -- 172.21.15.39:0/3021115250 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6fc1609e0 con 0x7fd6fc0ce880 2024-05-14T14:40:48.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.882+0000 7fd7044aa640 1 -- 172.21.15.39:0/3021115250 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6fc160fa0 con 0x7fd6fc0ce880 2024-05-14T14:40:48.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.883+0000 7fd7044aa640 1 -- 172.21.15.39:0/3021115250 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6fc076aa0 con 0x7fd6fc0ce880 2024-05-14T14:40:48.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.884+0000 7fd6faffd640 1 -- 172.21.15.39:0/3021115250 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fd6f401c070 con 0x7fd6fc0ce880 2024-05-14T14:40:48.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.884+0000 7fd6faffd640 1 --2- 172.21.15.39:0/3021115250 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fd6e80762d0 0x7fd6e80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:48.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.884+0000 7fd6faffd640 1 -- 172.21.15.39:0/3021115250 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd6f4096d50 con 0x7fd6fc0ce880 2024-05-14T14:40:48.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.884+0000 7fd702246640 1 --2- 172.21.15.39:0/3021115250 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fd6e80762d0 0x7fd6e80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:48.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.885+0000 7fd702246640 1 --2- 172.21.15.39:0/3021115250 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fd6e80762d0 0x7fd6e80787e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec009bc0 tx=0x7fd6ec009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:48.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:48.889+0000 7fd6faffd640 1 -- 172.21.15.39:0/3021115250 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fd6f409a030 con 0x7fd6fc0ce880 2024-05-14T14:40:49.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.095+0000 7fd7044aa640 1 -- 172.21.15.39:0/3021115250 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd6fc160770 con 0x7fd6fc0ce880 2024-05-14T14:40:49.080 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.095+0000 7fd6faffd640 1 -- 172.21.15.39:0/3021115250 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7fd6fc0cf1d0 con 0x7fd6fc0ce880 2024-05-14T14:40:49.080 INFO:teuthology.orchestra.run.smithi039.stderr:listed 0 entries 2024-05-14T14:40:49.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.097+0000 7fd7044aa640 1 -- 172.21.15.39:0/3021115250 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fd6e80762d0 msgr2=0x7fd6e80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:49.082 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.097+0000 7fd7044aa640 1 --2- 172.21.15.39:0/3021115250 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fd6e80762d0 0x7fd6e80787e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec009bc0 tx=0x7fd6ec009190 comp rx=0 tx=0).stop 2024-05-14T14:40:49.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.097+0000 7fd7044aa640 1 -- 172.21.15.39:0/3021115250 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6fc0ce880 msgr2=0x7fd6fc0cec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:49.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.097+0000 7fd7044aa640 1 --2- 172.21.15.39:0/3021115250 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6fc0ce880 0x7fd6fc0cec90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc08e6f0 tx=0x7fd6f400ead0 comp rx=0 tx=0).stop 2024-05-14T14:40:49.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.097+0000 7fd7044aa640 1 -- 172.21.15.39:0/3021115250 shutdown_connections 2024-05-14T14:40:49.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.097+0000 7fd7044aa640 1 --2- 172.21.15.39:0/3021115250 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fd6e80762d0 0x7fd6e80787e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:49.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.097+0000 7fd7044aa640 1 --2- 172.21.15.39:0/3021115250 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fd6fc0ce880 0x7fd6fc0cec90 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:49.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.097+0000 7fd7044aa640 1 --2- 172.21.15.39:0/3021115250 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd6fc1602d0 0x7fd6fc1f6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:49.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.097+0000 7fd7044aa640 1 --2- 172.21.15.39:0/3021115250 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fd6e4003fd0 0x7fd6fc157e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:49.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.097+0000 7fd7044aa640 1 -- 172.21.15.39:0/3021115250 >> 172.21.15.39:0/3021115250 conn(0x7fd6fc06f270 msgr2=0x7fd6fc0ba140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:49.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.097+0000 7fd7044aa640 1 -- 172.21.15.39:0/3021115250 shutdown_connections 2024-05-14T14:40:49.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.097+0000 7fd7044aa640 1 -- 172.21.15.39:0/3021115250 wait complete. 2024-05-14T14:40:49.093 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-14T14:40:49.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:49.094 DEBUG:teuthology.orchestra.run.smithi039:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-05-14T14:40:49.121 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi039.front.sepia.ceph.com 2024-05-14T14:40:49.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:49.121 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-14T14:40:49.178 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-14T14:40:49.178 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T14:40:49.198 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-14T14:40:49.199 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T14:40:49.259 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-14T14:40:49.259 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T14:40:49.323 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-14T14:40:49.439 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.454+0000 7f6262a13640 1 Processor -- start 2024-05-14T14:40:49.440 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.455+0000 7f6262a13640 1 -- start start 2024-05-14T14:40:49.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.456+0000 7f6262a13640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f625c0d1310 0x7f625c06d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:49.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.456+0000 7f6262a13640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f625c06d5f0 0x7f625c0ba070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:49.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.456+0000 7f6262a13640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f625c0b9310 con 0x7f625c160420 2024-05-14T14:40:49.441 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.456+0000 7f6262a13640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f625c06dd70 con 0x7f625c06d5f0 2024-05-14T14:40:49.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.456+0000 7f6262a13640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f625c0b9590 con 0x7f625c0d1310 2024-05-14T14:40:49.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.456+0000 7f6260fb0640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f625c06d5f0 0x7f625c0ba070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:49.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.456+0000 7f6260fb0640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f625c06d5f0 0x7f625c0ba070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36632/0 (socket says 172.21.15.39:36632) 2024-05-14T14:40:49.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.456+0000 7f6260fb0640 1 -- 172.21.15.39:0/1783049251 learned_addr learned my addr 172.21.15.39:0/1783049251 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:49.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.456+0000 7f625b7fe640 1 --2- 172.21.15.39:0/1783049251 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f625c0d1310 0x7f625c06d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:49.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.456+0000 7f6260fb0640 1 -- 172.21.15.39:0/1783049251 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f625c0d1310 msgr2=0x7f625c06d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:49.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.456+0000 7f6260fb0640 1 --2- 172.21.15.39:0/1783049251 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f625c0d1310 0x7f625c06d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:49.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.456+0000 7f6260fb0640 1 -- 172.21.15.39:0/1783049251 >> v1:172.21.15.62:6789/0 conn(0x7f625c160420 legacy=0x7f625c0d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:49.442 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.456+0000 7f6260fb0640 1 -- 172.21.15.39:0/1783049251 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f625c0b9870 con 0x7f625c06d5f0 2024-05-14T14:40:49.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.457+0000 7f6260fb0640 1 --2- 172.21.15.39:0/1783049251 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f625c06d5f0 0x7f625c0ba070 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6254009e50 tx=0x7f625402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deb9fb1c8d45e256 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:49.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.457+0000 7f625affd640 1 -- 172.21.15.39:0/1783049251 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6254036070 con 0x7f625c06d5f0 2024-05-14T14:40:49.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.457+0000 7f625affd640 1 -- 172.21.15.39:0/1783049251 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6254031600 con 0x7f625c06d5f0 2024-05-14T14:40:49.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.457+0000 7f625affd640 1 -- 172.21.15.39:0/1783049251 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62540319d0 con 0x7f625c06d5f0 2024-05-14T14:40:49.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.458+0000 7f6262a13640 1 -- 172.21.15.39:0/1783049251 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f625c06d5f0 msgr2=0x7f625c0ba070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:49.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.458+0000 7f6262a13640 1 --2- 172.21.15.39:0/1783049251 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f625c06d5f0 0x7f625c0ba070 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6254009e50 tx=0x7f625402a5f0 comp rx=0 tx=0).stop 2024-05-14T14:40:49.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.458+0000 7f6262a13640 1 -- 172.21.15.39:0/1783049251 shutdown_connections 2024-05-14T14:40:49.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.458+0000 7f6262a13640 1 --2- 172.21.15.39:0/1783049251 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f625c06d5f0 0x7f625c0ba070 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:49.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.458+0000 7f6262a13640 1 --2- 172.21.15.39:0/1783049251 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f625c0d1310 0x7f625c06d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:49.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.458+0000 7f6262a13640 1 -- 172.21.15.39:0/1783049251 >> 172.21.15.39:0/1783049251 conn(0x7f625c0d27d0 msgr2=0x7f625c0d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:49.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.458+0000 7f6262a13640 1 -- 172.21.15.39:0/1783049251 shutdown_connections 2024-05-14T14:40:49.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.458+0000 7f6262a13640 1 -- 172.21.15.39:0/1783049251 wait complete. 2024-05-14T14:40:49.445 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.460+0000 7f6262a13640 1 Processor -- start 2024-05-14T14:40:49.446 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.460+0000 7f6262a13640 1 -- start start 2024-05-14T14:40:49.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.461+0000 7f6262a13640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f625c06d5f0 0x7f625c0ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:49.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.462+0000 7f6262a13640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f625c160420 0x7f625c0b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:49.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.462+0000 7f6262a13640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f625c0cc890 0x7f625c0d5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:49.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.462+0000 7f6262a13640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f625c06da00 con 0x7f625c160420 2024-05-14T14:40:49.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.462+0000 7f6262a13640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f625c160830 con 0x7f625c06d5f0 2024-05-14T14:40:49.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.462+0000 7f6262a13640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f625c0ba5b0 con 0x7f625c0cc890 2024-05-14T14:40:49.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.462+0000 7f625b7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f625c160420 0x7f625c0b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:49.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.462+0000 7f625b7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f625c160420 0x7f625c0b4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36642/0 (socket says 172.21.15.39:36642) 2024-05-14T14:40:49.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.462+0000 7f625b7fe640 1 -- 172.21.15.39:0/1078531616 learned_addr learned my addr 172.21.15.39:0/1078531616 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:49.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.462+0000 7f6260fb0640 1 --2- 172.21.15.39:0/1078531616 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f625c0cc890 0x7f625c0d5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:49.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.462+0000 7f625bfff640 1 --2- 172.21.15.39:0/1078531616 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f625c06d5f0 0x7f625c0ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:49.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.462+0000 7f625b7fe640 1 -- 172.21.15.39:0/1078531616 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f625c0cc890 msgr2=0x7f625c0d5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:49.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.462+0000 7f625b7fe640 1 --2- 172.21.15.39:0/1078531616 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f625c0cc890 0x7f625c0d5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:49.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.462+0000 7f625b7fe640 1 -- 172.21.15.39:0/1078531616 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f625c06d5f0 msgr2=0x7f625c0ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:49.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.462+0000 7f625b7fe640 1 --2- 172.21.15.39:0/1078531616 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f625c06d5f0 0x7f625c0ccd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:49.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.462+0000 7f625b7fe640 1 -- 172.21.15.39:0/1078531616 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f625c0cd670 con 0x7f625c160420 2024-05-14T14:40:49.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.462+0000 7f625bfff640 1 --2- 172.21.15.39:0/1078531616 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f625c06d5f0 0x7f625c0ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:40:49.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.462+0000 7f625b7fe640 1 --2- 172.21.15.39:0/1078531616 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f625c160420 0x7f625c0b4e80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f625000d5f0 tx=0x7f625000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:49.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.462+0000 7f6258ff9640 1 -- 172.21.15.39:0/1078531616 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62500125f0 con 0x7f625c160420 2024-05-14T14:40:49.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.462+0000 7f6258ff9640 1 -- 172.21.15.39:0/1078531616 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6250019070 con 0x7f625c160420 2024-05-14T14:40:49.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.462+0000 7f6262a13640 1 -- 172.21.15.39:0/1078531616 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f625c0cd950 con 0x7f625c160420 2024-05-14T14:40:49.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.463+0000 7f6258ff9640 1 -- 172.21.15.39:0/1078531616 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62500129d0 con 0x7f625c160420 2024-05-14T14:40:49.449 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.463+0000 7f6262a13640 1 -- 172.21.15.39:0/1078531616 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f625c0ce680 con 0x7f625c160420 2024-05-14T14:40:49.450 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.464+0000 7f6262a13640 1 -- 172.21.15.39:0/1078531616 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f625c0d20d0 con 0x7f625c160420 2024-05-14T14:40:49.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.464+0000 7f6258ff9640 1 -- 172.21.15.39:0/1078531616 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6250012b70 con 0x7f625c160420 2024-05-14T14:40:49.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.465+0000 7f6258ff9640 1 --2- 172.21.15.39:0/1078531616 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f62480762d0 0x7f62480787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:49.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.465+0000 7f6258ff9640 1 -- 172.21.15.39:0/1078531616 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6250097cc0 con 0x7f625c160420 2024-05-14T14:40:49.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.465+0000 7f625bfff640 1 --2- 172.21.15.39:0/1078531616 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f62480762d0 0x7f62480787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:49.451 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.465+0000 7f625bfff640 1 --2- 172.21.15.39:0/1078531616 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f62480762d0 0x7f62480787e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f624c006fd0 tx=0x7f624c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:49.454 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.470+0000 7f6258ff9640 1 -- 172.21.15.39:0/1078531616 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f625c0d20d0 con 0x7f625c160420 2024-05-14T14:40:49.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.674+0000 7f6262a13640 1 -- 172.21.15.39:0/1078531616 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f625c0cd400 con 0x7f625c160420 2024-05-14T14:40:49.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.675+0000 7f6258ff9640 1 -- 172.21.15.39:0/1078531616 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f62500612e0 con 0x7f625c160420 2024-05-14T14:40:49.660 INFO:teuthology.orchestra.run.smithi039.stderr:listed 0 entries 2024-05-14T14:40:49.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.677+0000 7f6262a13640 1 -- 172.21.15.39:0/1078531616 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f62480762d0 msgr2=0x7f62480787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:49.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.677+0000 7f6262a13640 1 --2- 172.21.15.39:0/1078531616 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f62480762d0 0x7f62480787e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f624c006fd0 tx=0x7f624c008040 comp rx=0 tx=0).stop 2024-05-14T14:40:49.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.677+0000 7f6262a13640 1 -- 172.21.15.39:0/1078531616 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f625c160420 msgr2=0x7f625c0b4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:49.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.677+0000 7f6262a13640 1 --2- 172.21.15.39:0/1078531616 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f625c160420 0x7f625c0b4e80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f625000d5f0 tx=0x7f625000dab0 comp rx=0 tx=0).stop 2024-05-14T14:40:49.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.677+0000 7f6262a13640 1 -- 172.21.15.39:0/1078531616 shutdown_connections 2024-05-14T14:40:49.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.677+0000 7f6262a13640 1 --2- 172.21.15.39:0/1078531616 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f62480762d0 0x7f62480787e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:49.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.677+0000 7f6262a13640 1 --2- 172.21.15.39:0/1078531616 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f625c0cc890 0x7f625c0d5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:49.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.677+0000 7f6262a13640 1 --2- 172.21.15.39:0/1078531616 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f625c160420 0x7f625c0b4e80 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:49.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.677+0000 7f6262a13640 1 --2- 172.21.15.39:0/1078531616 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f625c06d5f0 0x7f625c0ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:49.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.677+0000 7f6262a13640 1 -- 172.21.15.39:0/1078531616 >> 172.21.15.39:0/1078531616 conn(0x7f625c0d27d0 msgr2=0x7f625c15f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:49.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.677+0000 7f6262a13640 1 -- 172.21.15.39:0/1078531616 shutdown_connections 2024-05-14T14:40:49.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:49.677+0000 7f6262a13640 1 -- 172.21.15.39:0/1078531616 wait complete. 2024-05-14T14:40:49.673 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-05-14T14:40:49.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:49.673 DEBUG:teuthology.orchestra.run.smithi062:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-05-14T14:40:49.707 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi062.front.sepia.ceph.com 2024-05-14T14:40:49.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:49.708 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-14T14:40:49.781 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T14:40:49.781 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T14:40:49.798 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T14:40:49.798 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T14:40:49.854 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T14:40:49.854 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T14:40:49.912 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-14T14:40:50.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.082+0000 7f3ccbf40640 1 Processor -- start 2024-05-14T14:40:50.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.082+0000 7f3ccbf40640 1 -- start start 2024-05-14T14:40:50.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.084+0000 7f3ccbf40640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3cc40b55e0 0x7f3cc40cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:50.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.084+0000 7f3ccbf40640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3cc40d0570 0x7f3cc40d0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:50.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.084+0000 7f3ccbf40640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cc40d0ec0 con 0x7f3cc406e570 2024-05-14T14:40:50.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.084+0000 7f3ccbf40640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f3cc40d2440 con 0x7f3cc40d0570 2024-05-14T14:40:50.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.084+0000 7f3ccbf40640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f3cc40b5b10 con 0x7f3cc40b55e0 2024-05-14T14:40:50.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.084+0000 7f3cc9cdc640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f3cc406e570 0x7f3cc41601c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:32950/0 (socket says 172.21.15.39:32950) 2024-05-14T14:40:50.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.084+0000 7f3cc9cdc640 1 -- 172.21.15.39:0/3213102690 learned_addr learned my addr 172.21.15.39:0/3213102690 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:50.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.084+0000 7f3cc8cda640 1 -- 172.21.15.39:0/3213102690 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3720702017 0 0) 0x7f3cb4001490 con 0x7f3cc406e570 2024-05-14T14:40:50.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.084+0000 7f3cc8cda640 1 -- 172.21.15.39:0/3213102690 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3cac003520 con 0x7f3cc406e570 2024-05-14T14:40:50.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.084+0000 7f3cc94db640 1 --2- 172.21.15.39:0/3213102690 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3cc40b55e0 0x7f3cc40cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:50.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.084+0000 7f3cca4dd640 1 --2- 172.21.15.39:0/3213102690 >> v2:172.21.15.62:3300/0 conn(0x7f3cc40d0570 0x7f3cc40d0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:50.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.084+0000 7f3cc8cda640 1 -- 172.21.15.39:0/3213102690 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2685842852 0 0) 0x7f3cac003520 con 0x7f3cc406e570 2024-05-14T14:40:50.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.084+0000 7f3cc8cda640 1 -- 172.21.15.39:0/3213102690 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3cc40b55e0 msgr2=0x7f3cc40cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:50.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.084+0000 7f3cc8cda640 1 --2- 172.21.15.39:0/3213102690 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3cc40b55e0 0x7f3cc40cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:50.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.084+0000 7f3cc8cda640 1 -- 172.21.15.39:0/3213102690 >> v2:172.21.15.62:3300/0 conn(0x7f3cc40d0570 msgr2=0x7f3cc40d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:50.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.084+0000 7f3cc8cda640 1 --2- 172.21.15.39:0/3213102690 >> v2:172.21.15.62:3300/0 conn(0x7f3cc40d0570 0x7f3cc40d0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:50.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.084+0000 7f3cc8cda640 1 -- 172.21.15.39:0/3213102690 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cc40b5df0 con 0x7f3cc406e570 2024-05-14T14:40:50.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.084+0000 7f3cc8cda640 1 -- 172.21.15.39:0/3213102690 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1803005051 0 0) 0x7f3cb4001c40 con 0x7f3cc406e570 2024-05-14T14:40:50.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.085+0000 7f3cc8cda640 1 -- 172.21.15.39:0/3213102690 >> v1:172.21.15.39:6789/0 conn(0x7f3cc406e570 legacy=0x7f3cc41601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:50.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.085+0000 7f3cc8cda640 1 --2- 172.21.15.39:0/3213102690 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3cc40b55e0 0x7f3cac003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:50.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.085+0000 7f3cc8cda640 1 --2- 172.21.15.39:0/3213102690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3cac003fd0 0x7f3cac004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:50.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.085+0000 7f3cc8cda640 1 --2- 172.21.15.39:0/3213102690 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3cac004d40 0x7f3cac005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:50.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.085+0000 7f3cc8cda640 1 -- 172.21.15.39:0/3213102690 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc40d2440 con 0x7f3cac004d40 2024-05-14T14:40:50.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.085+0000 7f3cc8cda640 1 -- 172.21.15.39:0/3213102690 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc40b5b10 con 0x7f3cac003fd0 2024-05-14T14:40:50.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.085+0000 7f3cc8cda640 1 -- 172.21.15.39:0/3213102690 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f3cac00bac0 con 0x7f3cc40b55e0 2024-05-14T14:40:50.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.085+0000 7f3cca4dd640 1 --2- 172.21.15.39:0/3213102690 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3cac004d40 0x7f3cac005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:50.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.085+0000 7f3cc94db640 1 --2- 172.21.15.39:0/3213102690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3cac003fd0 0x7f3cac004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:50.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.085+0000 7f3cc9cdc640 1 --2- 172.21.15.39:0/3213102690 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3cc40b55e0 0x7f3cac003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:50.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.085+0000 7f3cca4dd640 1 -- 172.21.15.39:0/3213102690 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3cc40b55e0 msgr2=0x7f3cac003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:50.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.085+0000 7f3cca4dd640 1 --2- 172.21.15.39:0/3213102690 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3cc40b55e0 0x7f3cac003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:50.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.085+0000 7f3cca4dd640 1 -- 172.21.15.39:0/3213102690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3cac003fd0 msgr2=0x7f3cac004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:50.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.085+0000 7f3cca4dd640 1 --2- 172.21.15.39:0/3213102690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3cac003fd0 0x7f3cac004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:50.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.085+0000 7f3cca4dd640 1 -- 172.21.15.39:0/3213102690 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cac003520 con 0x7f3cac004d40 2024-05-14T14:40:50.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.086+0000 7f3cca4dd640 1 --2- 172.21.15.39:0/3213102690 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3cac004d40 0x7f3cac005150 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc009ac0 tx=0x7f3cac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da4081d9991b8761 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:50.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.086+0000 7f3cc8cda640 1 -- 172.21.15.39:0/3213102690 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc036070 con 0x7f3cac004d40 2024-05-14T14:40:50.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.086+0000 7f3cc8cda640 1 -- 172.21.15.39:0/3213102690 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cbc031400 con 0x7f3cac004d40 2024-05-14T14:40:50.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.086+0000 7f3cc8cda640 1 -- 172.21.15.39:0/3213102690 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc009690 con 0x7f3cac004d40 2024-05-14T14:40:50.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.087+0000 7f3ccbf40640 1 -- 172.21.15.39:0/3213102690 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3cac004d40 msgr2=0x7f3cac005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:50.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.087+0000 7f3ccbf40640 1 --2- 172.21.15.39:0/3213102690 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3cac004d40 0x7f3cac005150 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc009ac0 tx=0x7f3cac005830 comp rx=0 tx=0).stop 2024-05-14T14:40:50.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.087+0000 7f3cca4dd640 1 -- 172.21.15.39:0/3213102690 reap_dead start 2024-05-14T14:40:50.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.087+0000 7f3ccbf40640 1 -- 172.21.15.39:0/3213102690 shutdown_connections 2024-05-14T14:40:50.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.087+0000 7f3ccbf40640 1 -- 172.21.15.39:0/3213102690 >> 172.21.15.39:0/3213102690 conn(0x7f3cc4071680 msgr2=0x7f3cc4071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:50.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.087+0000 7f3ccbf40640 1 -- 172.21.15.39:0/3213102690 shutdown_connections 2024-05-14T14:40:50.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.087+0000 7f3ccbf40640 1 -- 172.21.15.39:0/3213102690 wait complete. 2024-05-14T14:40:50.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.089+0000 7f3ccbf40640 1 Processor -- start 2024-05-14T14:40:50.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.089+0000 7f3ccbf40640 1 -- start start 2024-05-14T14:40:50.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.090+0000 7f3ccbf40640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3cc41ebc60 0x7f3cc414ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:50.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.090+0000 7f3ccbf40640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3cc4161de0 0x7f3cc41621f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:50.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.090+0000 7f3ccbf40640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3cc41e89a0 0x7f3cc41e8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:50.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.090+0000 7f3ccbf40640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc40cf0c0 con 0x7f3cc41e89a0 2024-05-14T14:40:50.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.090+0000 7f3ccbf40640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc40b63b0 con 0x7f3cc4161de0 2024-05-14T14:40:50.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.090+0000 7f3ccbf40640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f3cc40cf240 con 0x7f3cc41ebc60 2024-05-14T14:40:50.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.090+0000 7f3cca4dd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3cc41e89a0 0x7f3cc41e8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:50.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.090+0000 7f3cca4dd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3cc41e89a0 0x7f3cc41e8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36660/0 (socket says 172.21.15.39:36660) 2024-05-14T14:40:50.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.090+0000 7f3cca4dd640 1 -- 172.21.15.39:0/2220370781 learned_addr learned my addr 172.21.15.39:0/2220370781 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:50.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.090+0000 7f3cc94db640 1 --2- 172.21.15.39:0/2220370781 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3cc4161de0 0x7f3cc41621f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:50.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.090+0000 7f3cc9cdc640 1 --2- 172.21.15.39:0/2220370781 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3cc41ebc60 0x7f3cc414ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:50.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.090+0000 7f3cca4dd640 1 -- 172.21.15.39:0/2220370781 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3cc41ebc60 msgr2=0x7f3cc414ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:50.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.090+0000 7f3cca4dd640 1 --2- 172.21.15.39:0/2220370781 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3cc41ebc60 0x7f3cc414ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:50.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.090+0000 7f3cca4dd640 1 -- 172.21.15.39:0/2220370781 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3cc4161de0 msgr2=0x7f3cc41621f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:50.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.090+0000 7f3cca4dd640 1 --2- 172.21.15.39:0/2220370781 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3cc4161de0 0x7f3cc41621f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:50.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.090+0000 7f3cca4dd640 1 -- 172.21.15.39:0/2220370781 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cc4162730 con 0x7f3cc41e89a0 2024-05-14T14:40:50.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.091+0000 7f3cca4dd640 1 --2- 172.21.15.39:0/2220370781 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3cc41e89a0 0x7f3cc41e8db0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc009ac0 tx=0x7f3cbc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:50.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.091+0000 7f3cc27fc640 1 -- 172.21.15.39:0/2220370781 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc036070 con 0x7f3cc41e89a0 2024-05-14T14:40:50.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.091+0000 7f3cc27fc640 1 -- 172.21.15.39:0/2220370781 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cbc040070 con 0x7f3cc41e89a0 2024-05-14T14:40:50.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.091+0000 7f3cc27fc640 1 -- 172.21.15.39:0/2220370781 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc009690 con 0x7f3cc41e89a0 2024-05-14T14:40:50.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.091+0000 7f3ccbf40640 1 -- 172.21.15.39:0/2220370781 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cc414f4d0 con 0x7f3cc41e89a0 2024-05-14T14:40:50.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.091+0000 7f3ccbf40640 1 -- 172.21.15.39:0/2220370781 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cc415b170 con 0x7f3cc41e89a0 2024-05-14T14:40:50.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.092+0000 7f3ccbf40640 1 -- 172.21.15.39:0/2220370781 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cc4076aa0 con 0x7f3cc41e89a0 2024-05-14T14:40:50.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.093+0000 7f3cc27fc640 1 -- 172.21.15.39:0/2220370781 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f3cbc045460 con 0x7f3cc41e89a0 2024-05-14T14:40:50.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.093+0000 7f3cc27fc640 1 --2- 172.21.15.39:0/2220370781 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f3cb00762d0 0x7f3cb00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:50.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.093+0000 7f3cc27fc640 1 -- 172.21.15.39:0/2220370781 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3cbc0b79b0 con 0x7f3cc41e89a0 2024-05-14T14:40:50.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.093+0000 7f3cc9cdc640 1 --2- 172.21.15.39:0/2220370781 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f3cb00762d0 0x7f3cb00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:50.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.094+0000 7f3cc9cdc640 1 --2- 172.21.15.39:0/2220370781 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f3cb00762d0 0x7f3cb00787e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3cb40016b0 tx=0x7f3cb4006040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:50.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.098+0000 7f3cc27fc640 1 -- 172.21.15.39:0/2220370781 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f3cc4162730 con 0x7f3cc41e89a0 2024-05-14T14:40:50.286 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.302+0000 7f3ccbf40640 1 -- 172.21.15.39:0/2220370781 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3cc40d1ff0 con 0x7f3cc41e89a0 2024-05-14T14:40:50.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.302+0000 7f3cc27fc640 1 -- 172.21.15.39:0/2220370781 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f3cbc0044e0 con 0x7f3cc41e89a0 2024-05-14T14:40:50.287 INFO:teuthology.orchestra.run.smithi039.stderr:listed 0 entries 2024-05-14T14:40:50.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.304+0000 7f3ccbf40640 1 -- 172.21.15.39:0/2220370781 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f3cb00762d0 msgr2=0x7f3cb00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:50.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.304+0000 7f3ccbf40640 1 --2- 172.21.15.39:0/2220370781 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f3cb00762d0 0x7f3cb00787e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f3cb40016b0 tx=0x7f3cb4006040 comp rx=0 tx=0).stop 2024-05-14T14:40:50.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.304+0000 7f3ccbf40640 1 -- 172.21.15.39:0/2220370781 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3cc41e89a0 msgr2=0x7f3cc41e8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:50.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.304+0000 7f3ccbf40640 1 --2- 172.21.15.39:0/2220370781 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3cc41e89a0 0x7f3cc41e8db0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc009ac0 tx=0x7f3cbc004730 comp rx=0 tx=0).stop 2024-05-14T14:40:50.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.304+0000 7f3ccbf40640 1 -- 172.21.15.39:0/2220370781 shutdown_connections 2024-05-14T14:40:50.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.304+0000 7f3ccbf40640 1 --2- 172.21.15.39:0/2220370781 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f3cb00762d0 0x7f3cb00787e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:50.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.304+0000 7f3ccbf40640 1 --2- 172.21.15.39:0/2220370781 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f3cc41e89a0 0x7f3cc41e8db0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:50.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.304+0000 7f3ccbf40640 1 --2- 172.21.15.39:0/2220370781 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3cc4161de0 0x7f3cc41621f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:50.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.304+0000 7f3ccbf40640 1 --2- 172.21.15.39:0/2220370781 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f3cc41ebc60 0x7f3cc414ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:50.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.304+0000 7f3ccbf40640 1 -- 172.21.15.39:0/2220370781 >> 172.21.15.39:0/2220370781 conn(0x7f3cc4071680 msgr2=0x7f3cc40b8760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:50.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.304+0000 7f3ccbf40640 1 -- 172.21.15.39:0/2220370781 shutdown_connections 2024-05-14T14:40:50.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.304+0000 7f3ccbf40640 1 -- 172.21.15.39:0/2220370781 wait complete. 2024-05-14T14:40:50.300 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-05-14T14:40:50.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:50.301 DEBUG:teuthology.orchestra.run.smithi039:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-05-14T14:40:50.328 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi039.front.sepia.ceph.com 2024-05-14T14:40:50.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:50.328 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-05-14T14:40:50.384 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-14T14:40:50.384 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T14:40:50.404 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-14T14:40:50.404 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T14:40:50.465 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-14T14:40:50.465 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T14:40:50.525 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-14T14:40:50.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.657+0000 7fa025b3f640 1 Processor -- start 2024-05-14T14:40:50.642 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.657+0000 7fa025b3f640 1 -- start start 2024-05-14T14:40:50.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.658+0000 7fa025b3f640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa020163e50 0x7fa020160320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:50.644 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.658+0000 7fa025b3f640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa020161320 0x7fa0200d0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:50.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.658+0000 7fa025b3f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa0200d0fd0 0x7fa0200d47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:50.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.658+0000 7fa025b3f640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fa020164260 con 0x7fa020161320 2024-05-14T14:40:50.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.658+0000 7fa025b3f640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fa0200d13e0 con 0x7fa0200d0fd0 2024-05-14T14:40:50.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.658+0000 7fa025b3f640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fa0201644a0 con 0x7fa020163e50 2024-05-14T14:40:50.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.658+0000 7fa01effd640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa020161320 0x7fa0200d0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:50.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.658+0000 7fa01effd640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa020161320 0x7fa0200d0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36676/0 (socket says 172.21.15.39:36676) 2024-05-14T14:40:50.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.658+0000 7fa01effd640 1 -- 172.21.15.39:0/2788802663 learned_addr learned my addr 172.21.15.39:0/2788802663 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:50.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.659+0000 7fa01f7fe640 1 --2- 172.21.15.39:0/2788802663 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa020163e50 0x7fa020160320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:50.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.659+0000 7fa01ffff640 1 --2- 172.21.15.39:0/2788802663 >> v2:172.21.15.62:3300/0 conn(0x7fa0200d0fd0 0x7fa0200d47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:50.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.659+0000 7fa01effd640 1 -- 172.21.15.39:0/2788802663 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa020163e50 msgr2=0x7fa020160320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:50.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.659+0000 7fa01effd640 1 --2- 172.21.15.39:0/2788802663 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa020163e50 0x7fa020160320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:50.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.659+0000 7fa01effd640 1 -- 172.21.15.39:0/2788802663 >> v2:172.21.15.62:3300/0 conn(0x7fa0200d0fd0 msgr2=0x7fa0200d47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:50.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.659+0000 7fa01effd640 1 --2- 172.21.15.39:0/2788802663 >> v2:172.21.15.62:3300/0 conn(0x7fa0200d0fd0 0x7fa0200d47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:50.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.659+0000 7fa01effd640 1 -- 172.21.15.39:0/2788802663 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa020164780 con 0x7fa020161320 2024-05-14T14:40:50.645 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.659+0000 7fa01ffff640 1 --2- 172.21.15.39:0/2788802663 >> v2:172.21.15.62:3300/0 conn(0x7fa0200d0fd0 0x7fa0200d47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:40:50.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.660+0000 7fa01effd640 1 --2- 172.21.15.39:0/2788802663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa020161320 0x7fa0200d0a90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa0200d5b00 tx=0x7fa01402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b21b6b8403f4640a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:50.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.660+0000 7fa01e7fc640 1 -- 172.21.15.39:0/2788802663 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa014037070 con 0x7fa020161320 2024-05-14T14:40:50.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.660+0000 7fa01e7fc640 1 -- 172.21.15.39:0/2788802663 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa014032440 con 0x7fa020161320 2024-05-14T14:40:50.646 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.660+0000 7fa01e7fc640 1 -- 172.21.15.39:0/2788802663 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa014032810 con 0x7fa020161320 2024-05-14T14:40:50.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.660+0000 7fa025b3f640 1 -- 172.21.15.39:0/2788802663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa020161320 msgr2=0x7fa0200d0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:50.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.660+0000 7fa025b3f640 1 --2- 172.21.15.39:0/2788802663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa020161320 0x7fa0200d0a90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa0200d5b00 tx=0x7fa01402a140 comp rx=0 tx=0).stop 2024-05-14T14:40:50.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.660+0000 7fa025b3f640 1 -- 172.21.15.39:0/2788802663 shutdown_connections 2024-05-14T14:40:50.647 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.660+0000 7fa025b3f640 1 --2- 172.21.15.39:0/2788802663 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa020161320 0x7fa0200d0a90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:50.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.660+0000 7fa025b3f640 1 --2- 172.21.15.39:0/2788802663 >> v2:172.21.15.62:3300/0 conn(0x7fa0200d0fd0 0x7fa0200d47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:50.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.660+0000 7fa025b3f640 1 --2- 172.21.15.39:0/2788802663 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa020163e50 0x7fa020160320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:50.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.660+0000 7fa025b3f640 1 -- 172.21.15.39:0/2788802663 >> 172.21.15.39:0/2788802663 conn(0x7fa0200b77d0 msgr2=0x7fa0200b7be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:50.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.661+0000 7fa025b3f640 1 -- 172.21.15.39:0/2788802663 shutdown_connections 2024-05-14T14:40:50.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.661+0000 7fa025b3f640 1 -- 172.21.15.39:0/2788802663 wait complete. 2024-05-14T14:40:50.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.662+0000 7fa025b3f640 1 Processor -- start 2024-05-14T14:40:50.648 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.663+0000 7fa025b3f640 1 -- start start 2024-05-14T14:40:50.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.664+0000 7fa025b3f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0200d0fd0 0x7fa0201f6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:50.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.664+0000 7fa025b3f640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa020161320 0x7fa0201ebfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:50.650 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.664+0000 7fa025b3f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa020163e50 0x7fa0201ec4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:50.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.664+0000 7fa025b3f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa020161730 con 0x7fa020163e50 2024-05-14T14:40:50.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.664+0000 7fa025b3f640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa020164d40 con 0x7fa0200d0fd0 2024-05-14T14:40:50.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.664+0000 7fa025b3f640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fa0200d4d20 con 0x7fa020161320 2024-05-14T14:40:50.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.664+0000 7fa01ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa020163e50 0x7fa0201ec4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:50.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.664+0000 7fa01ffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa020163e50 0x7fa0201ec4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36688/0 (socket says 172.21.15.39:36688) 2024-05-14T14:40:50.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.664+0000 7fa01ffff640 1 -- 172.21.15.39:0/3537373311 learned_addr learned my addr 172.21.15.39:0/3537373311 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:50.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.664+0000 7fa01effd640 1 --2- 172.21.15.39:0/3537373311 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa020161320 0x7fa0201ebfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:50.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.664+0000 7fa01f7fe640 1 --2- 172.21.15.39:0/3537373311 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0200d0fd0 0x7fa0201f6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:50.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.664+0000 7fa01ffff640 1 -- 172.21.15.39:0/3537373311 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa020161320 msgr2=0x7fa0201ebfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:50.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.664+0000 7fa01ffff640 1 --2- 172.21.15.39:0/3537373311 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa020161320 0x7fa0201ebfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:50.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.664+0000 7fa01ffff640 1 -- 172.21.15.39:0/3537373311 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0200d0fd0 msgr2=0x7fa0201f6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:50.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.664+0000 7fa01ffff640 1 --2- 172.21.15.39:0/3537373311 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0200d0fd0 0x7fa0201f6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:50.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.664+0000 7fa01ffff640 1 -- 172.21.15.39:0/3537373311 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa02015a520 con 0x7fa020163e50 2024-05-14T14:40:50.651 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.664+0000 7fa01f7fe640 1 --2- 172.21.15.39:0/3537373311 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0200d0fd0 0x7fa0201f6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:40:50.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.664+0000 7fa01ffff640 1 --2- 172.21.15.39:0/3537373311 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa020163e50 0x7fa0201ec4e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa018007de0 tx=0x7fa01800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:50.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.665+0000 7fa007fff640 1 -- 172.21.15.39:0/3537373311 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa01801a070 con 0x7fa020163e50 2024-05-14T14:40:50.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.665+0000 7fa007fff640 1 -- 172.21.15.39:0/3537373311 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa018015400 con 0x7fa020163e50 2024-05-14T14:40:50.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.665+0000 7fa025b3f640 1 -- 172.21.15.39:0/3537373311 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa02015a800 con 0x7fa020163e50 2024-05-14T14:40:50.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.665+0000 7fa007fff640 1 -- 172.21.15.39:0/3537373311 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0180157f0 con 0x7fa020163e50 2024-05-14T14:40:50.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.665+0000 7fa025b3f640 1 -- 172.21.15.39:0/3537373311 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa020155960 con 0x7fa020163e50 2024-05-14T14:40:50.652 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.666+0000 7fa025b3f640 1 -- 172.21.15.39:0/3537373311 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa020076aa0 con 0x7fa020163e50 2024-05-14T14:40:50.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.667+0000 7fa007fff640 1 -- 172.21.15.39:0/3537373311 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa01801d070 con 0x7fa020163e50 2024-05-14T14:40:50.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.667+0000 7fa007fff640 1 --2- 172.21.15.39:0/3537373311 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fa00c0762d0 0x7fa00c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:50.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.667+0000 7fa01f7fe640 1 --2- 172.21.15.39:0/3537373311 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fa00c0762d0 0x7fa00c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:50.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.667+0000 7fa007fff640 1 -- 172.21.15.39:0/3537373311 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa018097b40 con 0x7fa020163e50 2024-05-14T14:40:50.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.668+0000 7fa01f7fe640 1 --2- 172.21.15.39:0/3537373311 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fa00c0762d0 0x7fa00c0787e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa0200b8fc0 tx=0x7fa010008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:50.657 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.672+0000 7fa007fff640 1 -- 172.21.15.39:0/3537373311 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa018010070 con 0x7fa020163e50 2024-05-14T14:40:50.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.877+0000 7fa025b3f640 1 -- 172.21.15.39:0/3537373311 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa0200cfbc0 con 0x7fa020163e50 2024-05-14T14:40:50.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.877+0000 7fa007fff640 1 -- 172.21.15.39:0/3537373311 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7fa018060a80 con 0x7fa020163e50 2024-05-14T14:40:50.862 INFO:teuthology.orchestra.run.smithi039.stderr:listed 0 entries 2024-05-14T14:40:50.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.879+0000 7fa025b3f640 1 -- 172.21.15.39:0/3537373311 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fa00c0762d0 msgr2=0x7fa00c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:50.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.879+0000 7fa025b3f640 1 --2- 172.21.15.39:0/3537373311 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fa00c0762d0 0x7fa00c0787e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa0200b8fc0 tx=0x7fa010008040 comp rx=0 tx=0).stop 2024-05-14T14:40:50.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.879+0000 7fa025b3f640 1 -- 172.21.15.39:0/3537373311 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa020163e50 msgr2=0x7fa0201ec4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:50.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.879+0000 7fa025b3f640 1 --2- 172.21.15.39:0/3537373311 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa020163e50 0x7fa0201ec4e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa018007de0 tx=0x7fa01800d4a0 comp rx=0 tx=0).stop 2024-05-14T14:40:50.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.879+0000 7fa025b3f640 1 -- 172.21.15.39:0/3537373311 shutdown_connections 2024-05-14T14:40:50.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.879+0000 7fa025b3f640 1 --2- 172.21.15.39:0/3537373311 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fa00c0762d0 0x7fa00c0787e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:50.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.879+0000 7fa025b3f640 1 --2- 172.21.15.39:0/3537373311 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa020163e50 0x7fa0201ec4e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:50.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.879+0000 7fa025b3f640 1 --2- 172.21.15.39:0/3537373311 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa020161320 0x7fa0201ebfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:50.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.879+0000 7fa025b3f640 1 --2- 172.21.15.39:0/3537373311 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0200d0fd0 0x7fa0201f6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:50.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.879+0000 7fa025b3f640 1 -- 172.21.15.39:0/3537373311 >> 172.21.15.39:0/3537373311 conn(0x7fa0200b77d0 msgr2=0x7fa02006daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:50.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.879+0000 7fa025b3f640 1 -- 172.21.15.39:0/3537373311 shutdown_connections 2024-05-14T14:40:50.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:50.880+0000 7fa025b3f640 1 -- 172.21.15.39:0/3537373311 wait complete. 2024-05-14T14:40:50.876 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-05-14T14:40:50.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:50.876 DEBUG:teuthology.orchestra.run.smithi062:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-05-14T14:40:50.909 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi062.front.sepia.ceph.com 2024-05-14T14:40:50.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:40:50.909 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-05-14T14:40:50.968 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-05-14T14:40:50.968 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T14:40:51.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.098+0000 7f6fc0572640 1 Processor -- start 2024-05-14T14:40:51.083 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.098+0000 7f6fc0572640 1 -- start start 2024-05-14T14:40:51.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.100+0000 7f6fc0572640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6fb80d1310 0x7f6fb806d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:51.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.100+0000 7f6fc0572640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6fb806d5f0 0x7f6fb80ba070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:51.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.100+0000 7f6fc0572640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fb80b9310 con 0x7f6fb8160420 2024-05-14T14:40:51.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.100+0000 7f6fc0572640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f6fb806dd70 con 0x7f6fb80d1310 2024-05-14T14:40:51.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.100+0000 7f6fc0572640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f6fb80b9590 con 0x7f6fb806d5f0 2024-05-14T14:40:51.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.100+0000 7f6fbdb0d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6fb80d1310 0x7f6fb806d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:51.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.100+0000 7f6fbdb0d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f6fb80d1310 0x7f6fb806d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36696/0 (socket says 172.21.15.39:36696) 2024-05-14T14:40:51.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.100+0000 7f6fbdb0d640 1 -- 172.21.15.39:0/1650431272 learned_addr learned my addr 172.21.15.39:0/1650431272 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:51.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.100+0000 7f6fbeb0f640 1 --2- 172.21.15.39:0/1650431272 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6fb806d5f0 0x7f6fb80ba070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:51.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.100+0000 7f6fbdb0d640 1 -- 172.21.15.39:0/1650431272 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6fb806d5f0 msgr2=0x7f6fb80ba070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:51.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.101+0000 7f6fbdb0d640 1 --2- 172.21.15.39:0/1650431272 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6fb806d5f0 0x7f6fb80ba070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:51.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.101+0000 7f6fbdb0d640 1 -- 172.21.15.39:0/1650431272 >> v1:172.21.15.62:6789/0 conn(0x7f6fb8160420 legacy=0x7f6fb80d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:51.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.101+0000 7f6fbdb0d640 1 -- 172.21.15.39:0/1650431272 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fb80b9870 con 0x7f6fb80d1310 2024-05-14T14:40:51.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.101+0000 7f6fbeb0f640 1 --2- 172.21.15.39:0/1650431272 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6fb806d5f0 0x7f6fb80ba070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:40:51.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.101+0000 7f6fbdb0d640 1 --2- 172.21.15.39:0/1650431272 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fb80d1310 0x7f6fb806d0b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6fac009870 tx=0x7f6fac02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0fd6966d632ef83 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:51.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.101+0000 7f6fbd30c640 1 -- 172.21.15.39:0/1650431272 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fac037070 con 0x7f6fb80d1310 2024-05-14T14:40:51.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.101+0000 7f6fbd30c640 1 -- 172.21.15.39:0/1650431272 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fac032440 con 0x7f6fb80d1310 2024-05-14T14:40:51.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.101+0000 7f6fbd30c640 1 -- 172.21.15.39:0/1650431272 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fac032810 con 0x7f6fb80d1310 2024-05-14T14:40:51.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.102+0000 7f6fc0572640 1 -- 172.21.15.39:0/1650431272 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fb80d1310 msgr2=0x7f6fb806d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:51.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.102+0000 7f6fc0572640 1 --2- 172.21.15.39:0/1650431272 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fb80d1310 0x7f6fb806d0b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6fac009870 tx=0x7f6fac02a1c0 comp rx=0 tx=0).stop 2024-05-14T14:40:51.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.102+0000 7f6fc0572640 1 -- 172.21.15.39:0/1650431272 shutdown_connections 2024-05-14T14:40:51.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.102+0000 7f6fc0572640 1 --2- 172.21.15.39:0/1650431272 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6fb806d5f0 0x7f6fb80ba070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:51.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.102+0000 7f6fc0572640 1 --2- 172.21.15.39:0/1650431272 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fb80d1310 0x7f6fb806d0b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:51.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.102+0000 7f6fc0572640 1 -- 172.21.15.39:0/1650431272 >> 172.21.15.39:0/1650431272 conn(0x7f6fb80d27d0 msgr2=0x7f6fb80d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:51.089 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.102+0000 7f6fc0572640 1 -- 172.21.15.39:0/1650431272 shutdown_connections 2024-05-14T14:40:51.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.102+0000 7f6fc0572640 1 -- 172.21.15.39:0/1650431272 wait complete. 2024-05-14T14:40:51.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.104+0000 7f6fc0572640 1 Processor -- start 2024-05-14T14:40:51.090 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.104+0000 7f6fc0572640 1 -- start start 2024-05-14T14:40:51.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.105+0000 7f6fc0572640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fb806d5f0 0x7f6fb814f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:51.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.105+0000 7f6fc0572640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6fb8160420 0x7f6fb80cc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:51.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.105+0000 7f6fc0572640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6fb814fc60 0x7f6fb815f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:51.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.105+0000 7f6fc0572640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb806da00 con 0x7f6fb806d5f0 2024-05-14T14:40:51.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.105+0000 7f6fc0572640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb8160830 con 0x7f6fb814fc60 2024-05-14T14:40:51.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.105+0000 7f6fc0572640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f6fb80ba5b0 con 0x7f6fb8160420 2024-05-14T14:40:51.092 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.105+0000 7f6fbe30e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fb806d5f0 0x7f6fb814f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:51.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.106+0000 7f6fbe30e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fb806d5f0 0x7f6fb814f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36700/0 (socket says 172.21.15.39:36700) 2024-05-14T14:40:51.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.106+0000 7f6fbe30e640 1 -- 172.21.15.39:0/2662601898 learned_addr learned my addr 172.21.15.39:0/2662601898 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:51.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.106+0000 7f6fbdb0d640 1 --2- 172.21.15.39:0/2662601898 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6fb8160420 0x7f6fb80cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:51.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.106+0000 7f6fbeb0f640 1 --2- 172.21.15.39:0/2662601898 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6fb814fc60 0x7f6fb815f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:51.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.106+0000 7f6fbe30e640 1 -- 172.21.15.39:0/2662601898 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6fb8160420 msgr2=0x7f6fb80cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:51.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.106+0000 7f6fbe30e640 1 --2- 172.21.15.39:0/2662601898 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6fb8160420 0x7f6fb80cc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:51.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.106+0000 7f6fbe30e640 1 -- 172.21.15.39:0/2662601898 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6fb814fc60 msgr2=0x7f6fb815f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:51.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.106+0000 7f6fbe30e640 1 --2- 172.21.15.39:0/2662601898 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6fb814fc60 0x7f6fb815f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:51.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.106+0000 7f6fbe30e640 1 -- 172.21.15.39:0/2662601898 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fb80c9830 con 0x7f6fb806d5f0 2024-05-14T14:40:51.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.106+0000 7f6fbe30e640 1 --2- 172.21.15.39:0/2662601898 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fb806d5f0 0x7f6fb814f310 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6fa800b3f0 tx=0x7f6fa800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:51.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.106+0000 7f6fb6ffd640 1 -- 172.21.15.39:0/2662601898 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8015020 con 0x7f6fb806d5f0 2024-05-14T14:40:51.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.106+0000 7f6fb6ffd640 1 -- 172.21.15.39:0/2662601898 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fa8011830 con 0x7f6fb806d5f0 2024-05-14T14:40:51.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.106+0000 7f6fc0572640 1 -- 172.21.15.39:0/2662601898 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fb80c9b10 con 0x7f6fb806d5f0 2024-05-14T14:40:51.093 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.106+0000 7f6fb6ffd640 1 -- 172.21.15.39:0/2662601898 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa8011c20 con 0x7f6fb806d5f0 2024-05-14T14:40:51.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.106+0000 7f6fc0572640 1 -- 172.21.15.39:0/2662601898 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fb80ca0d0 con 0x7f6fb806d5f0 2024-05-14T14:40:51.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.107+0000 7f6fc0572640 1 -- 172.21.15.39:0/2662601898 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fb8076aa0 con 0x7f6fb806d5f0 2024-05-14T14:40:51.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.108+0000 7f6fb6ffd640 1 -- 172.21.15.39:0/2662601898 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6fa8018020 con 0x7f6fb806d5f0 2024-05-14T14:40:51.094 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.109+0000 7f6fb6ffd640 1 --2- 172.21.15.39:0/2662601898 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f6fa40762d0 0x7f6fa40787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:51.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.109+0000 7f6fb6ffd640 1 -- 172.21.15.39:0/2662601898 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6fa80978e0 con 0x7f6fb806d5f0 2024-05-14T14:40:51.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.109+0000 7f6fbdb0d640 1 --2- 172.21.15.39:0/2662601898 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f6fa40762d0 0x7f6fa40787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:51.095 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.109+0000 7f6fbdb0d640 1 --2- 172.21.15.39:0/2662601898 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f6fa40762d0 0x7f6fa40787e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6fac034000 tx=0x7f6fac02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:51.098 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.113+0000 7f6fb6ffd640 1 -- 172.21.15.39:0/2662601898 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6fa801f020 con 0x7f6fb806d5f0 2024-05-14T14:40:51.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.344+0000 7f6fc0572640 1 -- 172.21.15.39:0/2662601898 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6fb80bb2f0 con 0x7f6fb806d5f0 2024-05-14T14:40:51.330 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.344+0000 7f6fb6ffd640 1 -- 172.21.15.39:0/2662601898 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5171 (secure 0 0 0) 0x7f6fa8060f00 con 0x7f6fb806d5f0 2024-05-14T14:40:51.330 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:40:51.330 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/3753262818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3753262818},{"type":"v1","addr":"172.21.15.62:6834","nonce":3753262818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/97693396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6835","nonce":97693396},{"type":"v1","addr":"172.21.15.39:6837","nonce":97693396}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6836/1648047942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":1648047942},{"type":"v1","addr":"172.21.15.39:6836","nonce":1648047942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T14:40:15.320927+0000","modified":"2024-05-14T14:40:28.417797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/1519798364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":1519798364},{"type":"v1","addr":"172.21.15.62:6835","nonce":1519798364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-05-14T14:40:51.331 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 9 2024-05-14T14:40:51.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.347+0000 7f6fc0572640 1 -- 172.21.15.39:0/2662601898 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f6fa40762d0 msgr2=0x7f6fa40787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:51.332 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.347+0000 7f6fc0572640 1 --2- 172.21.15.39:0/2662601898 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f6fa40762d0 0x7f6fa40787e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6fac034000 tx=0x7f6fac02e000 comp rx=0 tx=0).stop 2024-05-14T14:40:51.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.347+0000 7f6fc0572640 1 -- 172.21.15.39:0/2662601898 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fb806d5f0 msgr2=0x7f6fb814f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:51.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.347+0000 7f6fc0572640 1 --2- 172.21.15.39:0/2662601898 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fb806d5f0 0x7f6fb814f310 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6fa800b3f0 tx=0x7f6fa800b8b0 comp rx=0 tx=0).stop 2024-05-14T14:40:51.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.347+0000 7f6fc0572640 1 -- 172.21.15.39:0/2662601898 shutdown_connections 2024-05-14T14:40:51.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.347+0000 7f6fc0572640 1 --2- 172.21.15.39:0/2662601898 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f6fa40762d0 0x7f6fa40787e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:51.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.347+0000 7f6fc0572640 1 --2- 172.21.15.39:0/2662601898 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6fb814fc60 0x7f6fb815f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:51.333 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.347+0000 7f6fc0572640 1 --2- 172.21.15.39:0/2662601898 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6fb8160420 0x7f6fb80cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:51.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.347+0000 7f6fc0572640 1 --2- 172.21.15.39:0/2662601898 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6fb806d5f0 0x7f6fb814f310 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:51.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.347+0000 7f6fc0572640 1 -- 172.21.15.39:0/2662601898 >> 172.21.15.39:0/2662601898 conn(0x7f6fb80d27d0 msgr2=0x7f6fb80b5780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:51.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.347+0000 7f6fc0572640 1 -- 172.21.15.39:0/2662601898 shutdown_connections 2024-05-14T14:40:51.334 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.347+0000 7f6fc0572640 1 -- 172.21.15.39:0/2662601898 wait complete. 2024-05-14T14:40:51.344 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T14:40:51.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.474+0000 7f48dc514640 1 Processor -- start 2024-05-14T14:40:51.459 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.474+0000 7f48dc514640 1 -- start start 2024-05-14T14:40:51.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.475+0000 7f48dc514640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f48d4164600 0x7f48d4164a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:51.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.475+0000 7f48dc514640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f48d40ce1b0 0x7f48d40ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:51.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.475+0000 7f48dc514640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48d40ceb00 con 0x7f48d40cf2a0 2024-05-14T14:40:51.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.475+0000 7f48dc514640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f48d4164170 con 0x7f48d40ce1b0 2024-05-14T14:40:51.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.475+0000 7f48dc514640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f48d4161130 con 0x7f48d4164600 2024-05-14T14:40:51.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.476+0000 7f48daab1640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f48d40ce1b0 0x7f48d40ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:51.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.476+0000 7f48daab1640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f48d40ce1b0 0x7f48d40ce5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36712/0 (socket says 172.21.15.39:36712) 2024-05-14T14:40:51.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.476+0000 7f48daab1640 1 -- 172.21.15.39:0/2485679616 learned_addr learned my addr 172.21.15.39:0/2485679616 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:51.461 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.476+0000 7f48d9aaf640 1 --2- 172.21.15.39:0/2485679616 >> v2:172.21.15.62:3300/0 conn(0x7f48d4164600 0x7f48d4164a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:51.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.476+0000 7f48daab1640 1 -- 172.21.15.39:0/2485679616 >> v2:172.21.15.62:3300/0 conn(0x7f48d4164600 msgr2=0x7f48d4164a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:51.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.476+0000 7f48daab1640 1 --2- 172.21.15.39:0/2485679616 >> v2:172.21.15.62:3300/0 conn(0x7f48d4164600 0x7f48d4164a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:51.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.476+0000 7f48daab1640 1 -- 172.21.15.39:0/2485679616 >> v1:172.21.15.62:6789/0 conn(0x7f48d40cf2a0 legacy=0x7f48d41608e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:51.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.476+0000 7f48daab1640 1 -- 172.21.15.39:0/2485679616 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d4161410 con 0x7f48d40ce1b0 2024-05-14T14:40:51.462 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.476+0000 7f48d9aaf640 1 --2- 172.21.15.39:0/2485679616 >> v2:172.21.15.62:3300/0 conn(0x7f48d4164600 0x7f48d4164a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:40:51.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.477+0000 7f48daab1640 1 --2- 172.21.15.39:0/2485679616 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48d40ce1b0 0x7f48d40ce5c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f48d406fc70 tx=0x7f48cc02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d089140cece5d927 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:51.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.477+0000 7f48d92ae640 1 -- 172.21.15.39:0/2485679616 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48cc036070 con 0x7f48d40ce1b0 2024-05-14T14:40:51.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.477+0000 7f48d92ae640 1 -- 172.21.15.39:0/2485679616 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48cc031600 con 0x7f48d40ce1b0 2024-05-14T14:40:51.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.477+0000 7f48d92ae640 1 -- 172.21.15.39:0/2485679616 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48cc0319d0 con 0x7f48d40ce1b0 2024-05-14T14:40:51.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.477+0000 7f48dc514640 1 -- 172.21.15.39:0/2485679616 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48d40ce1b0 msgr2=0x7f48d40ce5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:51.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.477+0000 7f48dc514640 1 --2- 172.21.15.39:0/2485679616 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48d40ce1b0 0x7f48d40ce5c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f48d406fc70 tx=0x7f48cc02a730 comp rx=0 tx=0).stop 2024-05-14T14:40:51.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.478+0000 7f48dc514640 1 -- 172.21.15.39:0/2485679616 shutdown_connections 2024-05-14T14:40:51.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.478+0000 7f48dc514640 1 --2- 172.21.15.39:0/2485679616 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48d40ce1b0 0x7f48d40ce5c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:51.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.478+0000 7f48dc514640 1 --2- 172.21.15.39:0/2485679616 >> v2:172.21.15.62:3300/0 conn(0x7f48d4164600 0x7f48d4164a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:51.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.478+0000 7f48dc514640 1 -- 172.21.15.39:0/2485679616 >> 172.21.15.39:0/2485679616 conn(0x7f48d4071680 msgr2=0x7f48d4071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:51.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.478+0000 7f48dc514640 1 -- 172.21.15.39:0/2485679616 shutdown_connections 2024-05-14T14:40:51.464 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.478+0000 7f48dc514640 1 -- 172.21.15.39:0/2485679616 wait complete. 2024-05-14T14:40:51.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.479+0000 7f48dc514640 1 Processor -- start 2024-05-14T14:40:51.465 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.480+0000 7f48dc514640 1 -- start start 2024-05-14T14:40:51.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.481+0000 7f48dc514640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f48d40ce1b0 0x7f48d41545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:51.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.481+0000 7f48dc514640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48d40cf2a0 0x7f48d41f9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:51.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.481+0000 7f48dc514640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48d4164600 0x7f48d41f9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:51.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.481+0000 7f48dc514640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f48d40d0e20 con 0x7f48d4164600 2024-05-14T14:40:51.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.481+0000 7f48dc514640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f48d40cf6b0 con 0x7f48d40cf2a0 2024-05-14T14:40:51.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.481+0000 7f48dc514640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f48d406e4a0 con 0x7f48d40ce1b0 2024-05-14T14:40:51.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.481+0000 7f48daab1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48d4164600 0x7f48d41f9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:51.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.481+0000 7f48daab1640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48d4164600 0x7f48d41f9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36722/0 (socket says 172.21.15.39:36722) 2024-05-14T14:40:51.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.481+0000 7f48daab1640 1 -- 172.21.15.39:0/3982488031 learned_addr learned my addr 172.21.15.39:0/3982488031 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:51.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.481+0000 7f48d9aaf640 1 --2- 172.21.15.39:0/3982488031 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48d40cf2a0 0x7f48d41f9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:51.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.481+0000 7f48da2b0640 1 --2- 172.21.15.39:0/3982488031 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f48d40ce1b0 0x7f48d41545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:51.468 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.481+0000 7f48daab1640 1 -- 172.21.15.39:0/3982488031 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f48d40ce1b0 msgr2=0x7f48d41545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:51.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.481+0000 7f48daab1640 1 --2- 172.21.15.39:0/3982488031 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f48d40ce1b0 0x7f48d41545c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:51.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.481+0000 7f48daab1640 1 -- 172.21.15.39:0/3982488031 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48d40cf2a0 msgr2=0x7f48d41f9970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:51.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.481+0000 7f48daab1640 1 --2- 172.21.15.39:0/3982488031 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48d40cf2a0 0x7f48d41f9970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:51.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.481+0000 7f48daab1640 1 -- 172.21.15.39:0/3982488031 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d40b6c00 con 0x7f48d4164600 2024-05-14T14:40:51.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.481+0000 7f48da2b0640 1 --2- 172.21.15.39:0/3982488031 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f48d40ce1b0 0x7f48d41545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:40:51.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.481+0000 7f48daab1640 1 --2- 172.21.15.39:0/3982488031 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48d4164600 0x7f48d41f9eb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f48cc034040 tx=0x7f48cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:51.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.482+0000 7f48caffd640 1 -- 172.21.15.39:0/3982488031 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48cc036050 con 0x7f48d4164600 2024-05-14T14:40:51.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.482+0000 7f48caffd640 1 -- 172.21.15.39:0/3982488031 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48cc042070 con 0x7f48d4164600 2024-05-14T14:40:51.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.482+0000 7f48dc514640 1 -- 172.21.15.39:0/3982488031 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48d40b6ee0 con 0x7f48d4164600 2024-05-14T14:40:51.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.482+0000 7f48caffd640 1 -- 172.21.15.39:0/3982488031 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48cc009510 con 0x7f48d4164600 2024-05-14T14:40:51.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.482+0000 7f48dc514640 1 -- 172.21.15.39:0/3982488031 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48d40b74a0 con 0x7f48d4164600 2024-05-14T14:40:51.469 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.483+0000 7f48dc514640 1 -- 172.21.15.39:0/3982488031 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48d4076aa0 con 0x7f48d4164600 2024-05-14T14:40:51.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.483+0000 7f48caffd640 1 -- 172.21.15.39:0/3982488031 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f48cc007bf0 con 0x7f48d4164600 2024-05-14T14:40:51.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.484+0000 7f48caffd640 1 --2- 172.21.15.39:0/3982488031 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f48b80762d0 0x7f48b80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:51.470 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.484+0000 7f48caffd640 1 -- 172.21.15.39:0/3982488031 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f48cc0b87a0 con 0x7f48d4164600 2024-05-14T14:40:51.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.484+0000 7f48da2b0640 1 --2- 172.21.15.39:0/3982488031 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f48b80762d0 0x7f48b80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:51.471 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.484+0000 7f48da2b0640 1 --2- 172.21.15.39:0/3982488031 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f48b80762d0 0x7f48b80787e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f48d40d0070 tx=0x7f48d0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:51.473 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.489+0000 7f48caffd640 1 -- 172.21.15.39:0/3982488031 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f48cc081d40 con 0x7f48d4164600 2024-05-14T14:40:51.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.716+0000 7f48dc514640 1 -- 172.21.15.39:0/3982488031 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f48d40cdb90 con 0x7f48d4164600 2024-05-14T14:40:51.701 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.716+0000 7f48caffd640 1 -- 172.21.15.39:0/3982488031 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5171 (secure 0 0 0) 0x7f48cc081640 con 0x7f48d4164600 2024-05-14T14:40:51.702 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:40:51.702 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/3753262818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3753262818},{"type":"v1","addr":"172.21.15.62:6834","nonce":3753262818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/97693396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6835","nonce":97693396},{"type":"v1","addr":"172.21.15.39:6837","nonce":97693396}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6836/1648047942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":1648047942},{"type":"v1","addr":"172.21.15.39:6836","nonce":1648047942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T14:40:15.320927+0000","modified":"2024-05-14T14:40:28.417797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/1519798364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":1519798364},{"type":"v1","addr":"172.21.15.62:6835","nonce":1519798364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-05-14T14:40:51.703 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 9 2024-05-14T14:40:51.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.718+0000 7f48dc514640 1 -- 172.21.15.39:0/3982488031 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f48b80762d0 msgr2=0x7f48b80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:51.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.718+0000 7f48dc514640 1 --2- 172.21.15.39:0/3982488031 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f48b80762d0 0x7f48b80787e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f48d40d0070 tx=0x7f48d0009040 comp rx=0 tx=0).stop 2024-05-14T14:40:51.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.718+0000 7f48dc514640 1 -- 172.21.15.39:0/3982488031 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48d4164600 msgr2=0x7f48d41f9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:51.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.718+0000 7f48dc514640 1 --2- 172.21.15.39:0/3982488031 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48d4164600 0x7f48d41f9eb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f48cc034040 tx=0x7f48cc004a40 comp rx=0 tx=0).stop 2024-05-14T14:40:51.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.718+0000 7f48dc514640 1 -- 172.21.15.39:0/3982488031 shutdown_connections 2024-05-14T14:40:51.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.718+0000 7f48dc514640 1 --2- 172.21.15.39:0/3982488031 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f48b80762d0 0x7f48b80787e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:51.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.718+0000 7f48dc514640 1 --2- 172.21.15.39:0/3982488031 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f48d4164600 0x7f48d41f9eb0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:51.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.718+0000 7f48dc514640 1 --2- 172.21.15.39:0/3982488031 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f48d40cf2a0 0x7f48d41f9970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:51.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.718+0000 7f48dc514640 1 --2- 172.21.15.39:0/3982488031 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f48d40ce1b0 0x7f48d41545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:51.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.718+0000 7f48dc514640 1 -- 172.21.15.39:0/3982488031 >> 172.21.15.39:0/3982488031 conn(0x7f48d4071680 msgr2=0x7f48d4162360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:51.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.718+0000 7f48dc514640 1 -- 172.21.15.39:0/3982488031 shutdown_connections 2024-05-14T14:40:51.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.719+0000 7f48dc514640 1 -- 172.21.15.39:0/3982488031 wait complete. 2024-05-14T14:40:51.715 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T14:40:51.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.845+0000 7f96133f3640 1 Processor -- start 2024-05-14T14:40:51.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.845+0000 7f96133f3640 1 -- start start 2024-05-14T14:40:51.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.847+0000 7f96133f3640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f960c0d1310 0x7f960c06d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:51.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.847+0000 7f96133f3640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f960c06d5f0 0x7f960c0ba070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:51.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.847+0000 7f96133f3640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f960c0b9310 con 0x7f960c160420 2024-05-14T14:40:51.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.847+0000 7f96133f3640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f960c06dd70 con 0x7f960c06d5f0 2024-05-14T14:40:51.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.847+0000 7f96133f3640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f960c0b9590 con 0x7f960c0d1310 2024-05-14T14:40:51.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.847+0000 7f9611990640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f960c06d5f0 0x7f960c0ba070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:51.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.847+0000 7f961118f640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f960c160420 0x7f960c0d0c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:32954/0 (socket says 172.21.15.39:32954) 2024-05-14T14:40:51.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.847+0000 7f961118f640 1 -- 172.21.15.39:0/2444298665 learned_addr learned my addr 172.21.15.39:0/2444298665 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:51.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.847+0000 7f961098e640 1 --2- 172.21.15.39:0/2444298665 >> v2:172.21.15.62:3300/0 conn(0x7f960c0d1310 0x7f960c06d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:51.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.847+0000 7f9611990640 1 -- 172.21.15.39:0/2444298665 >> v2:172.21.15.62:3300/0 conn(0x7f960c0d1310 msgr2=0x7f960c06d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:51.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.847+0000 7f9611990640 1 --2- 172.21.15.39:0/2444298665 >> v2:172.21.15.62:3300/0 conn(0x7f960c0d1310 0x7f960c06d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:51.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.847+0000 7f9611990640 1 -- 172.21.15.39:0/2444298665 >> v1:172.21.15.39:6789/0 conn(0x7f960c160420 legacy=0x7f960c0d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:51.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.847+0000 7f9611990640 1 -- 172.21.15.39:0/2444298665 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f960c0b9870 con 0x7f960c06d5f0 2024-05-14T14:40:51.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.847+0000 7f960bfff640 1 -- 172.21.15.39:0/2444298665 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3434189549 0 0) 0x7f9604001110 con 0x7f960c160420 2024-05-14T14:40:51.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.848+0000 7f9611990640 1 --2- 172.21.15.39:0/2444298665 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f960c06d5f0 0x7f960c0ba070 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f960c0d37c0 tx=0x7f95fc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d57a2a673906a3e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:51.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.848+0000 7f960bfff640 1 -- 172.21.15.39:0/2444298665 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc037070 con 0x7f960c06d5f0 2024-05-14T14:40:51.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.848+0000 7f960bfff640 1 -- 172.21.15.39:0/2444298665 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95fc032440 con 0x7f960c06d5f0 2024-05-14T14:40:51.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.848+0000 7f960bfff640 1 -- 172.21.15.39:0/2444298665 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95fc02ae60 con 0x7f960c06d5f0 2024-05-14T14:40:51.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.849+0000 7f96133f3640 1 -- 172.21.15.39:0/2444298665 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f960c06d5f0 msgr2=0x7f960c0ba070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:51.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.849+0000 7f96133f3640 1 --2- 172.21.15.39:0/2444298665 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f960c06d5f0 0x7f960c0ba070 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f960c0d37c0 tx=0x7f95fc02a110 comp rx=0 tx=0).stop 2024-05-14T14:40:51.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.849+0000 7f96133f3640 1 -- 172.21.15.39:0/2444298665 shutdown_connections 2024-05-14T14:40:51.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.849+0000 7f96133f3640 1 --2- 172.21.15.39:0/2444298665 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f960c06d5f0 0x7f960c0ba070 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:51.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.849+0000 7f96133f3640 1 --2- 172.21.15.39:0/2444298665 >> v2:172.21.15.62:3300/0 conn(0x7f960c0d1310 0x7f960c06d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:51.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.849+0000 7f96133f3640 1 -- 172.21.15.39:0/2444298665 >> 172.21.15.39:0/2444298665 conn(0x7f960c0d27d0 msgr2=0x7f960c0d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:51.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.849+0000 7f96133f3640 1 -- 172.21.15.39:0/2444298665 shutdown_connections 2024-05-14T14:40:51.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.849+0000 7f96133f3640 1 -- 172.21.15.39:0/2444298665 wait complete. 2024-05-14T14:40:51.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.851+0000 7f96133f3640 1 Processor -- start 2024-05-14T14:40:51.836 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.851+0000 7f96133f3640 1 -- start start 2024-05-14T14:40:51.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.852+0000 7f96133f3640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f960c06d5f0 0x7f960c0ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:51.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.852+0000 7f96133f3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f960c160420 0x7f960c14f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:51.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.852+0000 7f96133f3640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f960c159c70 0x7f960c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:51.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.852+0000 7f96133f3640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f960c06da00 con 0x7f960c06d5f0 2024-05-14T14:40:51.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.852+0000 7f96133f3640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f960c160830 con 0x7f960c160420 2024-05-14T14:40:51.838 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.852+0000 7f96133f3640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f960c0ba5b0 con 0x7f960c159c70 2024-05-14T14:40:51.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.852+0000 7f961118f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f960c06d5f0 0x7f960c0ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:51.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.852+0000 7f961118f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f960c06d5f0 0x7f960c0ccd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36744/0 (socket says 172.21.15.39:36744) 2024-05-14T14:40:51.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.852+0000 7f961118f640 1 -- 172.21.15.39:0/3859036587 learned_addr learned my addr 172.21.15.39:0/3859036587 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:51.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.852+0000 7f9611990640 1 --2- 172.21.15.39:0/3859036587 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f960c159c70 0x7f960c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:51.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.852+0000 7f961098e640 1 --2- 172.21.15.39:0/3859036587 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f960c160420 0x7f960c14f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:51.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.852+0000 7f961118f640 1 -- 172.21.15.39:0/3859036587 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f960c159c70 msgr2=0x7f960c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:51.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.852+0000 7f961118f640 1 --2- 172.21.15.39:0/3859036587 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f960c159c70 0x7f960c0ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:51.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.852+0000 7f961118f640 1 -- 172.21.15.39:0/3859036587 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f960c160420 msgr2=0x7f960c14f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:51.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.852+0000 7f961118f640 1 --2- 172.21.15.39:0/3859036587 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f960c160420 0x7f960c14f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:51.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.852+0000 7f961118f640 1 -- 172.21.15.39:0/3859036587 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f960c14f850 con 0x7f960c06d5f0 2024-05-14T14:40:51.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.853+0000 7f961118f640 1 --2- 172.21.15.39:0/3859036587 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f960c06d5f0 0x7f960c0ccd90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f960400c410 tx=0x7f960400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:51.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.853+0000 7f9609ffb640 1 -- 172.21.15.39:0/3859036587 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96040074e0 con 0x7f960c06d5f0 2024-05-14T14:40:51.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.853+0000 7f9609ffb640 1 -- 172.21.15.39:0/3859036587 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96040047e0 con 0x7f960c06d5f0 2024-05-14T14:40:51.839 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.853+0000 7f96133f3640 1 -- 172.21.15.39:0/3859036587 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f960c0cd690 con 0x7f960c06d5f0 2024-05-14T14:40:51.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.853+0000 7f9609ffb640 1 -- 172.21.15.39:0/3859036587 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9604004bd0 con 0x7f960c06d5f0 2024-05-14T14:40:51.840 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.853+0000 7f96133f3640 1 -- 172.21.15.39:0/3859036587 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f960c0cdc50 con 0x7f960c06d5f0 2024-05-14T14:40:51.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.854+0000 7f96133f3640 1 -- 172.21.15.39:0/3859036587 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f960c076aa0 con 0x7f960c06d5f0 2024-05-14T14:40:51.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.855+0000 7f9609ffb640 1 -- 172.21.15.39:0/3859036587 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9604011070 con 0x7f960c06d5f0 2024-05-14T14:40:51.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.855+0000 7f9609ffb640 1 --2- 172.21.15.39:0/3859036587 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f95f8076300 0x7f95f8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:51.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.855+0000 7f9609ffb640 1 -- 172.21.15.39:0/3859036587 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f96040974d0 con 0x7f960c06d5f0 2024-05-14T14:40:51.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.855+0000 7f961098e640 1 --2- 172.21.15.39:0/3859036587 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f95f8076300 0x7f95f8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:51.841 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.856+0000 7f961098e640 1 --2- 172.21.15.39:0/3859036587 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f95f8076300 0x7f95f8078810 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f960c158360 tx=0x7f9600007900 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:51.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:51.860+0000 7f9609ffb640 1 -- 172.21.15.39:0/3859036587 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f960c14f850 con 0x7f960c06d5f0 2024-05-14T14:40:52.040 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.055+0000 7f96133f3640 1 -- 172.21.15.39:0/3859036587 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f960c06c7a0 con 0x7f960c06d5f0 2024-05-14T14:40:52.041 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.057+0000 7f9609ffb640 1 -- 172.21.15.39:0/3859036587 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18454 (secure 0 0 0) 0x7f960c0b9310 con 0x7f960c06d5f0 2024-05-14T14:40:52.042 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:40:52.042 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"fsid":"d7983fec-79c7-4991-b19c-1aecead64611","created":"2024-05-14T14:39:52.157167+0000","modified":"2024-05-14T14:40:20.397684+0000","last_up_change":"2024-05-14T14:40:03.848608+0000","last_in_change":"2024-05-14T14:39:54.591920+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T14:40:04.692846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T14:40:13.794415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T14:40:14.273154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T14:40:17.979457+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c4ec4534-6301-4dd7-b4d6-d560b096d442","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6801","nonce":4023478848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6803","nonce":4023478848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6807","nonce":4023478848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6805","nonce":4023478848}]},"public_addr":"172.21.15.39:6801/4023478848","cluster_addr":"172.21.15.39:6803/4023478848","heartbeat_back_addr":"172.21.15.39:6807/4023478848","heartbeat_front_addr":"172.21.15.39:6805/4023478848","state":["exists","up"]},{"osd":1,"uuid":"93f91b0e-096e-4bdf-aed0-d1136f73f136","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6817","nonce":926357398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6819","nonce":926357398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6823","nonce":926357398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6821","nonce":926357398}]},"public_addr":"172.21.15.39:6817/926357398","cluster_addr":"172.21.15.39:6819/926357398","heartbeat_back_addr":"172.21.15.39:6823/926357398","heartbeat_front_addr":"172.21.15.39:6821/926357398","state":["exists","up"]},{"osd":2,"uuid":"c590b1e0-67eb-452e-8e80-d2208da17d09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6809","nonce":610616754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6811","nonce":610616754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6815","nonce":610616754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6813","nonce":610616754}]},"public_addr":"172.21.15.39:6809/610616754","cluster_addr":"172.21.15.39:6811/610616754","heartbeat_back_addr":"172.21.15.39:6815/610616754","heartbeat_front_addr":"172.21.15.39:6813/610616754","state":["exists","up"]},{"osd":3,"uuid":"d57661b0-44f6-4355-9115-83eceb9b8f71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6825","nonce":1469314579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6827","nonce":1469314579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6831","nonce":1469314579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6829","nonce":1469314579}]},"public_addr":"172.21.15.39:6825/1469314579","cluster_addr":"172.21.15.39:6827/1469314579","heartbeat_back_addr":"172.21.15.39:6831/1469314579","heartbeat_front_addr":"172.21.15.39:6829/1469314579","state":["exists","up"]},{"osd":4,"uuid":"b131436f-f6e1-4d72-a86e-de200afdcebb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6825","nonce":3481507129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6827","nonce":3481507129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6831","nonce":3481507129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6829","nonce":3481507129}]},"public_addr":"172.21.15.62:6825/3481507129","cluster_addr":"172.21.15.62:6827/3481507129","heartbeat_back_addr":"172.21.15.62:6831/3481507129","heartbeat_front_addr":"172.21.15.62:6829/3481507129","state":["exists","up"]},{"osd":5,"uuid":"12e10b40-28b1-410f-9ce0-7b427daa111e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6801","nonce":3291934116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6803","nonce":3291934116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6807","nonce":3291934116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6805","nonce":3291934116}]},"public_addr":"172.21.15.62:6801/3291934116","cluster_addr":"172.21.15.62:6803/3291934116","heartbeat_back_addr":"172.21.15.62:6807/3291934116","heartbeat_front_addr":"172.21.15.62:6805/3291934116","state":["exists","up"]},{"osd":6,"uuid":"ad8950a5-70bd-488c-8f29-010515cc4a04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6817","nonce":3005996101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6819","nonce":3005996101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6823","nonce":3005996101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6821","nonce":3005996101}]},"public_addr":"172.21.15.62:6817/3005996101","cluster_addr":"172.21.15.62:6819/3005996101","heartbeat_back_addr":"172.21.15.62:6823/3005996101","heartbeat_front_addr":"172.21.15.62:6821/3005996101","state":["exists","up"]},{"osd":7,"uuid":"e0d4b8b7-3c80-4760-a342-1d508cdecc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6809","nonce":2800379225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6811","nonce":2800379225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6815","nonce":2800379225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6813","nonce":2800379225}]},"public_addr":"172.21.15.62:6809/2800379225","cluster_addr":"172.21.15.62:6811/2800379225","heartbeat_back_addr":"172.21.15.62:6815/2800379225","heartbeat_front_addr":"172.21.15.62:6813/2800379225","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.773714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.760037+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.811225+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.752810+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.745165+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.700634+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.768477+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.747301+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T14:40:52.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.059+0000 7f96133f3640 1 -- 172.21.15.39:0/3859036587 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f95f8076300 msgr2=0x7f95f8078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:52.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.059+0000 7f96133f3640 1 --2- 172.21.15.39:0/3859036587 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f95f8076300 0x7f95f8078810 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f960c158360 tx=0x7f9600007900 comp rx=0 tx=0).stop 2024-05-14T14:40:52.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.059+0000 7f96133f3640 1 -- 172.21.15.39:0/3859036587 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f960c06d5f0 msgr2=0x7f960c0ccd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:52.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.059+0000 7f96133f3640 1 --2- 172.21.15.39:0/3859036587 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f960c06d5f0 0x7f960c0ccd90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f960400c410 tx=0x7f960400c8d0 comp rx=0 tx=0).stop 2024-05-14T14:40:52.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.059+0000 7f96133f3640 1 -- 172.21.15.39:0/3859036587 shutdown_connections 2024-05-14T14:40:52.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.059+0000 7f96133f3640 1 --2- 172.21.15.39:0/3859036587 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f95f8076300 0x7f95f8078810 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:52.044 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.059+0000 7f96133f3640 1 --2- 172.21.15.39:0/3859036587 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f960c159c70 0x7f960c0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:52.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.059+0000 7f96133f3640 1 --2- 172.21.15.39:0/3859036587 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f960c160420 0x7f960c14f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:52.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.059+0000 7f96133f3640 1 --2- 172.21.15.39:0/3859036587 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f960c06d5f0 0x7f960c0ccd90 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:52.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.059+0000 7f96133f3640 1 -- 172.21.15.39:0/3859036587 >> 172.21.15.39:0/3859036587 conn(0x7f960c0d27d0 msgr2=0x7f960c15e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:52.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.059+0000 7f96133f3640 1 -- 172.21.15.39:0/3859036587 shutdown_connections 2024-05-14T14:40:52.045 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.059+0000 7f96133f3640 1 -- 172.21.15.39:0/3859036587 wait complete. 2024-05-14T14:40:52.056 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-14T14:40:52.056 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T14:40:52.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.187+0000 7fa89ee22640 1 Processor -- start 2024-05-14T14:40:52.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.187+0000 7fa89ee22640 1 -- start start 2024-05-14T14:40:52.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.190+0000 7fa89ee22640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa89815e030 0x7fa8980b6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:52.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.190+0000 7fa89ee22640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa8980d0200 0x7fa8980d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:52.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.190+0000 7fa89ee22640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8980b7420 con 0x7fa8980ce590 2024-05-14T14:40:52.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.190+0000 7fa89ee22640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fa8980d2490 con 0x7fa8980d0200 2024-05-14T14:40:52.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.190+0000 7fa89ee22640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fa8980d2770 con 0x7fa89815e030 2024-05-14T14:40:52.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.190+0000 7fa89d3bf640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fa8980d0200 0x7fa8980d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:52.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.190+0000 7fa89cbbe640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fa8980ce590 0x7fa898161c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:32964/0 (socket says 172.21.15.39:32964) 2024-05-14T14:40:52.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.190+0000 7fa89cbbe640 1 -- 172.21.15.39:0/1907131407 learned_addr learned my addr 172.21.15.39:0/1907131407 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:52.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.190+0000 7fa897fff640 1 --2- 172.21.15.39:0/1907131407 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa89815e030 0x7fa8980b6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:52.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.190+0000 7fa89d3bf640 1 -- 172.21.15.39:0/1907131407 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa89815e030 msgr2=0x7fa8980b6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:52.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.190+0000 7fa89d3bf640 1 --2- 172.21.15.39:0/1907131407 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa89815e030 0x7fa8980b6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:52.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.190+0000 7fa89d3bf640 1 -- 172.21.15.39:0/1907131407 >> v1:172.21.15.39:6789/0 conn(0x7fa8980ce590 legacy=0x7fa898161c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:52.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.190+0000 7fa8977fe640 1 -- 172.21.15.39:0/1907131407 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1480331317 0 0) 0x7fa8980b7420 con 0x7fa8980ce590 2024-05-14T14:40:52.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.190+0000 7fa89d3bf640 1 -- 172.21.15.39:0/1907131407 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa898162400 con 0x7fa8980d0200 2024-05-14T14:40:52.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.191+0000 7fa89d3bf640 1 --2- 172.21.15.39:0/1907131407 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8980d0200 0x7fa8980d0610 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa8900097a0 tx=0x7fa89002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c888acd667f717b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:52.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.191+0000 7fa8977fe640 1 -- 172.21.15.39:0/1907131407 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa890037070 con 0x7fa8980d0200 2024-05-14T14:40:52.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.191+0000 7fa8977fe640 1 -- 172.21.15.39:0/1907131407 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa89002ae50 con 0x7fa8980d0200 2024-05-14T14:40:52.177 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.191+0000 7fa8977fe640 1 -- 172.21.15.39:0/1907131407 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa890032660 con 0x7fa8980d0200 2024-05-14T14:40:52.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.192+0000 7fa89ee22640 1 -- 172.21.15.39:0/1907131407 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8980d0200 msgr2=0x7fa8980d0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:52.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.192+0000 7fa89ee22640 1 --2- 172.21.15.39:0/1907131407 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8980d0200 0x7fa8980d0610 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa8900097a0 tx=0x7fa89002a100 comp rx=0 tx=0).stop 2024-05-14T14:40:52.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.192+0000 7fa89ee22640 1 -- 172.21.15.39:0/1907131407 shutdown_connections 2024-05-14T14:40:52.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.192+0000 7fa89ee22640 1 --2- 172.21.15.39:0/1907131407 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8980d0200 0x7fa8980d0610 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:52.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.192+0000 7fa89ee22640 1 --2- 172.21.15.39:0/1907131407 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa89815e030 0x7fa8980b6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:52.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.192+0000 7fa89ee22640 1 -- 172.21.15.39:0/1907131407 >> 172.21.15.39:0/1907131407 conn(0x7fa898071660 msgr2=0x7fa898071a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:52.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.192+0000 7fa89ee22640 1 -- 172.21.15.39:0/1907131407 shutdown_connections 2024-05-14T14:40:52.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.192+0000 7fa89ee22640 1 -- 172.21.15.39:0/1907131407 wait complete. 2024-05-14T14:40:52.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.194+0000 7fa89ee22640 1 Processor -- start 2024-05-14T14:40:52.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.194+0000 7fa89ee22640 1 -- start start 2024-05-14T14:40:52.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.196+0000 7fa89ee22640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8980ce590 0x7fa8981f77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:52.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.196+0000 7fa89ee22640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8980d0200 0x7fa8980c5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:52.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.196+0000 7fa89ee22640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa89815e030 0x7fa8980c7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:52.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.196+0000 7fa89ee22640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fa8980d0b50 con 0x7fa8980d0200 2024-05-14T14:40:52.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.196+0000 7fa89ee22640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fa8981629c0 con 0x7fa89815e030 2024-05-14T14:40:52.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.196+0000 7fa89ee22640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fa89815e440 con 0x7fa8980ce590 2024-05-14T14:40:52.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.196+0000 7fa897fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8980d0200 0x7fa8980c5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:52.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.196+0000 7fa897fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8980d0200 0x7fa8980c5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36764/0 (socket says 172.21.15.39:36764) 2024-05-14T14:40:52.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.196+0000 7fa897fff640 1 -- 172.21.15.39:0/1976591660 learned_addr learned my addr 172.21.15.39:0/1976591660 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:52.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.196+0000 7fa89cbbe640 1 --2- 172.21.15.39:0/1976591660 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8980ce590 0x7fa8981f77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:52.183 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.196+0000 7fa89d3bf640 1 --2- 172.21.15.39:0/1976591660 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa89815e030 0x7fa8980c7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:52.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.196+0000 7fa897fff640 1 -- 172.21.15.39:0/1976591660 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8980ce590 msgr2=0x7fa8981f77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:52.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.196+0000 7fa897fff640 1 --2- 172.21.15.39:0/1976591660 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8980ce590 0x7fa8981f77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:52.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.196+0000 7fa897fff640 1 -- 172.21.15.39:0/1976591660 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa89815e030 msgr2=0x7fa8980c7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:52.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.196+0000 7fa897fff640 1 --2- 172.21.15.39:0/1976591660 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa89815e030 0x7fa8980c7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:52.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.196+0000 7fa897fff640 1 -- 172.21.15.39:0/1976591660 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8981f81a0 con 0x7fa8980d0200 2024-05-14T14:40:52.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.197+0000 7fa897fff640 1 --2- 172.21.15.39:0/1976591660 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8980d0200 0x7fa8980c5f80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa88800e8a0 tx=0x7fa88800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:52.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.197+0000 7fa8957fa640 1 -- 172.21.15.39:0/1976591660 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa888017070 con 0x7fa8980d0200 2024-05-14T14:40:52.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.197+0000 7fa8957fa640 1 -- 172.21.15.39:0/1976591660 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa88800c940 con 0x7fa8980d0200 2024-05-14T14:40:52.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.197+0000 7fa89ee22640 1 -- 172.21.15.39:0/1976591660 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8981f8480 con 0x7fa8980d0200 2024-05-14T14:40:52.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.197+0000 7fa8957fa640 1 -- 172.21.15.39:0/1976591660 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa88800cd30 con 0x7fa8980d0200 2024-05-14T14:40:52.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.197+0000 7fa89ee22640 1 -- 172.21.15.39:0/1976591660 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8980c64c0 con 0x7fa8980d0200 2024-05-14T14:40:52.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.198+0000 7fa89ee22640 1 -- 172.21.15.39:0/1976591660 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8980cf9e0 con 0x7fa8980d0200 2024-05-14T14:40:52.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.199+0000 7fa8957fa640 1 -- 172.21.15.39:0/1976591660 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fa88801a070 con 0x7fa8980d0200 2024-05-14T14:40:52.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.199+0000 7fa8957fa640 1 --2- 172.21.15.39:0/1976591660 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fa878076300 0x7fa878078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:52.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.199+0000 7fa8957fa640 1 -- 172.21.15.39:0/1976591660 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa888097ab0 con 0x7fa8980d0200 2024-05-14T14:40:52.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.199+0000 7fa89cbbe640 1 --2- 172.21.15.39:0/1976591660 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fa878076300 0x7fa878078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:52.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.200+0000 7fa89cbbe640 1 --2- 172.21.15.39:0/1976591660 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fa878076300 0x7fa878078810 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa8800012e0 tx=0x7fa880001630 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:52.189 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.204+0000 7fa8957fa640 1 -- 172.21.15.39:0/1976591660 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fa8980cf9e0 con 0x7fa8980d0200 2024-05-14T14:40:52.421 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.436+0000 7fa89ee22640 1 -- 172.21.15.39:0/1976591660 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa898076aa0 con 0x7fa8980d0200 2024-05-14T14:40:52.422 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.437+0000 7fa8957fa640 1 -- 172.21.15.39:0/1976591660 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5171 (secure 0 0 0) 0x7fa888060a80 con 0x7fa8980d0200 2024-05-14T14:40:52.422 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:40:52.422 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/3753262818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3753262818},{"type":"v1","addr":"172.21.15.62:6834","nonce":3753262818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/97693396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6835","nonce":97693396},{"type":"v1","addr":"172.21.15.39:6837","nonce":97693396}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6836/1648047942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":1648047942},{"type":"v1","addr":"172.21.15.39:6836","nonce":1648047942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T14:40:15.320927+0000","modified":"2024-05-14T14:40:28.417797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/1519798364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":1519798364},{"type":"v1","addr":"172.21.15.62:6835","nonce":1519798364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-05-14T14:40:52.422 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 9 2024-05-14T14:40:52.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.439+0000 7fa89ee22640 1 -- 172.21.15.39:0/1976591660 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fa878076300 msgr2=0x7fa878078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:52.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.439+0000 7fa89ee22640 1 --2- 172.21.15.39:0/1976591660 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fa878076300 0x7fa878078810 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa8800012e0 tx=0x7fa880001630 comp rx=0 tx=0).stop 2024-05-14T14:40:52.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.439+0000 7fa89ee22640 1 -- 172.21.15.39:0/1976591660 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8980d0200 msgr2=0x7fa8980c5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:52.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.439+0000 7fa89ee22640 1 --2- 172.21.15.39:0/1976591660 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8980d0200 0x7fa8980c5f80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa88800e8a0 tx=0x7fa88800ed60 comp rx=0 tx=0).stop 2024-05-14T14:40:52.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.439+0000 7fa89ee22640 1 -- 172.21.15.39:0/1976591660 shutdown_connections 2024-05-14T14:40:52.424 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.439+0000 7fa89ee22640 1 --2- 172.21.15.39:0/1976591660 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fa878076300 0x7fa878078810 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:52.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.439+0000 7fa89ee22640 1 --2- 172.21.15.39:0/1976591660 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa89815e030 0x7fa8980c7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:52.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.439+0000 7fa89ee22640 1 --2- 172.21.15.39:0/1976591660 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fa8980d0200 0x7fa8980c5f80 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:52.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.439+0000 7fa89ee22640 1 --2- 172.21.15.39:0/1976591660 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fa8980ce590 0x7fa8981f77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:52.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.439+0000 7fa89ee22640 1 -- 172.21.15.39:0/1976591660 >> 172.21.15.39:0/1976591660 conn(0x7fa898071660 msgr2=0x7fa8980b6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:52.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.439+0000 7fa89ee22640 1 -- 172.21.15.39:0/1976591660 shutdown_connections 2024-05-14T14:40:52.425 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.439+0000 7fa89ee22640 1 -- 172.21.15.39:0/1976591660 wait complete. 2024-05-14T14:40:52.436 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T14:40:52.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.568+0000 7fe1f1622640 1 Processor -- start 2024-05-14T14:40:52.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.568+0000 7fe1f1622640 1 -- start start 2024-05-14T14:40:52.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.569+0000 7fe1f1622640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe1ec06d640 0x7fe1ec0b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:52.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.569+0000 7fe1f1622640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1ec06f870 0x7fe1ec0cf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:52.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.569+0000 7fe1f1622640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1ec0b5870 con 0x7fe1ec0b6910 2024-05-14T14:40:52.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.569+0000 7fe1f1622640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fe1ec0d12b0 con 0x7fe1ec06d640 2024-05-14T14:40:52.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.570+0000 7fe1f1622640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe1ec0b6480 con 0x7fe1ec06f870 2024-05-14T14:40:52.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.570+0000 7fe1ea7fc640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fe1ec06d640 0x7fe1ec0b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:52.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.570+0000 7fe1eaffd640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fe1ec0b6910 0x7fe1ec06cf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:32968/0 (socket says 172.21.15.39:32968) 2024-05-14T14:40:52.555 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.570+0000 7fe1eaffd640 1 -- 172.21.15.39:0/2806451386 learned_addr learned my addr 172.21.15.39:0/2806451386 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:52.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.570+0000 7fe1eb7fe640 1 --2- 172.21.15.39:0/2806451386 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1ec06f870 0x7fe1ec0cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:52.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.570+0000 7fe1ea7fc640 1 -- 172.21.15.39:0/2806451386 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1ec06f870 msgr2=0x7fe1ec0cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:52.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.570+0000 7fe1ea7fc640 1 --2- 172.21.15.39:0/2806451386 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1ec06f870 0x7fe1ec0cf770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:52.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.570+0000 7fe1ea7fc640 1 -- 172.21.15.39:0/2806451386 >> v1:172.21.15.39:6789/0 conn(0x7fe1ec0b6910 legacy=0x7fe1ec06cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:52.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.570+0000 7fe1ea7fc640 1 -- 172.21.15.39:0/2806451386 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1ec0b5b50 con 0x7fe1ec06d640 2024-05-14T14:40:52.556 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.570+0000 7fe1e9ffb640 1 -- 172.21.15.39:0/2806451386 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3893045824 0 0) 0x7fe1ec0b5870 con 0x7fe1ec0b6910 2024-05-14T14:40:52.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.571+0000 7fe1ea7fc640 1 --2- 172.21.15.39:0/2806451386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1ec06d640 0x7fe1ec0b50e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe1d400a940 tx=0x7fe1d402b550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61c7d6d306b3be89 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:52.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.571+0000 7fe1e9ffb640 1 -- 172.21.15.39:0/2806451386 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d400b040 con 0x7fe1ec06d640 2024-05-14T14:40:52.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.571+0000 7fe1e9ffb640 1 -- 172.21.15.39:0/2806451386 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1d4030710 con 0x7fe1ec06d640 2024-05-14T14:40:52.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.571+0000 7fe1e9ffb640 1 -- 172.21.15.39:0/2806451386 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d4030ae0 con 0x7fe1ec06d640 2024-05-14T14:40:52.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.572+0000 7fe1f1622640 1 -- 172.21.15.39:0/2806451386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1ec06d640 msgr2=0x7fe1ec0b50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:52.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.572+0000 7fe1f1622640 1 --2- 172.21.15.39:0/2806451386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1ec06d640 0x7fe1ec0b50e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe1d400a940 tx=0x7fe1d402b550 comp rx=0 tx=0).stop 2024-05-14T14:40:52.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.572+0000 7fe1f1622640 1 -- 172.21.15.39:0/2806451386 shutdown_connections 2024-05-14T14:40:52.558 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.572+0000 7fe1f1622640 1 --2- 172.21.15.39:0/2806451386 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1ec06f870 0x7fe1ec0cf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:52.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.572+0000 7fe1f1622640 1 --2- 172.21.15.39:0/2806451386 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1ec06d640 0x7fe1ec0b50e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:52.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.572+0000 7fe1f1622640 1 -- 172.21.15.39:0/2806451386 >> 172.21.15.39:0/2806451386 conn(0x7fe1ec0ce330 msgr2=0x7fe1ec0ce740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:52.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.572+0000 7fe1f1622640 1 -- 172.21.15.39:0/2806451386 shutdown_connections 2024-05-14T14:40:52.559 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.572+0000 7fe1f1622640 1 -- 172.21.15.39:0/2806451386 wait complete. 2024-05-14T14:40:52.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.576+0000 7fe1f1622640 1 Processor -- start 2024-05-14T14:40:52.561 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.576+0000 7fe1f1622640 1 -- start start 2024-05-14T14:40:52.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.577+0000 7fe1f1622640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1ec06f870 0x7fe1ec0afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:52.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.577+0000 7fe1f1622640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1ec0b6910 0x7fe1ec14e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:52.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.577+0000 7fe1f1622640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1ec09ed10 0x7fe1ec09f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:52.563 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.577+0000 7fe1f1622640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ec0b6110 con 0x7fe1ec06f870 2024-05-14T14:40:52.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.577+0000 7fe1f1622640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ec0b5620 con 0x7fe1ec09ed10 2024-05-14T14:40:52.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.577+0000 7fe1f1622640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe1ec0b49c0 con 0x7fe1ec0b6910 2024-05-14T14:40:52.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.577+0000 7fe1eaffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1ec06f870 0x7fe1ec0afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:52.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.577+0000 7fe1eaffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1ec06f870 0x7fe1ec0afbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36778/0 (socket says 172.21.15.39:36778) 2024-05-14T14:40:52.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.577+0000 7fe1eaffd640 1 -- 172.21.15.39:0/878638060 learned_addr learned my addr 172.21.15.39:0/878638060 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:52.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.577+0000 7fe1ea7fc640 1 --2- 172.21.15.39:0/878638060 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1ec0b6910 0x7fe1ec14e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:52.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.577+0000 7fe1eb7fe640 1 --2- 172.21.15.39:0/878638060 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1ec09ed10 0x7fe1ec09f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:52.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.578+0000 7fe1eaffd640 1 -- 172.21.15.39:0/878638060 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1ec0b6910 msgr2=0x7fe1ec14e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:52.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.578+0000 7fe1eaffd640 1 --2- 172.21.15.39:0/878638060 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1ec0b6910 0x7fe1ec14e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:52.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.578+0000 7fe1eaffd640 1 -- 172.21.15.39:0/878638060 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1ec09ed10 msgr2=0x7fe1ec09f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:52.564 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.578+0000 7fe1eaffd640 1 --2- 172.21.15.39:0/878638060 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1ec09ed10 0x7fe1ec09f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:52.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.578+0000 7fe1eaffd640 1 -- 172.21.15.39:0/878638060 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1ec09da60 con 0x7fe1ec06f870 2024-05-14T14:40:52.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.578+0000 7fe1eaffd640 1 --2- 172.21.15.39:0/878638060 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1ec06f870 0x7fe1ec0afbd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc00c390 tx=0x7fe1dc00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:52.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.578+0000 7fe1e37fe640 1 -- 172.21.15.39:0/878638060 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc0074e0 con 0x7fe1ec06f870 2024-05-14T14:40:52.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.578+0000 7fe1e37fe640 1 -- 172.21.15.39:0/878638060 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1dc0047e0 con 0x7fe1ec06f870 2024-05-14T14:40:52.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.578+0000 7fe1f1622640 1 -- 172.21.15.39:0/878638060 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1ec09dd40 con 0x7fe1ec06f870 2024-05-14T14:40:52.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.578+0000 7fe1e37fe640 1 -- 172.21.15.39:0/878638060 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc004bd0 con 0x7fe1ec06f870 2024-05-14T14:40:52.565 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.578+0000 7fe1f1622640 1 -- 172.21.15.39:0/878638060 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1ec0af6b0 con 0x7fe1ec06f870 2024-05-14T14:40:52.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.579+0000 7fe1f1622640 1 -- 172.21.15.39:0/878638060 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1ec076aa0 con 0x7fe1ec06f870 2024-05-14T14:40:52.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.580+0000 7fe1e37fe640 1 -- 172.21.15.39:0/878638060 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe1dc011070 con 0x7fe1ec06f870 2024-05-14T14:40:52.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.580+0000 7fe1e37fe640 1 --2- 172.21.15.39:0/878638060 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe1cc0762d0 0x7fe1cc0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:52.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.580+0000 7fe1e37fe640 1 -- 172.21.15.39:0/878638060 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe1dc097340 con 0x7fe1ec06f870 2024-05-14T14:40:52.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.581+0000 7fe1ea7fc640 1 --2- 172.21.15.39:0/878638060 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe1cc0762d0 0x7fe1cc0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:52.566 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.581+0000 7fe1ea7fc640 1 --2- 172.21.15.39:0/878638060 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe1cc0762d0 0x7fe1cc0787e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4035000 tx=0x7fe1d4030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:52.570 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.585+0000 7fe1e37fe640 1 -- 172.21.15.39:0/878638060 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe1dc060320 con 0x7fe1ec06f870 2024-05-14T14:40:52.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.818+0000 7fe1f1622640 1 -- 172.21.15.39:0/878638060 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe1ec0b5870 con 0x7fe1ec06f870 2024-05-14T14:40:52.803 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.818+0000 7fe1e37fe640 1 -- 172.21.15.39:0/878638060 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5171 (secure 0 0 0) 0x7fe1dc064620 con 0x7fe1ec06f870 2024-05-14T14:40:52.803 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:40:52.803 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/3753262818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3753262818},{"type":"v1","addr":"172.21.15.62:6834","nonce":3753262818}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/97693396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6835","nonce":97693396},{"type":"v1","addr":"172.21.15.39:6837","nonce":97693396}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6836/1648047942","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":1648047942},{"type":"v1","addr":"172.21.15.39:6836","nonce":1648047942}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T14:40:15.320927+0000","modified":"2024-05-14T14:40:28.417797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/1519798364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":1519798364},{"type":"v1","addr":"172.21.15.62:6835","nonce":1519798364}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-05-14T14:40:52.804 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 9 2024-05-14T14:40:52.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.821+0000 7fe1f1622640 1 -- 172.21.15.39:0/878638060 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe1cc0762d0 msgr2=0x7fe1cc0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:52.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.821+0000 7fe1f1622640 1 --2- 172.21.15.39:0/878638060 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe1cc0762d0 0x7fe1cc0787e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4035000 tx=0x7fe1d4030000 comp rx=0 tx=0).stop 2024-05-14T14:40:52.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.821+0000 7fe1f1622640 1 -- 172.21.15.39:0/878638060 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1ec06f870 msgr2=0x7fe1ec0afbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:52.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.821+0000 7fe1f1622640 1 --2- 172.21.15.39:0/878638060 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1ec06f870 0x7fe1ec0afbd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc00c390 tx=0x7fe1dc00c850 comp rx=0 tx=0).stop 2024-05-14T14:40:52.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.821+0000 7fe1f1622640 1 -- 172.21.15.39:0/878638060 shutdown_connections 2024-05-14T14:40:52.806 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.821+0000 7fe1f1622640 1 --2- 172.21.15.39:0/878638060 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe1cc0762d0 0x7fe1cc0787e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:52.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.821+0000 7fe1f1622640 1 --2- 172.21.15.39:0/878638060 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1ec09ed10 0x7fe1ec09f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:52.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.821+0000 7fe1f1622640 1 --2- 172.21.15.39:0/878638060 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe1ec0b6910 0x7fe1ec14e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:52.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.821+0000 7fe1f1622640 1 --2- 172.21.15.39:0/878638060 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe1ec06f870 0x7fe1ec0afbd0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:52.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.821+0000 7fe1f1622640 1 -- 172.21.15.39:0/878638060 >> 172.21.15.39:0/878638060 conn(0x7fe1ec0ce330 msgr2=0x7fe1ec06fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:52.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.821+0000 7fe1f1622640 1 -- 172.21.15.39:0/878638060 shutdown_connections 2024-05-14T14:40:52.807 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.821+0000 7fe1f1622640 1 -- 172.21.15.39:0/878638060 wait complete. 2024-05-14T14:40:52.817 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T14:40:52.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.948+0000 7f4c02cc6640 1 Processor -- start 2024-05-14T14:40:52.933 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.948+0000 7f4c02cc6640 1 -- start start 2024-05-14T14:40:52.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.949+0000 7f4c02cc6640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4bfc15e5e0 0x7f4bfc0afc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:52.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.949+0000 7f4c02cc6640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4bfc06d080 0x7f4bfc06d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:52.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.949+0000 7f4c02cc6640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bfc144900 con 0x7f4bfc09b5f0 2024-05-14T14:40:52.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.949+0000 7f4c02cc6640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f4bfc0b0170 con 0x7f4bfc06d080 2024-05-14T14:40:52.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.949+0000 7f4c02cc6640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f4bfc15eaf0 con 0x7f4bfc15e5e0 2024-05-14T14:40:52.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.950+0000 7f4c01263640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f4bfc09b5f0 0x7f4bfc09ba00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:32984/0 (socket says 172.21.15.39:32984) 2024-05-14T14:40:52.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.950+0000 7f4c01263640 1 -- 172.21.15.39:0/1698790379 learned_addr learned my addr 172.21.15.39:0/1698790379 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:52.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.950+0000 7f4bfbfff640 1 --2- 172.21.15.39:0/1698790379 >> v2:172.21.15.62:3300/0 conn(0x7f4bfc06d080 0x7f4bfc06d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:52.936 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.950+0000 7f4c00a62640 1 --2- 172.21.15.39:0/1698790379 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4bfc15e5e0 0x7f4bfc0afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:52.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.950+0000 7f4bfb7fe640 1 -- 172.21.15.39:0/1698790379 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3342895136 0 0) 0x7f4bfc144900 con 0x7f4bfc09b5f0 2024-05-14T14:40:52.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.950+0000 7f4bfb7fe640 1 -- 172.21.15.39:0/1698790379 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bec003520 con 0x7f4bfc09b5f0 2024-05-14T14:40:52.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.950+0000 7f4bfbfff640 1 -- 172.21.15.39:0/1698790379 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4bfc15e5e0 msgr2=0x7f4bfc0afc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:52.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.950+0000 7f4bfbfff640 1 --2- 172.21.15.39:0/1698790379 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4bfc15e5e0 0x7f4bfc0afc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:52.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.950+0000 7f4bfbfff640 1 -- 172.21.15.39:0/1698790379 >> v1:172.21.15.39:6789/0 conn(0x7f4bfc09b5f0 legacy=0x7f4bfc09ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:52.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.950+0000 7f4bfbfff640 1 -- 172.21.15.39:0/1698790379 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bfc15edd0 con 0x7f4bfc06d080 2024-05-14T14:40:52.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.950+0000 7f4c00a62640 1 --2- 172.21.15.39:0/1698790379 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4bfc15e5e0 0x7f4bfc0afc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T14:40:52.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.951+0000 7f4bfbfff640 1 --2- 172.21.15.39:0/1698790379 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bfc06d080 0x7f4bfc06d490 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4be80097a0 tx=0x7f4be802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=445c61520882646c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:52.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.951+0000 7f4bfb7fe640 1 -- 172.21.15.39:0/1698790379 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be8037070 con 0x7f4bfc06d080 2024-05-14T14:40:52.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.951+0000 7f4bfb7fe640 1 -- 172.21.15.39:0/1698790379 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4be8032440 con 0x7f4bfc06d080 2024-05-14T14:40:52.937 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.951+0000 7f4bfb7fe640 1 -- 172.21.15.39:0/1698790379 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be8032810 con 0x7f4bfc06d080 2024-05-14T14:40:52.938 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.952+0000 7f4c02cc6640 1 -- 172.21.15.39:0/1698790379 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bfc06d080 msgr2=0x7f4bfc06d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:52.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.952+0000 7f4c02cc6640 1 --2- 172.21.15.39:0/1698790379 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bfc06d080 0x7f4bfc06d490 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4be80097a0 tx=0x7f4be802a180 comp rx=0 tx=0).stop 2024-05-14T14:40:52.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.952+0000 7f4c02cc6640 1 -- 172.21.15.39:0/1698790379 shutdown_connections 2024-05-14T14:40:52.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.952+0000 7f4c02cc6640 1 --2- 172.21.15.39:0/1698790379 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bfc06d080 0x7f4bfc06d490 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:52.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.952+0000 7f4c02cc6640 1 --2- 172.21.15.39:0/1698790379 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4bfc15e5e0 0x7f4bfc0afc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:52.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.952+0000 7f4c02cc6640 1 -- 172.21.15.39:0/1698790379 >> 172.21.15.39:0/1698790379 conn(0x7f4bfc074720 msgr2=0x7f4bfc0b7820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:52.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.952+0000 7f4c02cc6640 1 -- 172.21.15.39:0/1698790379 shutdown_connections 2024-05-14T14:40:52.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.952+0000 7f4c02cc6640 1 -- 172.21.15.39:0/1698790379 wait complete. 2024-05-14T14:40:52.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.954+0000 7f4c02cc6640 1 Processor -- start 2024-05-14T14:40:52.939 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.954+0000 7f4c02cc6640 1 -- start start 2024-05-14T14:40:52.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.955+0000 7f4c02cc6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bfc06d080 0x7f4bfc156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:52.941 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.955+0000 7f4c02cc6640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4bfc09b5f0 0x7f4bfc159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:52.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.955+0000 7f4c02cc6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4bfc15e5e0 0x7f4bfc15aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:52.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.955+0000 7f4c02cc6640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4bfc0d2c60 con 0x7f4bfc15e5e0 2024-05-14T14:40:52.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.955+0000 7f4c02cc6640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4bfc15f390 con 0x7f4bfc06d080 2024-05-14T14:40:52.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.955+0000 7f4c02cc6640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f4bfc0d2de0 con 0x7f4bfc09b5f0 2024-05-14T14:40:52.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.955+0000 7f4c01263640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4bfc15e5e0 0x7f4bfc15aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:52.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.955+0000 7f4c01263640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4bfc15e5e0 0x7f4bfc15aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36792/0 (socket says 172.21.15.39:36792) 2024-05-14T14:40:52.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.955+0000 7f4c01263640 1 -- 172.21.15.39:0/1859011548 learned_addr learned my addr 172.21.15.39:0/1859011548 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:52.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.956+0000 7f4bfbfff640 1 --2- 172.21.15.39:0/1859011548 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4bfc09b5f0 0x7f4bfc159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:52.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.956+0000 7f4c00a62640 1 --2- 172.21.15.39:0/1859011548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bfc06d080 0x7f4bfc156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:52.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.956+0000 7f4c01263640 1 -- 172.21.15.39:0/1859011548 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4bfc09b5f0 msgr2=0x7f4bfc159010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:52.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.956+0000 7f4c01263640 1 --2- 172.21.15.39:0/1859011548 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4bfc09b5f0 0x7f4bfc159010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:52.942 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.956+0000 7f4c01263640 1 -- 172.21.15.39:0/1859011548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bfc06d080 msgr2=0x7f4bfc156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:52.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.956+0000 7f4c01263640 1 --2- 172.21.15.39:0/1859011548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bfc06d080 0x7f4bfc156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:52.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.956+0000 7f4c01263640 1 -- 172.21.15.39:0/1859011548 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bfc156ac0 con 0x7f4bfc15e5e0 2024-05-14T14:40:52.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.956+0000 7f4c01263640 1 --2- 172.21.15.39:0/1859011548 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4bfc15e5e0 0x7f4bfc15aa00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4bf400cad0 tx=0x7f4bf400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:52.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.956+0000 7f4bf97fa640 1 -- 172.21.15.39:0/1859011548 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf400ab70 con 0x7f4bfc15e5e0 2024-05-14T14:40:52.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.956+0000 7f4c02cc6640 1 -- 172.21.15.39:0/1859011548 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bfc142550 con 0x7f4bfc15e5e0 2024-05-14T14:40:52.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.956+0000 7f4bf97fa640 1 -- 172.21.15.39:0/1859011548 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf400ad10 con 0x7f4bfc15e5e0 2024-05-14T14:40:52.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.956+0000 7f4bf97fa640 1 -- 172.21.15.39:0/1859011548 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bf4012600 con 0x7f4bfc15e5e0 2024-05-14T14:40:52.943 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.956+0000 7f4c02cc6640 1 -- 172.21.15.39:0/1859011548 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bfc142b10 con 0x7f4bfc15e5e0 2024-05-14T14:40:52.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.957+0000 7f4c02cc6640 1 -- 172.21.15.39:0/1859011548 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bfc076aa0 con 0x7f4bfc15e5e0 2024-05-14T14:40:52.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.959+0000 7f4bf97fa640 1 -- 172.21.15.39:0/1859011548 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4bf40127a0 con 0x7f4bfc15e5e0 2024-05-14T14:40:52.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.959+0000 7f4bf97fa640 1 --2- 172.21.15.39:0/1859011548 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4be0076300 0x7f4be0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:52.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.959+0000 7f4bf97fa640 1 -- 172.21.15.39:0/1859011548 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4bf4097ec0 con 0x7f4bfc15e5e0 2024-05-14T14:40:52.944 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.959+0000 7f4c00a62640 1 --2- 172.21.15.39:0/1859011548 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4be0076300 0x7f4be0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:52.945 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.960+0000 7f4c00a62640 1 --2- 172.21.15.39:0/1859011548 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4be0076300 0x7f4be0078810 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0009560 tx=0x7f4bf0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:52.953 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:52.968+0000 7f4bf97fa640 1 -- 172.21.15.39:0/1859011548 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4bfc156ac0 con 0x7f4bfc15e5e0 2024-05-14T14:40:53.145 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.160+0000 7f4c02cc6640 1 -- 172.21.15.39:0/1859011548 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4bfc0b3db0 con 0x7f4bfc15e5e0 2024-05-14T14:40:53.146 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.161+0000 7f4bf97fa640 1 -- 172.21.15.39:0/1859011548 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18454 (secure 0 0 0) 0x7f4bf4060d80 con 0x7f4bfc15e5e0 2024-05-14T14:40:53.147 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:40:53.147 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":24,"fsid":"d7983fec-79c7-4991-b19c-1aecead64611","created":"2024-05-14T14:39:52.157167+0000","modified":"2024-05-14T14:40:20.397684+0000","last_up_change":"2024-05-14T14:40:03.848608+0000","last_in_change":"2024-05-14T14:39:54.591920+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T14:40:04.692846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T14:40:13.794415+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T14:40:14.273154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T14:40:17.979457+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c4ec4534-6301-4dd7-b4d6-d560b096d442","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6801","nonce":4023478848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6803","nonce":4023478848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6807","nonce":4023478848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6805","nonce":4023478848}]},"public_addr":"172.21.15.39:6801/4023478848","cluster_addr":"172.21.15.39:6803/4023478848","heartbeat_back_addr":"172.21.15.39:6807/4023478848","heartbeat_front_addr":"172.21.15.39:6805/4023478848","state":["exists","up"]},{"osd":1,"uuid":"93f91b0e-096e-4bdf-aed0-d1136f73f136","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6817","nonce":926357398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6819","nonce":926357398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6823","nonce":926357398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6821","nonce":926357398}]},"public_addr":"172.21.15.39:6817/926357398","cluster_addr":"172.21.15.39:6819/926357398","heartbeat_back_addr":"172.21.15.39:6823/926357398","heartbeat_front_addr":"172.21.15.39:6821/926357398","state":["exists","up"]},{"osd":2,"uuid":"c590b1e0-67eb-452e-8e80-d2208da17d09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6809","nonce":610616754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6811","nonce":610616754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6815","nonce":610616754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6813","nonce":610616754}]},"public_addr":"172.21.15.39:6809/610616754","cluster_addr":"172.21.15.39:6811/610616754","heartbeat_back_addr":"172.21.15.39:6815/610616754","heartbeat_front_addr":"172.21.15.39:6813/610616754","state":["exists","up"]},{"osd":3,"uuid":"d57661b0-44f6-4355-9115-83eceb9b8f71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6825","nonce":1469314579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6827","nonce":1469314579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6831","nonce":1469314579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6829","nonce":1469314579}]},"public_addr":"172.21.15.39:6825/1469314579","cluster_addr":"172.21.15.39:6827/1469314579","heartbeat_back_addr":"172.21.15.39:6831/1469314579","heartbeat_front_addr":"172.21.15.39:6829/1469314579","state":["exists","up"]},{"osd":4,"uuid":"b131436f-f6e1-4d72-a86e-de200afdcebb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6825","nonce":3481507129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6827","nonce":3481507129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6831","nonce":3481507129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6829","nonce":3481507129}]},"public_addr":"172.21.15.62:6825/3481507129","cluster_addr":"172.21.15.62:6827/3481507129","heartbeat_back_addr":"172.21.15.62:6831/3481507129","heartbeat_front_addr":"172.21.15.62:6829/3481507129","state":["exists","up"]},{"osd":5,"uuid":"12e10b40-28b1-410f-9ce0-7b427daa111e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6801","nonce":3291934116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6803","nonce":3291934116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6807","nonce":3291934116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6805","nonce":3291934116}]},"public_addr":"172.21.15.62:6801/3291934116","cluster_addr":"172.21.15.62:6803/3291934116","heartbeat_back_addr":"172.21.15.62:6807/3291934116","heartbeat_front_addr":"172.21.15.62:6805/3291934116","state":["exists","up"]},{"osd":6,"uuid":"ad8950a5-70bd-488c-8f29-010515cc4a04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6817","nonce":3005996101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6819","nonce":3005996101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6823","nonce":3005996101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6821","nonce":3005996101}]},"public_addr":"172.21.15.62:6817/3005996101","cluster_addr":"172.21.15.62:6819/3005996101","heartbeat_back_addr":"172.21.15.62:6823/3005996101","heartbeat_front_addr":"172.21.15.62:6821/3005996101","state":["exists","up"]},{"osd":7,"uuid":"e0d4b8b7-3c80-4760-a342-1d508cdecc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6809","nonce":2800379225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6811","nonce":2800379225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6815","nonce":2800379225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6813","nonce":2800379225}]},"public_addr":"172.21.15.62:6809/2800379225","cluster_addr":"172.21.15.62:6811/2800379225","heartbeat_back_addr":"172.21.15.62:6815/2800379225","heartbeat_front_addr":"172.21.15.62:6813/2800379225","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.773714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.760037+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.811225+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.752810+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.745165+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.700634+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.768477+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.747301+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T14:40:53.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.164+0000 7f4c02cc6640 1 -- 172.21.15.39:0/1859011548 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4be0076300 msgr2=0x7f4be0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:53.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.164+0000 7f4c02cc6640 1 --2- 172.21.15.39:0/1859011548 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4be0076300 0x7f4be0078810 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0009560 tx=0x7f4bf0009190 comp rx=0 tx=0).stop 2024-05-14T14:40:53.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.164+0000 7f4c02cc6640 1 -- 172.21.15.39:0/1859011548 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4bfc15e5e0 msgr2=0x7f4bfc15aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:53.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.164+0000 7f4c02cc6640 1 --2- 172.21.15.39:0/1859011548 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4bfc15e5e0 0x7f4bfc15aa00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4bf400cad0 tx=0x7f4bf400cf90 comp rx=0 tx=0).stop 2024-05-14T14:40:53.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.164+0000 7f4c02cc6640 1 -- 172.21.15.39:0/1859011548 shutdown_connections 2024-05-14T14:40:53.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.164+0000 7f4c02cc6640 1 --2- 172.21.15.39:0/1859011548 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4be0076300 0x7f4be0078810 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:53.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.164+0000 7f4c02cc6640 1 --2- 172.21.15.39:0/1859011548 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4bfc15e5e0 0x7f4bfc15aa00 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:53.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.164+0000 7f4c02cc6640 1 --2- 172.21.15.39:0/1859011548 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4bfc09b5f0 0x7f4bfc159010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:53.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.164+0000 7f4c02cc6640 1 --2- 172.21.15.39:0/1859011548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4bfc06d080 0x7f4bfc156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:53.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.164+0000 7f4c02cc6640 1 -- 172.21.15.39:0/1859011548 >> 172.21.15.39:0/1859011548 conn(0x7f4bfc074720 msgr2=0x7f4bfc09ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:53.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.164+0000 7f4c02cc6640 1 -- 172.21.15.39:0/1859011548 shutdown_connections 2024-05-14T14:40:53.149 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.164+0000 7f4c02cc6640 1 -- 172.21.15.39:0/1859011548 wait complete. 2024-05-14T14:40:53.161 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-14T14:40:53.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.292+0000 7f7bf72e0640 1 Processor -- start 2024-05-14T14:40:53.277 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.292+0000 7f7bf72e0640 1 -- start start 2024-05-14T14:40:53.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.293+0000 7f7bf72e0640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7bf00ce590 0x7f7bf015e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:53.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.293+0000 7f7bf72e0640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7bf0161c20 0x7f7bf00b6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:53.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.293+0000 7f7bf72e0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7bf00d0200 0x7f7bf00d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:53.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.293+0000 7f7bf72e0640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f7bf00d2490 con 0x7f7bf00ce590 2024-05-14T14:40:53.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.293+0000 7f7bf72e0640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f7bf00d2770 con 0x7f7bf00d0200 2024-05-14T14:40:53.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.293+0000 7f7bf72e0640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f7bf015e570 con 0x7f7bf0161c20 2024-05-14T14:40:53.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.294+0000 7f7bf507c640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7bf00ce590 0x7f7bf015e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:53.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.294+0000 7f7bf507c640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f7bf00ce590 0x7f7bf015e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36808/0 (socket says 172.21.15.39:36808) 2024-05-14T14:40:53.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.294+0000 7f7bf507c640 1 -- 172.21.15.39:0/3359082525 learned_addr learned my addr 172.21.15.39:0/3359082525 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:53.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.294+0000 7f7bf507c640 1 -- 172.21.15.39:0/3359082525 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7bf0161c20 msgr2=0x7f7bf00b6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:53.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.294+0000 7f7bf487b640 1 --2- 172.21.15.39:0/3359082525 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7bf0161c20 0x7f7bf00b6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:53.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.294+0000 7f7bf587d640 1 --2- 172.21.15.39:0/3359082525 >> v2:172.21.15.62:3300/0 conn(0x7f7bf00d0200 0x7f7bf00d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:53.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.294+0000 7f7bf507c640 1 --2- 172.21.15.39:0/3359082525 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7bf0161c20 0x7f7bf00b6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:53.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.294+0000 7f7bf507c640 1 -- 172.21.15.39:0/3359082525 >> v2:172.21.15.62:3300/0 conn(0x7f7bf00d0200 msgr2=0x7f7bf00d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:53.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.294+0000 7f7bf507c640 1 --2- 172.21.15.39:0/3359082525 >> v2:172.21.15.62:3300/0 conn(0x7f7bf00d0200 0x7f7bf00d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:53.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.294+0000 7f7bf507c640 1 -- 172.21.15.39:0/3359082525 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bf00b7420 con 0x7f7bf00ce590 2024-05-14T14:40:53.280 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.294+0000 7f7bf587d640 1 --2- 172.21.15.39:0/3359082525 >> v2:172.21.15.62:3300/0 conn(0x7f7bf00d0200 0x7f7bf00d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:40:53.281 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.295+0000 7f7bf507c640 1 --2- 172.21.15.39:0/3359082525 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bf00ce590 0x7f7bf015e030 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7bf00d1590 tx=0x7f7bec02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a43933a2bdfdb01 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:53.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.295+0000 7f7be3fff640 1 -- 172.21.15.39:0/3359082525 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bec037070 con 0x7f7bf00ce590 2024-05-14T14:40:53.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.295+0000 7f7be3fff640 1 -- 172.21.15.39:0/3359082525 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bec032440 con 0x7f7bf00ce590 2024-05-14T14:40:53.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.295+0000 7f7be3fff640 1 -- 172.21.15.39:0/3359082525 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bec032810 con 0x7f7bf00ce590 2024-05-14T14:40:53.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.296+0000 7f7bf72e0640 1 -- 172.21.15.39:0/3359082525 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bf00ce590 msgr2=0x7f7bf015e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:53.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.296+0000 7f7bf72e0640 1 --2- 172.21.15.39:0/3359082525 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bf00ce590 0x7f7bf015e030 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7bf00d1590 tx=0x7f7bec02a140 comp rx=0 tx=0).stop 2024-05-14T14:40:53.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.296+0000 7f7bf72e0640 1 -- 172.21.15.39:0/3359082525 shutdown_connections 2024-05-14T14:40:53.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.296+0000 7f7bf72e0640 1 --2- 172.21.15.39:0/3359082525 >> v2:172.21.15.62:3300/0 conn(0x7f7bf00d0200 0x7f7bf00d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:53.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.296+0000 7f7bf72e0640 1 --2- 172.21.15.39:0/3359082525 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7bf0161c20 0x7f7bf00b6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:53.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.296+0000 7f7bf72e0640 1 --2- 172.21.15.39:0/3359082525 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bf00ce590 0x7f7bf015e030 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:53.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.296+0000 7f7bf72e0640 1 -- 172.21.15.39:0/3359082525 >> 172.21.15.39:0/3359082525 conn(0x7f7bf0071660 msgr2=0x7f7bf0071a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:53.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.296+0000 7f7bf72e0640 1 -- 172.21.15.39:0/3359082525 shutdown_connections 2024-05-14T14:40:53.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.296+0000 7f7bf72e0640 1 -- 172.21.15.39:0/3359082525 wait complete. 2024-05-14T14:40:53.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.299+0000 7f7bf72e0640 1 Processor -- start 2024-05-14T14:40:53.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.299+0000 7f7bf72e0640 1 -- start start 2024-05-14T14:40:53.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.301+0000 7f7bf72e0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bf00ce590 0x7f7bf0159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:53.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.301+0000 7f7bf72e0640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7bf00d0200 0x7f7bf00c6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:53.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.301+0000 7f7bf72e0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bf0161c20 0x7f7bf0144870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:53.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.301+0000 7f7bf72e0640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf01629c0 con 0x7f7bf00ce590 2024-05-14T14:40:53.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.301+0000 7f7bf72e0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf01626e0 con 0x7f7bf0161c20 2024-05-14T14:40:53.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.301+0000 7f7bf72e0640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f7bf00d0b50 con 0x7f7bf00d0200 2024-05-14T14:40:53.287 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.301+0000 7f7bf507c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bf00ce590 0x7f7bf0159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:53.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.301+0000 7f7bf507c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bf00ce590 0x7f7bf0159f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36812/0 (socket says 172.21.15.39:36812) 2024-05-14T14:40:53.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.301+0000 7f7bf507c640 1 -- 172.21.15.39:0/629413500 learned_addr learned my addr 172.21.15.39:0/629413500 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:53.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.301+0000 7f7bf487b640 1 --2- 172.21.15.39:0/629413500 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7bf00d0200 0x7f7bf00c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:53.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.301+0000 7f7bf587d640 1 --2- 172.21.15.39:0/629413500 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bf0161c20 0x7f7bf0144870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:53.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.301+0000 7f7bf507c640 1 -- 172.21.15.39:0/629413500 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7bf00d0200 msgr2=0x7f7bf00c6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:53.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.301+0000 7f7bf507c640 1 --2- 172.21.15.39:0/629413500 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7bf00d0200 0x7f7bf00c6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:53.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.301+0000 7f7bf507c640 1 -- 172.21.15.39:0/629413500 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bf0161c20 msgr2=0x7f7bf0144870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:53.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.301+0000 7f7bf507c640 1 --2- 172.21.15.39:0/629413500 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bf0161c20 0x7f7bf0144870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:53.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.301+0000 7f7bf507c640 1 -- 172.21.15.39:0/629413500 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bf00c6650 con 0x7f7bf00ce590 2024-05-14T14:40:53.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.301+0000 7f7bf587d640 1 --2- 172.21.15.39:0/629413500 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bf0161c20 0x7f7bf0144870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:40:53.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.302+0000 7f7bf507c640 1 --2- 172.21.15.39:0/629413500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bf00ce590 0x7f7bf0159f80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7bec000c00 tx=0x7f7bec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:53.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.302+0000 7f7be1ffb640 1 -- 172.21.15.39:0/629413500 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bec037040 con 0x7f7bf00ce590 2024-05-14T14:40:53.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.302+0000 7f7be1ffb640 1 -- 172.21.15.39:0/629413500 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bec042070 con 0x7f7bf00ce590 2024-05-14T14:40:53.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.302+0000 7f7bf72e0640 1 -- 172.21.15.39:0/629413500 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bf01581c0 con 0x7f7bf00ce590 2024-05-14T14:40:53.288 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.302+0000 7f7be1ffb640 1 -- 172.21.15.39:0/629413500 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bec030bb0 con 0x7f7bf00ce590 2024-05-14T14:40:53.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.302+0000 7f7bf72e0640 1 -- 172.21.15.39:0/629413500 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bf0158780 con 0x7f7bf00ce590 2024-05-14T14:40:53.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.303+0000 7f7bf72e0640 1 -- 172.21.15.39:0/629413500 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bf0076aa0 con 0x7f7bf00ce590 2024-05-14T14:40:53.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.304+0000 7f7be1ffb640 1 -- 172.21.15.39:0/629413500 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7bec047460 con 0x7f7bf00ce590 2024-05-14T14:40:53.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.305+0000 7f7be1ffb640 1 --2- 172.21.15.39:0/629413500 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f7bd4076300 0x7f7bd4078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:53.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.305+0000 7f7be1ffb640 1 -- 172.21.15.39:0/629413500 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7bec0b8500 con 0x7f7bf00ce590 2024-05-14T14:40:53.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.305+0000 7f7bf487b640 1 --2- 172.21.15.39:0/629413500 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f7bd4076300 0x7f7bd4078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:53.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.305+0000 7f7bf487b640 1 --2- 172.21.15.39:0/629413500 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f7bd4076300 0x7f7bd4078810 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7be4006fd0 tx=0x7f7be4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:53.294 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.309+0000 7f7be1ffb640 1 -- 172.21.15.39:0/629413500 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7bf00c6650 con 0x7f7bf00ce590 2024-05-14T14:40:53.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.541+0000 7f7bf72e0640 1 -- 172.21.15.39:0/629413500 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f7bf00d1d60 con 0x7f7bf00ce590 2024-05-14T14:40:53.526 INFO:tasks.ceph.mon.a.smithi039.stderr:2024-05-14T14:40:53.541+0000 7fbdf2d0d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-14T14:40:53.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.543+0000 7f7be1ffb640 1 -- 172.21.15.39:0/629413500 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7f7bec0814d0 con 0x7f7bf00ce590 2024-05-14T14:40:53.528 INFO:teuthology.orchestra.run.smithi039.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-14T14:40:53.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.546+0000 7f7bf72e0640 1 -- 172.21.15.39:0/629413500 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f7bd4076300 msgr2=0x7f7bd4078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:53.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.546+0000 7f7bf72e0640 1 --2- 172.21.15.39:0/629413500 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f7bd4076300 0x7f7bd4078810 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7be4006fd0 tx=0x7f7be4008040 comp rx=0 tx=0).stop 2024-05-14T14:40:53.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.546+0000 7f7bf72e0640 1 -- 172.21.15.39:0/629413500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bf00ce590 msgr2=0x7f7bf0159f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:53.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.546+0000 7f7bf72e0640 1 --2- 172.21.15.39:0/629413500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bf00ce590 0x7f7bf0159f80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7bec000c00 tx=0x7f7bec0046c0 comp rx=0 tx=0).stop 2024-05-14T14:40:53.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.546+0000 7f7bf72e0640 1 -- 172.21.15.39:0/629413500 shutdown_connections 2024-05-14T14:40:53.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.546+0000 7f7bf72e0640 1 --2- 172.21.15.39:0/629413500 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f7bd4076300 0x7f7bd4078810 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:53.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.546+0000 7f7bf72e0640 1 --2- 172.21.15.39:0/629413500 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bf0161c20 0x7f7bf0144870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:53.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.546+0000 7f7bf72e0640 1 --2- 172.21.15.39:0/629413500 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f7bf00d0200 0x7f7bf00c6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:53.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.546+0000 7f7bf72e0640 1 --2- 172.21.15.39:0/629413500 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f7bf00ce590 0x7f7bf0159f80 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:53.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.546+0000 7f7bf72e0640 1 -- 172.21.15.39:0/629413500 >> 172.21.15.39:0/629413500 conn(0x7f7bf0071660 msgr2=0x7f7bf0071a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:53.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.546+0000 7f7bf72e0640 1 -- 172.21.15.39:0/629413500 shutdown_connections 2024-05-14T14:40:53.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.546+0000 7f7bf72e0640 1 -- 172.21.15.39:0/629413500 wait complete. 2024-05-14T14:40:53.535 INFO:tasks.ceph.mds.b.smithi062.stderr: -4027> 2024-05-14T14:40:21.473+0000 7fc00080a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-14T14:40:53.543 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-14T14:40:53.597 INFO:tasks.ceph.mds.b.smithi062.stdout:starting mds.b at 2024-05-14T14:40:53.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.675+0000 7fe343af2640 1 Processor -- start 2024-05-14T14:40:53.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.675+0000 7fe343af2640 1 -- start start 2024-05-14T14:40:53.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.677+0000 7fe343af2640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe33c0736e0 0x7fe33c0b8250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:53.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.677+0000 7fe343af2640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe33c15e0b0 0x7fe33c0b8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:53.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.677+0000 7fe343af2640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe33c164090 con 0x7fe33c0b6950 2024-05-14T14:40:53.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.677+0000 7fe343af2640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fe33c164950 con 0x7fe33c15e0b0 2024-05-14T14:40:53.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.677+0000 7fe343af2640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe33c164300 con 0x7fe33c0736e0 2024-05-14T14:40:53.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.677+0000 7fe34208f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe33c15e0b0 0x7fe33c0b8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:53.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.677+0000 7fe34188e640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fe33c0b6950 0x7fe33c072fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.39:47036/0 (socket says 172.21.15.39:47036) 2024-05-14T14:40:53.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.677+0000 7fe34188e640 1 -- 172.21.15.39:0/60497911 learned_addr learned my addr 172.21.15.39:0/60497911 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:53.662 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.677+0000 7fe34108d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe33c0736e0 0x7fe33c0b8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:53.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.677+0000 7fe34088c640 1 -- 172.21.15.39:0/60497911 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1539210958 0 0) 0x7fe33c164090 con 0x7fe33c0b6950 2024-05-14T14:40:53.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.677+0000 7fe34088c640 1 -- 172.21.15.39:0/60497911 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe324003520 con 0x7fe33c0b6950 2024-05-14T14:40:53.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.677+0000 7fe34108d640 1 -- 172.21.15.39:0/60497911 >> v2:172.21.15.62:3300/0 conn(0x7fe33c15e0b0 msgr2=0x7fe33c0b8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:53.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.677+0000 7fe34108d640 1 --2- 172.21.15.39:0/60497911 >> v2:172.21.15.62:3300/0 conn(0x7fe33c15e0b0 0x7fe33c0b8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:53.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.677+0000 7fe34108d640 1 -- 172.21.15.39:0/60497911 >> v1:172.21.15.62:6789/0 conn(0x7fe33c0b6950 legacy=0x7fe33c072fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:53.663 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.677+0000 7fe34108d640 1 -- 172.21.15.39:0/60497911 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe33c1645e0 con 0x7fe33c0736e0 2024-05-14T14:40:53.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.678+0000 7fe34108d640 1 --2- 172.21.15.39:0/60497911 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe33c0736e0 0x7fe33c0b8250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe3300097a0 tx=0x7fe33002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=463cf127fd067c35 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:53.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.678+0000 7fe34088c640 1 -- 172.21.15.39:0/60497911 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe330037070 con 0x7fe33c0736e0 2024-05-14T14:40:53.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.678+0000 7fe34088c640 1 -- 172.21.15.39:0/60497911 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe330032440 con 0x7fe33c0736e0 2024-05-14T14:40:53.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.678+0000 7fe34088c640 1 -- 172.21.15.39:0/60497911 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3300327f0 con 0x7fe33c0736e0 2024-05-14T14:40:53.664 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.679+0000 7fe343af2640 1 -- 172.21.15.39:0/60497911 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe33c0736e0 msgr2=0x7fe33c0b8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:53.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.679+0000 7fe343af2640 1 --2- 172.21.15.39:0/60497911 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe33c0736e0 0x7fe33c0b8250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe3300097a0 tx=0x7fe33002a180 comp rx=0 tx=0).stop 2024-05-14T14:40:53.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.679+0000 7fe343af2640 1 -- 172.21.15.39:0/60497911 shutdown_connections 2024-05-14T14:40:53.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.679+0000 7fe343af2640 1 --2- 172.21.15.39:0/60497911 >> v2:172.21.15.62:3300/0 conn(0x7fe33c15e0b0 0x7fe33c0b8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:53.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.679+0000 7fe343af2640 1 --2- 172.21.15.39:0/60497911 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe33c0736e0 0x7fe33c0b8250 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:53.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.679+0000 7fe343af2640 1 -- 172.21.15.39:0/60497911 >> 172.21.15.39:0/60497911 conn(0x7fe33c0d3b00 msgr2=0x7fe33c0d3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:53.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.679+0000 7fe343af2640 1 -- 172.21.15.39:0/60497911 shutdown_connections 2024-05-14T14:40:53.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.679+0000 7fe343af2640 1 -- 172.21.15.39:0/60497911 wait complete. 2024-05-14T14:40:53.665 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.681+0000 7fe343af2640 1 Processor -- start 2024-05-14T14:40:53.666 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.681+0000 7fe343af2640 1 -- start start 2024-05-14T14:40:53.668 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.682+0000 7fe343af2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe33c0b6950 0x7fe33c0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:53.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.682+0000 7fe343af2640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe33c15e0b0 0x7fe33c0b01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:53.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.682+0000 7fe343af2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe33c1f9080 0x7fe33c1f9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:53.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.682+0000 7fe343af2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe33c161480 con 0x7fe33c0b6950 2024-05-14T14:40:53.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.682+0000 7fe343af2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe33c161860 con 0x7fe33c1f9080 2024-05-14T14:40:53.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.682+0000 7fe343af2640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe33c161600 con 0x7fe33c15e0b0 2024-05-14T14:40:53.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.682+0000 7fe34188e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe33c0b6950 0x7fe33c0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:53.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.682+0000 7fe34188e640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe33c0b6950 0x7fe33c0b25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36824/0 (socket says 172.21.15.39:36824) 2024-05-14T14:40:53.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.682+0000 7fe34188e640 1 -- 172.21.15.39:0/2146730985 learned_addr learned my addr 172.21.15.39:0/2146730985 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:53.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.682+0000 7fe34108d640 1 --2- 172.21.15.39:0/2146730985 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe33c15e0b0 0x7fe33c0b01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:53.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.682+0000 7fe34208f640 1 --2- 172.21.15.39:0/2146730985 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe33c1f9080 0x7fe33c1f9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:53.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.683+0000 7fe34188e640 1 -- 172.21.15.39:0/2146730985 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe33c15e0b0 msgr2=0x7fe33c0b01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:53.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.683+0000 7fe34188e640 1 --2- 172.21.15.39:0/2146730985 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe33c15e0b0 0x7fe33c0b01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:53.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.683+0000 7fe34188e640 1 -- 172.21.15.39:0/2146730985 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe33c1f9080 msgr2=0x7fe33c1f9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:53.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.683+0000 7fe34188e640 1 --2- 172.21.15.39:0/2146730985 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe33c1f9080 0x7fe33c1f9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:53.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.683+0000 7fe34188e640 1 -- 172.21.15.39:0/2146730985 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe33c1f7fe0 con 0x7fe33c0b6950 2024-05-14T14:40:53.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.683+0000 7fe34188e640 1 --2- 172.21.15.39:0/2146730985 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe33c0b6950 0x7fe33c0b25a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe32c00cbf0 tx=0x7fe32c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:53.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.683+0000 7fe33a7fc640 1 -- 172.21.15.39:0/2146730985 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32c00ace0 con 0x7fe33c0b6950 2024-05-14T14:40:53.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.683+0000 7fe33a7fc640 1 -- 172.21.15.39:0/2146730985 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe32c012400 con 0x7fe33c0b6950 2024-05-14T14:40:53.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.683+0000 7fe343af2640 1 -- 172.21.15.39:0/2146730985 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe33c1f82c0 con 0x7fe33c0b6950 2024-05-14T14:40:53.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.683+0000 7fe33a7fc640 1 -- 172.21.15.39:0/2146730985 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32c0127b0 con 0x7fe33c0b6950 2024-05-14T14:40:53.670 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.683+0000 7fe343af2640 1 -- 172.21.15.39:0/2146730985 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe33c1f8880 con 0x7fe33c0b6950 2024-05-14T14:40:53.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.684+0000 7fe343af2640 1 -- 172.21.15.39:0/2146730985 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe33c076aa0 con 0x7fe33c0b6950 2024-05-14T14:40:53.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.685+0000 7fe33a7fc640 1 -- 172.21.15.39:0/2146730985 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe32c012950 con 0x7fe33c0b6950 2024-05-14T14:40:53.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.685+0000 7fe33a7fc640 1 --2- 172.21.15.39:0/2146730985 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe3280762d0 0x7fe3280787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:53.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.686+0000 7fe33a7fc640 1 -- 172.21.15.39:0/2146730985 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6618+0+0 (secure 0 0 0) 0x7fe32c097fe0 con 0x7fe33c0b6950 2024-05-14T14:40:53.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.686+0000 7fe34108d640 1 --2- 172.21.15.39:0/2146730985 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe3280762d0 0x7fe3280787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:53.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.686+0000 7fe34108d640 1 --2- 172.21.15.39:0/2146730985 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe3280762d0 0x7fe3280787e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe330034000 tx=0x7fe33002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:53.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.690+0000 7fe33a7fc640 1 -- 172.21.15.39:0/2146730985 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe32c060e30 con 0x7fe33c0b6950 2024-05-14T14:40:53.905 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:53.921+0000 7fe343af2640 1 -- 172.21.15.39:0/2146730985 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fe33c0d3160 con 0x7fe33c0b6950 2024-05-14T14:40:54.531 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.546+0000 7fe33a7fc640 1 -- 172.21.15.39:0/2146730985 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7fe32c065130 con 0x7fe33c0b6950 2024-05-14T14:40:54.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.548+0000 7fe343af2640 1 -- 172.21.15.39:0/2146730985 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe3280762d0 msgr2=0x7fe3280787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:54.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.548+0000 7fe343af2640 1 --2- 172.21.15.39:0/2146730985 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe3280762d0 0x7fe3280787e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe330034000 tx=0x7fe33002e000 comp rx=0 tx=0).stop 2024-05-14T14:40:54.533 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.548+0000 7fe343af2640 1 -- 172.21.15.39:0/2146730985 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe33c0b6950 msgr2=0x7fe33c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:54.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.548+0000 7fe343af2640 1 --2- 172.21.15.39:0/2146730985 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe33c0b6950 0x7fe33c0b25a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe32c00cbf0 tx=0x7fe32c00a430 comp rx=0 tx=0).stop 2024-05-14T14:40:54.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.548+0000 7fe343af2640 1 -- 172.21.15.39:0/2146730985 shutdown_connections 2024-05-14T14:40:54.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.548+0000 7fe343af2640 1 --2- 172.21.15.39:0/2146730985 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe3280762d0 0x7fe3280787e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:54.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.548+0000 7fe343af2640 1 --2- 172.21.15.39:0/2146730985 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe33c1f9080 0x7fe33c1f9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:54.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.548+0000 7fe343af2640 1 --2- 172.21.15.39:0/2146730985 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe33c15e0b0 0x7fe33c0b01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:54.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.548+0000 7fe343af2640 1 --2- 172.21.15.39:0/2146730985 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe33c0b6950 0x7fe33c0b25a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:54.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.548+0000 7fe343af2640 1 -- 172.21.15.39:0/2146730985 >> 172.21.15.39:0/2146730985 conn(0x7fe33c0d3b00 msgr2=0x7fe33c161a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:54.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.549+0000 7fe343af2640 1 -- 172.21.15.39:0/2146730985 shutdown_connections 2024-05-14T14:40:54.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.549+0000 7fe343af2640 1 -- 172.21.15.39:0/2146730985 wait complete. 2024-05-14T14:40:54.547 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-14T14:40:54.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.684+0000 7fea698fa640 1 Processor -- start 2024-05-14T14:40:54.669 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.684+0000 7fea698fa640 1 -- start start 2024-05-14T14:40:54.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.686+0000 7fea698fa640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea64160420 0x7fea640d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:54.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.686+0000 7fea698fa640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fea6406d7c0 0x7fea640ba070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:54.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.686+0000 7fea698fa640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea640b9310 con 0x7fea640d1140 2024-05-14T14:40:54.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.686+0000 7fea698fa640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fea640d1550 con 0x7fea6406d7c0 2024-05-14T14:40:54.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.686+0000 7fea698fa640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fea6406dd70 con 0x7fea64160420 2024-05-14T14:40:54.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.686+0000 7fea637fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fea6406d7c0 0x7fea640ba070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:54.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.686+0000 7fea62ffd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea64160420 0x7fea640d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:54.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.686+0000 7fea5a7fc640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fea640d1140 0x7fea6406d0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.39:47048/0 (socket says 172.21.15.39:47048) 2024-05-14T14:40:54.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.686+0000 7fea5a7fc640 1 -- 172.21.15.39:0/494940390 learned_addr learned my addr 172.21.15.39:0/494940390 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:54.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.686+0000 7fea62ffd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea64160420 0x7fea640d0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.39:43210/0 (socket says 172.21.15.39:43210) 2024-05-14T14:40:54.672 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.687+0000 7fea637fe640 1 -- 172.21.15.39:0/494940390 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea64160420 msgr2=0x7fea640d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:54.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.687+0000 7fea637fe640 1 --2- 172.21.15.39:0/494940390 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea64160420 0x7fea640d0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:54.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.687+0000 7fea637fe640 1 -- 172.21.15.39:0/494940390 >> v1:172.21.15.62:6789/0 conn(0x7fea640d1140 legacy=0x7fea6406d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:54.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.687+0000 7fea637fe640 1 -- 172.21.15.39:0/494940390 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea640b9590 con 0x7fea6406d7c0 2024-05-14T14:40:54.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.687+0000 7fea62ffd640 1 --2- 172.21.15.39:0/494940390 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea64160420 0x7fea640d0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T14:40:54.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.687+0000 7fea637fe640 1 --2- 172.21.15.39:0/494940390 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea6406d7c0 0x7fea640ba070 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fea5c009d90 tx=0x7fea5c02a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1266f31e00683f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:54.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.688+0000 7fea627fc640 1 -- 172.21.15.39:0/494940390 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea5c031600 con 0x7fea6406d7c0 2024-05-14T14:40:54.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.688+0000 7fea627fc640 1 -- 172.21.15.39:0/494940390 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea5c0317a0 con 0x7fea6406d7c0 2024-05-14T14:40:54.673 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.688+0000 7fea627fc640 1 -- 172.21.15.39:0/494940390 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea5c031b70 con 0x7fea6406d7c0 2024-05-14T14:40:54.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.688+0000 7fea698fa640 1 -- 172.21.15.39:0/494940390 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea6406d7c0 msgr2=0x7fea640ba070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:54.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.688+0000 7fea698fa640 1 --2- 172.21.15.39:0/494940390 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea6406d7c0 0x7fea640ba070 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fea5c009d90 tx=0x7fea5c02a5d0 comp rx=0 tx=0).stop 2024-05-14T14:40:54.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.688+0000 7fea698fa640 1 -- 172.21.15.39:0/494940390 shutdown_connections 2024-05-14T14:40:54.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.688+0000 7fea698fa640 1 --2- 172.21.15.39:0/494940390 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea6406d7c0 0x7fea640ba070 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:54.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.688+0000 7fea698fa640 1 --2- 172.21.15.39:0/494940390 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea64160420 0x7fea640d0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:54.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.688+0000 7fea698fa640 1 -- 172.21.15.39:0/494940390 >> 172.21.15.39:0/494940390 conn(0x7fea640d27d0 msgr2=0x7fea640d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:54.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.688+0000 7fea698fa640 1 -- 172.21.15.39:0/494940390 shutdown_connections 2024-05-14T14:40:54.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.688+0000 7fea698fa640 1 -- 172.21.15.39:0/494940390 wait complete. 2024-05-14T14:40:54.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.690+0000 7fea698fa640 1 Processor -- start 2024-05-14T14:40:54.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.690+0000 7fea698fa640 1 -- start start 2024-05-14T14:40:54.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.692+0000 7fea698fa640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea6406d7c0 0x7fea640ad9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:54.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.692+0000 7fea698fa640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea640d1140 0x7fea640af040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:54.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.692+0000 7fea698fa640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea64160420 0x7fea641eb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:54.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.692+0000 7fea698fa640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fea64160830 con 0x7fea64160420 2024-05-14T14:40:54.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.692+0000 7fea698fa640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fea640b9b50 con 0x7fea640d1140 2024-05-14T14:40:54.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.692+0000 7fea698fa640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fea640ba5b0 con 0x7fea6406d7c0 2024-05-14T14:40:54.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.692+0000 7fea637fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea64160420 0x7fea641eb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:54.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.692+0000 7fea637fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea64160420 0x7fea641eb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36834/0 (socket says 172.21.15.39:36834) 2024-05-14T14:40:54.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.692+0000 7fea637fe640 1 -- 172.21.15.39:0/3262469131 learned_addr learned my addr 172.21.15.39:0/3262469131 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:54.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.692+0000 7fea5a7fc640 1 --2- 172.21.15.39:0/3262469131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea640d1140 0x7fea640af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:54.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.692+0000 7fea62ffd640 1 --2- 172.21.15.39:0/3262469131 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea6406d7c0 0x7fea640ad9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:54.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.692+0000 7fea637fe640 1 -- 172.21.15.39:0/3262469131 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea6406d7c0 msgr2=0x7fea640ad9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:54.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.692+0000 7fea637fe640 1 --2- 172.21.15.39:0/3262469131 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea6406d7c0 0x7fea640ad9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:54.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.692+0000 7fea637fe640 1 -- 172.21.15.39:0/3262469131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea640d1140 msgr2=0x7fea640af040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:54.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.692+0000 7fea637fe640 1 --2- 172.21.15.39:0/3262469131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea640d1140 0x7fea640af040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:54.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.692+0000 7fea637fe640 1 -- 172.21.15.39:0/3262469131 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea640ac9b0 con 0x7fea64160420 2024-05-14T14:40:54.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.692+0000 7fea637fe640 1 --2- 172.21.15.39:0/3262469131 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea64160420 0x7fea641eb040 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fea5c009eb0 tx=0x7fea5c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:54.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.693+0000 7fea60ff9640 1 -- 172.21.15.39:0/3262469131 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea5c03f070 con 0x7fea64160420 2024-05-14T14:40:54.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.693+0000 7fea60ff9640 1 -- 172.21.15.39:0/3262469131 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea5c030c00 con 0x7fea64160420 2024-05-14T14:40:54.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.693+0000 7fea698fa640 1 -- 172.21.15.39:0/3262469131 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea640acc20 con 0x7fea64160420 2024-05-14T14:40:54.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.693+0000 7fea60ff9640 1 -- 172.21.15.39:0/3262469131 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea5c009450 con 0x7fea64160420 2024-05-14T14:40:54.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.693+0000 7fea698fa640 1 -- 172.21.15.39:0/3262469131 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea640ad1e0 con 0x7fea64160420 2024-05-14T14:40:54.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.694+0000 7fea698fa640 1 -- 172.21.15.39:0/3262469131 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea64076aa0 con 0x7fea64160420 2024-05-14T14:40:54.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.694+0000 7fea60ff9640 1 -- 172.21.15.39:0/3262469131 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fea5c043410 con 0x7fea64160420 2024-05-14T14:40:54.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.695+0000 7fea60ff9640 1 --2- 172.21.15.39:0/3262469131 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fea440762d0 0x7fea440787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:54.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.695+0000 7fea62ffd640 1 --2- 172.21.15.39:0/3262469131 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fea440762d0 0x7fea440787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:54.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.695+0000 7fea60ff9640 1 -- 172.21.15.39:0/3262469131 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6618+0+0 (secure 0 0 0) 0x7fea5c0b89a0 con 0x7fea64160420 2024-05-14T14:40:54.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.696+0000 7fea62ffd640 1 --2- 172.21.15.39:0/3262469131 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fea440762d0 0x7fea440787e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fea54009560 tx=0x7fea54009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:54.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.700+0000 7fea60ff9640 1 -- 172.21.15.39:0/3262469131 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fea5c0819b0 con 0x7fea64160420 2024-05-14T14:40:54.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:54.890+0000 7fea698fa640 1 -- 172.21.15.39:0/3262469131 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fea640d2090 con 0x7fea64160420 2024-05-14T14:40:55.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.552+0000 7fea60ff9640 1 -- 172.21.15.39:0/3262469131 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v26) ==== 181+0+0 (secure 0 0 0) 0x7fea5c085cb0 con 0x7fea64160420 2024-05-14T14:40:55.537 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_metadata' removed 2024-05-14T14:40:55.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.556+0000 7fea698fa640 1 -- 172.21.15.39:0/3262469131 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fea440762d0 msgr2=0x7fea440787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:55.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.556+0000 7fea698fa640 1 --2- 172.21.15.39:0/3262469131 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fea440762d0 0x7fea440787e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fea54009560 tx=0x7fea54009190 comp rx=0 tx=0).stop 2024-05-14T14:40:55.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.556+0000 7fea698fa640 1 -- 172.21.15.39:0/3262469131 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea64160420 msgr2=0x7fea641eb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:55.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.556+0000 7fea698fa640 1 --2- 172.21.15.39:0/3262469131 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea64160420 0x7fea641eb040 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fea5c009eb0 tx=0x7fea5c004a40 comp rx=0 tx=0).stop 2024-05-14T14:40:55.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.556+0000 7fea698fa640 1 -- 172.21.15.39:0/3262469131 shutdown_connections 2024-05-14T14:40:55.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.556+0000 7fea698fa640 1 --2- 172.21.15.39:0/3262469131 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fea440762d0 0x7fea440787e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:55.541 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.556+0000 7fea698fa640 1 --2- 172.21.15.39:0/3262469131 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fea64160420 0x7fea641eb040 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:55.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.556+0000 7fea698fa640 1 --2- 172.21.15.39:0/3262469131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fea640d1140 0x7fea640af040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:55.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.556+0000 7fea698fa640 1 --2- 172.21.15.39:0/3262469131 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fea6406d7c0 0x7fea640ad9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:55.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.556+0000 7fea698fa640 1 -- 172.21.15.39:0/3262469131 >> 172.21.15.39:0/3262469131 conn(0x7fea640d27d0 msgr2=0x7fea64161500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:55.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.556+0000 7fea698fa640 1 -- 172.21.15.39:0/3262469131 shutdown_connections 2024-05-14T14:40:55.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.556+0000 7fea698fa640 1 -- 172.21.15.39:0/3262469131 wait complete. 2024-05-14T14:40:55.554 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-14T14:40:55.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.690+0000 7f497c340640 1 Processor -- start 2024-05-14T14:40:55.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.690+0000 7f497c340640 1 -- start start 2024-05-14T14:40:55.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.692+0000 7f497c340640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f497415cfd0 0x7f49740b63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:55.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.692+0000 7f497c340640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f497406c740 con 0x7f49740cf060 2024-05-14T14:40:55.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.692+0000 7f497c340640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f497406c9e0 con 0x7f49740b68f0 2024-05-14T14:40:55.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.692+0000 7f497c340640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f49740b5980 con 0x7f497415cfd0 2024-05-14T14:40:55.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.692+0000 7f497a0dc640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f49740cf060 0x7f49740cdad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:32994/0 (socket says 172.21.15.39:32994) 2024-05-14T14:40:55.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.692+0000 7f497a0dc640 1 -- 172.21.15.39:0/800827781 learned_addr learned my addr 172.21.15.39:0/800827781 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:55.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.692+0000 7f49798db640 1 --2- 172.21.15.39:0/800827781 >> v2:172.21.15.39:3300/0 conn(0x7f497415cfd0 0x7f49740b63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:55.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.692+0000 7f49798db640 1 -- 172.21.15.39:0/800827781 >> v1:172.21.15.62:6789/0 conn(0x7f49740b68f0 legacy=0x7f49740cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:55.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.692+0000 7f49798db640 1 -- 172.21.15.39:0/800827781 >> v1:172.21.15.39:6789/0 conn(0x7f49740cf060 legacy=0x7f49740cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:55.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.692+0000 7f49798db640 1 -- 172.21.15.39:0/800827781 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49740b5bb0 con 0x7f497415cfd0 2024-05-14T14:40:55.677 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.692+0000 7f49790da640 1 -- 172.21.15.39:0/800827781 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2505031082 0 0) 0x7f497406c740 con 0x7f49740cf060 2024-05-14T14:40:55.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.693+0000 7f49798db640 1 --2- 172.21.15.39:0/800827781 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f497415cfd0 0x7f49740b63b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f49680097a0 tx=0x7f496802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a68e555cfaeb032 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:55.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.693+0000 7f49790da640 1 -- 172.21.15.39:0/800827781 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4968037070 con 0x7f497415cfd0 2024-05-14T14:40:55.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.693+0000 7f49790da640 1 -- 172.21.15.39:0/800827781 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4968032440 con 0x7f497415cfd0 2024-05-14T14:40:55.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.693+0000 7f49790da640 1 -- 172.21.15.39:0/800827781 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4968032810 con 0x7f497415cfd0 2024-05-14T14:40:55.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.694+0000 7f497c340640 1 -- 172.21.15.39:0/800827781 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f497415cfd0 msgr2=0x7f49740b63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:55.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.694+0000 7f497c340640 1 --2- 172.21.15.39:0/800827781 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f497415cfd0 0x7f49740b63b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f49680097a0 tx=0x7f496802a180 comp rx=0 tx=0).stop 2024-05-14T14:40:55.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.694+0000 7f497c340640 1 -- 172.21.15.39:0/800827781 shutdown_connections 2024-05-14T14:40:55.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.694+0000 7f497c340640 1 --2- 172.21.15.39:0/800827781 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f497415cfd0 0x7f49740b63b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:55.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.694+0000 7f497c340640 1 -- 172.21.15.39:0/800827781 >> 172.21.15.39:0/800827781 conn(0x7f49740ce330 msgr2=0x7f49740ce740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:55.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.694+0000 7f497c340640 1 -- 172.21.15.39:0/800827781 shutdown_connections 2024-05-14T14:40:55.679 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.694+0000 7f497c340640 1 -- 172.21.15.39:0/800827781 wait complete. 2024-05-14T14:40:55.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.696+0000 7f497c340640 1 Processor -- start 2024-05-14T14:40:55.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.696+0000 7f497c340640 1 -- start start 2024-05-14T14:40:55.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.697+0000 7f497c340640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f49740b68f0 0x7f49740ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:55.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.697+0000 7f497c340640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49740cf060 0x7f497406cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:55.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.697+0000 7f497c340640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f497415cfd0 0x7f497406d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:55.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.697+0000 7f497c340640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f49740b5f20 con 0x7f497415cfd0 2024-05-14T14:40:55.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.697+0000 7f497c340640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f497406ccc0 con 0x7f49740cf060 2024-05-14T14:40:55.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.697+0000 7f497c340640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f49740cfe80 con 0x7f49740b68f0 2024-05-14T14:40:55.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.697+0000 7f497a8dd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f497415cfd0 0x7f497406d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:55.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.697+0000 7f497a8dd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f497415cfd0 0x7f497406d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36850/0 (socket says 172.21.15.39:36850) 2024-05-14T14:40:55.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.697+0000 7f497a8dd640 1 -- 172.21.15.39:0/1995410219 learned_addr learned my addr 172.21.15.39:0/1995410219 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:55.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.697+0000 7f497a0dc640 1 --2- 172.21.15.39:0/1995410219 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f49740b68f0 0x7f49740ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:55.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.697+0000 7f49798db640 1 --2- 172.21.15.39:0/1995410219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49740cf060 0x7f497406cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:55.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.697+0000 7f497a8dd640 1 -- 172.21.15.39:0/1995410219 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f49740b68f0 msgr2=0x7f49740ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:55.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.697+0000 7f497a8dd640 1 --2- 172.21.15.39:0/1995410219 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f49740b68f0 0x7f49740ccf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:55.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.697+0000 7f497a8dd640 1 -- 172.21.15.39:0/1995410219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49740cf060 msgr2=0x7f497406cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:55.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.697+0000 7f497a8dd640 1 --2- 172.21.15.39:0/1995410219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49740cf060 0x7f497406cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:55.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.697+0000 7f497a8dd640 1 -- 172.21.15.39:0/1995410219 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49740cd450 con 0x7f497415cfd0 2024-05-14T14:40:55.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.698+0000 7f497a8dd640 1 --2- 172.21.15.39:0/1995410219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f497415cfd0 0x7f497406d470 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f496400b9a0 tx=0x7f496400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:55.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.698+0000 7f4972ffd640 1 -- 172.21.15.39:0/1995410219 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4964019070 con 0x7f497415cfd0 2024-05-14T14:40:55.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.698+0000 7f4972ffd640 1 -- 172.21.15.39:0/1995410219 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f496400cba0 con 0x7f497415cfd0 2024-05-14T14:40:55.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.698+0000 7f4972ffd640 1 -- 172.21.15.39:0/1995410219 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4964014440 con 0x7f497415cfd0 2024-05-14T14:40:55.684 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.698+0000 7f497c340640 1 -- 172.21.15.39:0/1995410219 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f497415a4f0 con 0x7f497415cfd0 2024-05-14T14:40:55.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.698+0000 7f497c340640 1 -- 172.21.15.39:0/1995410219 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f497415aab0 con 0x7f497415cfd0 2024-05-14T14:40:55.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.699+0000 7f497c340640 1 -- 172.21.15.39:0/1995410219 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49740d1240 con 0x7f497415cfd0 2024-05-14T14:40:55.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.699+0000 7f4972ffd640 1 -- 172.21.15.39:0/1995410219 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f496401c070 con 0x7f497415cfd0 2024-05-14T14:40:55.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.700+0000 7f4972ffd640 1 --2- 172.21.15.39:0/1995410219 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f49600762d0 0x7f49600787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:55.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.701+0000 7f497a0dc640 1 --2- 172.21.15.39:0/1995410219 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f49600762d0 0x7f49600787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:55.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.701+0000 7f4972ffd640 1 -- 172.21.15.39:0/1995410219 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6180+0+0 (secure 0 0 0) 0x7f49640973e0 con 0x7f497415cfd0 2024-05-14T14:40:55.686 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.701+0000 7f497a0dc640 1 --2- 172.21.15.39:0/1995410219 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f49600762d0 0x7f49600787e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f496c000f60 tx=0x7f496c007c00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:55.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.705+0000 7f4972ffd640 1 -- 172.21.15.39:0/1995410219 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f49740d1240 con 0x7f497415cfd0 2024-05-14T14:40:55.890 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:55.905+0000 7f497c340640 1 -- 172.21.15.39:0/1995410219 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4974076aa0 con 0x7f497415cfd0 2024-05-14T14:40:56.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.554+0000 7f4972ffd640 1 -- 172.21.15.39:0/1995410219 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v27) ==== 169+0+0 (secure 0 0 0) 0x7f4964060b60 con 0x7f497415cfd0 2024-05-14T14:40:56.539 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_data' removed 2024-05-14T14:40:56.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.557+0000 7f497c340640 1 -- 172.21.15.39:0/1995410219 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f49600762d0 msgr2=0x7f49600787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:56.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.557+0000 7f497c340640 1 --2- 172.21.15.39:0/1995410219 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f49600762d0 0x7f49600787e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f496c000f60 tx=0x7f496c007c00 comp rx=0 tx=0).stop 2024-05-14T14:40:56.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.557+0000 7f497c340640 1 -- 172.21.15.39:0/1995410219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f497415cfd0 msgr2=0x7f497406d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:56.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.557+0000 7f497c340640 1 --2- 172.21.15.39:0/1995410219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f497415cfd0 0x7f497406d470 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f496400b9a0 tx=0x7f496400be60 comp rx=0 tx=0).stop 2024-05-14T14:40:56.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.557+0000 7f497c340640 1 -- 172.21.15.39:0/1995410219 shutdown_connections 2024-05-14T14:40:56.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.557+0000 7f497c340640 1 --2- 172.21.15.39:0/1995410219 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f49600762d0 0x7f49600787e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:56.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.557+0000 7f497c340640 1 --2- 172.21.15.39:0/1995410219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f497415cfd0 0x7f497406d470 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:56.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.557+0000 7f497c340640 1 --2- 172.21.15.39:0/1995410219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49740cf060 0x7f497406cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:56.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.557+0000 7f497c340640 1 --2- 172.21.15.39:0/1995410219 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f49740b68f0 0x7f49740ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:56.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.557+0000 7f497c340640 1 -- 172.21.15.39:0/1995410219 >> 172.21.15.39:0/1995410219 conn(0x7f49740ce330 msgr2=0x7f4974071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:56.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.557+0000 7f497c340640 1 -- 172.21.15.39:0/1995410219 shutdown_connections 2024-05-14T14:40:56.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.557+0000 7f497c340640 1 -- 172.21.15.39:0/1995410219 wait complete. 2024-05-14T14:40:56.556 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-05-14T14:40:56.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.693+0000 7f5bc3643640 1 Processor -- start 2024-05-14T14:40:56.678 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.693+0000 7f5bc3643640 1 -- start start 2024-05-14T14:40:56.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.695+0000 7f5bc3643640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5bbc0cf060 0x7f5bbc15cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:56.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.695+0000 7f5bc3643640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5bbc0cdad0 0x7f5bbc0b63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:56.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.695+0000 7f5bc3643640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5bbc0b68f0 0x7f5bbc0cf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:56.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.695+0000 7f5bc3643640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f5bbc0b5980 con 0x7f5bbc0cf060 2024-05-14T14:40:56.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.695+0000 7f5bc3643640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f5bbc06ccc0 con 0x7f5bbc0cdad0 2024-05-14T14:40:56.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.695+0000 7f5bc3643640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f5bbc0b5f20 con 0x7f5bbc0b68f0 2024-05-14T14:40:56.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.695+0000 7f5bc13df640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5bbc0cf060 0x7f5bbc15cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:56.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.695+0000 7f5bc13df640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f5bbc0cf060 0x7f5bbc15cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36858/0 (socket says 172.21.15.39:36858) 2024-05-14T14:40:56.680 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.695+0000 7f5bc13df640 1 -- 172.21.15.39:0/3528797698 learned_addr learned my addr 172.21.15.39:0/3528797698 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:56.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.695+0000 7f5bc1be0640 1 --2- 172.21.15.39:0/3528797698 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5bbc0b68f0 0x7f5bbc0cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:56.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.695+0000 7f5bc0bde640 1 --2- 172.21.15.39:0/3528797698 >> v2:172.21.15.62:3300/0 conn(0x7f5bbc0cdad0 0x7f5bbc0b63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:56.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.695+0000 7f5bc13df640 1 -- 172.21.15.39:0/3528797698 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5bbc0b68f0 msgr2=0x7f5bbc0cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:56.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.695+0000 7f5bc13df640 1 --2- 172.21.15.39:0/3528797698 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5bbc0b68f0 0x7f5bbc0cf770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:56.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.695+0000 7f5bc13df640 1 -- 172.21.15.39:0/3528797698 >> v2:172.21.15.62:3300/0 conn(0x7f5bbc0cdad0 msgr2=0x7f5bbc0b63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:56.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.695+0000 7f5bc13df640 1 --2- 172.21.15.39:0/3528797698 >> v2:172.21.15.62:3300/0 conn(0x7f5bbc0cdad0 0x7f5bbc0b63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:56.681 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.695+0000 7f5bc13df640 1 -- 172.21.15.39:0/3528797698 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bbc06c740 con 0x7f5bbc0cf060 2024-05-14T14:40:56.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.696+0000 7f5bc13df640 1 --2- 172.21.15.39:0/3528797698 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bbc0cf060 0x7f5bbc15cfd0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0b5410 tx=0x7f5bb802e610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ca262e65f8ef657 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:56.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.696+0000 7f5baffff640 1 -- 172.21.15.39:0/3528797698 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb803a070 con 0x7f5bbc0cf060 2024-05-14T14:40:56.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.696+0000 7f5baffff640 1 -- 172.21.15.39:0/3528797698 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bb8033710 con 0x7f5bbc0cf060 2024-05-14T14:40:56.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.696+0000 7f5baffff640 1 -- 172.21.15.39:0/3528797698 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb8033ae0 con 0x7f5bbc0cf060 2024-05-14T14:40:56.682 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.697+0000 7f5bc3643640 1 -- 172.21.15.39:0/3528797698 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bbc0cf060 msgr2=0x7f5bbc15cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:56.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.697+0000 7f5bc3643640 1 --2- 172.21.15.39:0/3528797698 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bbc0cf060 0x7f5bbc15cfd0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0b5410 tx=0x7f5bb802e610 comp rx=0 tx=0).stop 2024-05-14T14:40:56.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.697+0000 7f5bc3643640 1 -- 172.21.15.39:0/3528797698 shutdown_connections 2024-05-14T14:40:56.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.697+0000 7f5bc3643640 1 --2- 172.21.15.39:0/3528797698 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5bbc0b68f0 0x7f5bbc0cf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:56.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.697+0000 7f5bc3643640 1 --2- 172.21.15.39:0/3528797698 >> v2:172.21.15.62:3300/0 conn(0x7f5bbc0cdad0 0x7f5bbc0b63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:56.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.697+0000 7f5bc3643640 1 --2- 172.21.15.39:0/3528797698 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bbc0cf060 0x7f5bbc15cfd0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:56.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.697+0000 7f5bc3643640 1 -- 172.21.15.39:0/3528797698 >> 172.21.15.39:0/3528797698 conn(0x7f5bbc0ce330 msgr2=0x7f5bbc0ce740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:56.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.697+0000 7f5bc3643640 1 -- 172.21.15.39:0/3528797698 shutdown_connections 2024-05-14T14:40:56.683 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.697+0000 7f5bc3643640 1 -- 172.21.15.39:0/3528797698 wait complete. 2024-05-14T14:40:56.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.699+0000 7f5bc3643640 1 Processor -- start 2024-05-14T14:40:56.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.699+0000 7f5bc3643640 1 -- start start 2024-05-14T14:40:56.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.700+0000 7f5bc3643640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5bbc0b68f0 0x7f5bbc154990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:56.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.700+0000 7f5bc3643640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5bbc0cdad0 0x7f5bbc14c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:56.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.700+0000 7f5bc3643640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bbc0cf060 0x7f5bbc160a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:56.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.700+0000 7f5bc3643640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f5bbc0b5bb0 con 0x7f5bbc0cf060 2024-05-14T14:40:56.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.700+0000 7f5bc3643640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f5bbc15d510 con 0x7f5bbc0b68f0 2024-05-14T14:40:56.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.700+0000 7f5bc3643640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f5bbc0cdee0 con 0x7f5bbc0cdad0 2024-05-14T14:40:56.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.700+0000 7f5bc1be0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bbc0cf060 0x7f5bbc160a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:56.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.700+0000 7f5bc1be0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bbc0cf060 0x7f5bbc160a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36860/0 (socket says 172.21.15.39:36860) 2024-05-14T14:40:56.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.700+0000 7f5bc1be0640 1 -- 172.21.15.39:0/4205575417 learned_addr learned my addr 172.21.15.39:0/4205575417 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:56.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.701+0000 7f5bc13df640 1 --2- 172.21.15.39:0/4205575417 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5bbc0b68f0 0x7f5bbc154990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:56.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.701+0000 7f5bc0bde640 1 --2- 172.21.15.39:0/4205575417 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5bbc0cdad0 0x7f5bbc14c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:56.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.701+0000 7f5bc1be0640 1 -- 172.21.15.39:0/4205575417 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5bbc0cdad0 msgr2=0x7f5bbc14c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:56.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.701+0000 7f5bc1be0640 1 --2- 172.21.15.39:0/4205575417 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5bbc0cdad0 0x7f5bbc14c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:56.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.701+0000 7f5bc1be0640 1 -- 172.21.15.39:0/4205575417 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5bbc0b68f0 msgr2=0x7f5bbc154990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:56.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.701+0000 7f5bc1be0640 1 --2- 172.21.15.39:0/4205575417 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5bbc0b68f0 0x7f5bbc154990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:56.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.701+0000 7f5bc1be0640 1 -- 172.21.15.39:0/4205575417 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bbc155370 con 0x7f5bbc0cf060 2024-05-14T14:40:56.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.701+0000 7f5bc1be0640 1 --2- 172.21.15.39:0/4205575417 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bbc0cf060 0x7f5bbc160a80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4007e60 tx=0x7f5bb400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:56.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.701+0000 7f5badffb640 1 -- 172.21.15.39:0/4205575417 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb4014420 con 0x7f5bbc0cf060 2024-05-14T14:40:56.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.701+0000 7f5badffb640 1 -- 172.21.15.39:0/4205575417 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bb4019070 con 0x7f5bbc0cf060 2024-05-14T14:40:56.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.701+0000 7f5bc3643640 1 -- 172.21.15.39:0/4205575417 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bbc155650 con 0x7f5bbc0cf060 2024-05-14T14:40:56.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.701+0000 7f5badffb640 1 -- 172.21.15.39:0/4205575417 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb4014820 con 0x7f5bbc0cf060 2024-05-14T14:40:56.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.701+0000 7f5bc3643640 1 -- 172.21.15.39:0/4205575417 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bbc150670 con 0x7f5bbc0cf060 2024-05-14T14:40:56.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.703+0000 7f5bc3643640 1 -- 172.21.15.39:0/4205575417 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bbc1550e0 con 0x7f5bbc0cf060 2024-05-14T14:40:56.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.703+0000 7f5badffb640 1 -- 172.21.15.39:0/4205575417 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f5bb40149c0 con 0x7f5bbc0cf060 2024-05-14T14:40:56.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.704+0000 7f5badffb640 1 --2- 172.21.15.39:0/4205575417 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f5ba00762d0 0x7f5ba00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:56.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.704+0000 7f5badffb640 1 -- 172.21.15.39:0/4205575417 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5766+0+0 (secure 0 0 0) 0x7f5bb4097db0 con 0x7f5bbc0cf060 2024-05-14T14:40:56.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.704+0000 7f5bc13df640 1 --2- 172.21.15.39:0/4205575417 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f5ba00762d0 0x7f5ba00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:56.690 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.704+0000 7f5bc13df640 1 --2- 172.21.15.39:0/4205575417 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f5ba00762d0 0x7f5ba00787e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5bb8037000 tx=0x7f5bb8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:56.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.709+0000 7f5badffb640 1 -- 172.21.15.39:0/4205575417 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f5bb4060ff0 con 0x7f5bbc0cf060 2024-05-14T14:40:56.889 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:56.905+0000 7f5bc3643640 1 -- 172.21.15.39:0/4205575417 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5bbc076aa0 con 0x7f5bbc0cf060 2024-05-14T14:40:57.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.565+0000 7f5badffb640 1 -- 172.21.15.39:0/4205575417 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v28) ==== 178+0+0 (secure 0 0 0) 0x7f5bb40652f0 con 0x7f5bbc0cf060 2024-05-14T14:40:57.550 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_data_ec' removed 2024-05-14T14:40:57.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.568+0000 7f5bc3643640 1 -- 172.21.15.39:0/4205575417 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f5ba00762d0 msgr2=0x7f5ba00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:57.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.568+0000 7f5bc3643640 1 --2- 172.21.15.39:0/4205575417 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f5ba00762d0 0x7f5ba00787e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5bb8037000 tx=0x7f5bb8008030 comp rx=0 tx=0).stop 2024-05-14T14:40:57.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.568+0000 7f5bc3643640 1 -- 172.21.15.39:0/4205575417 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bbc0cf060 msgr2=0x7f5bbc160a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:57.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.568+0000 7f5bc3643640 1 --2- 172.21.15.39:0/4205575417 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bbc0cf060 0x7f5bbc160a80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4007e60 tx=0x7f5bb400e4b0 comp rx=0 tx=0).stop 2024-05-14T14:40:57.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.568+0000 7f5bc3643640 1 -- 172.21.15.39:0/4205575417 shutdown_connections 2024-05-14T14:40:57.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.568+0000 7f5bc3643640 1 --2- 172.21.15.39:0/4205575417 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f5ba00762d0 0x7f5ba00787e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:57.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.568+0000 7f5bc3643640 1 --2- 172.21.15.39:0/4205575417 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f5bbc0cf060 0x7f5bbc160a80 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:57.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.568+0000 7f5bc3643640 1 --2- 172.21.15.39:0/4205575417 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f5bbc0cdad0 0x7f5bbc14c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:57.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.568+0000 7f5bc3643640 1 --2- 172.21.15.39:0/4205575417 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5bbc0b68f0 0x7f5bbc154990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:57.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.568+0000 7f5bc3643640 1 -- 172.21.15.39:0/4205575417 >> 172.21.15.39:0/4205575417 conn(0x7f5bbc0ce330 msgr2=0x7f5bbc0d0330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:57.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.568+0000 7f5bc3643640 1 -- 172.21.15.39:0/4205575417 shutdown_connections 2024-05-14T14:40:57.554 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.568+0000 7f5bc3643640 1 -- 172.21.15.39:0/4205575417 wait complete. 2024-05-14T14:40:57.568 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-14T14:40:57.568 INFO:tasks.ceph.mds.a:Stopping old one... 2024-05-14T14:40:57.568 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-14T14:40:57.568 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T14:40:57.568 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-14T14:40:57.568 INFO:tasks.ceph.mds.c:Stopping old one... 2024-05-14T14:40:57.568 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-14T14:40:57.569 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T14:40:57.569 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-14T14:40:57.569 INFO:tasks.ceph.mds.b:Stopping old one... 2024-05-14T14:40:57.569 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-14T14:40:57.569 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T14:40:57.569 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-14T14:40:57.569 INFO:tasks.ceph.mds.d:Stopping old one... 2024-05-14T14:40:57.570 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-14T14:40:57.570 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T14:40:57.579 INFO:tasks.ceph.mds.a:Stopped 2024-05-14T14:40:57.580 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-14T14:40:57.580 INFO:tasks.ceph.mds.c:Stopped 2024-05-14T14:40:57.581 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-14T14:40:57.584 INFO:tasks.ceph.mds.d:Stopped 2024-05-14T14:40:57.584 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-14T14:40:57.585 INFO:tasks.ceph.mds.b:Stopped 2024-05-14T14:40:57.585 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-14T14:40:57.622 INFO:tasks.ceph.mds.a:Started 2024-05-14T14:40:57.622 DEBUG:teuthology.parallel:result is None 2024-05-14T14:40:57.623 INFO:tasks.ceph.mds.c:Started 2024-05-14T14:40:57.623 DEBUG:teuthology.parallel:result is None 2024-05-14T14:40:57.627 INFO:tasks.ceph.mds.d:Started 2024-05-14T14:40:57.627 DEBUG:teuthology.parallel:result is None 2024-05-14T14:40:57.628 INFO:tasks.ceph.mds.b:Started 2024-05-14T14:40:57.628 DEBUG:teuthology.parallel:result is None 2024-05-14T14:40:57.629 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-05-14T14:40:57.720 INFO:tasks.ceph.mds.a.smithi039.stdout:starting mds.a at 2024-05-14T14:40:57.720 INFO:tasks.ceph.mds.c.smithi039.stdout:starting mds.c at 2024-05-14T14:40:57.725 INFO:tasks.ceph.mds.d.smithi062.stdout:starting mds.d at 2024-05-14T14:40:57.725 INFO:tasks.ceph.mds.b.smithi062.stdout:starting mds.b at 2024-05-14T14:40:57.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.769+0000 7f076ba05640 1 Processor -- start 2024-05-14T14:40:57.753 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.769+0000 7f076ba05640 1 -- start start 2024-05-14T14:40:57.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.770+0000 7f076ba05640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f07640ce590 0x7f076415e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:57.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.770+0000 7f076ba05640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0764161c20 0x7f07640b6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:57.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.770+0000 7f076ba05640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f07640d0200 0x7f07640d0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:57.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.770+0000 7f076ba05640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f07640d2490 con 0x7f07640ce590 2024-05-14T14:40:57.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.770+0000 7f076ba05640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f07640d2770 con 0x7f07640d0200 2024-05-14T14:40:57.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.770+0000 7f076ba05640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f076415e570 con 0x7f0764161c20 2024-05-14T14:40:57.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.770+0000 7f07697a1640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f07640ce590 0x7f076415e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:57.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.770+0000 7f07697a1640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f07640ce590 0x7f076415e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36892/0 (socket says 172.21.15.39:36892) 2024-05-14T14:40:57.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.770+0000 7f07697a1640 1 -- 172.21.15.39:0/2562420343 learned_addr learned my addr 172.21.15.39:0/2562420343 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:57.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.770+0000 7f0768fa0640 1 --2- 172.21.15.39:0/2562420343 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0764161c20 0x7f07640b6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:57.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.771+0000 7f0769fa2640 1 --2- 172.21.15.39:0/2562420343 >> v2:172.21.15.62:3300/0 conn(0x7f07640d0200 0x7f07640d0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:57.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.771+0000 7f07697a1640 1 -- 172.21.15.39:0/2562420343 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0764161c20 msgr2=0x7f07640b6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:57.756 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.771+0000 7f07697a1640 1 --2- 172.21.15.39:0/2562420343 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0764161c20 0x7f07640b6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:57.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.771+0000 7f07697a1640 1 -- 172.21.15.39:0/2562420343 >> v2:172.21.15.62:3300/0 conn(0x7f07640d0200 msgr2=0x7f07640d0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:57.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.771+0000 7f07697a1640 1 --2- 172.21.15.39:0/2562420343 >> v2:172.21.15.62:3300/0 conn(0x7f07640d0200 0x7f07640d0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:57.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.771+0000 7f07697a1640 1 -- 172.21.15.39:0/2562420343 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07640b7420 con 0x7f07640ce590 2024-05-14T14:40:57.757 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.771+0000 7f0768fa0640 1 --2- 172.21.15.39:0/2562420343 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0764161c20 0x7f07640b6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T14:40:57.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.772+0000 7f07697a1640 1 --2- 172.21.15.39:0/2562420343 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07640ce590 0x7f076415e030 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f07640d1590 tx=0x7f075c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b37e10f1e51f8142 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:57.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.772+0000 7f0763fff640 1 -- 172.21.15.39:0/2562420343 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f075c037070 con 0x7f07640ce590 2024-05-14T14:40:57.758 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.772+0000 7f0763fff640 1 -- 172.21.15.39:0/2562420343 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f075c032440 con 0x7f07640ce590 2024-05-14T14:40:57.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.772+0000 7f0763fff640 1 -- 172.21.15.39:0/2562420343 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f075c032810 con 0x7f07640ce590 2024-05-14T14:40:57.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.772+0000 7f076ba05640 1 -- 172.21.15.39:0/2562420343 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07640ce590 msgr2=0x7f076415e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:57.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.772+0000 7f076ba05640 1 --2- 172.21.15.39:0/2562420343 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07640ce590 0x7f076415e030 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f07640d1590 tx=0x7f075c02a140 comp rx=0 tx=0).stop 2024-05-14T14:40:57.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.773+0000 7f076ba05640 1 -- 172.21.15.39:0/2562420343 shutdown_connections 2024-05-14T14:40:57.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.773+0000 7f076ba05640 1 --2- 172.21.15.39:0/2562420343 >> v2:172.21.15.62:3300/0 conn(0x7f07640d0200 0x7f07640d0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:57.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.773+0000 7f076ba05640 1 --2- 172.21.15.39:0/2562420343 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0764161c20 0x7f07640b6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:57.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.773+0000 7f076ba05640 1 --2- 172.21.15.39:0/2562420343 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f07640ce590 0x7f076415e030 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:57.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.773+0000 7f076ba05640 1 -- 172.21.15.39:0/2562420343 >> 172.21.15.39:0/2562420343 conn(0x7f0764071660 msgr2=0x7f0764071a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:57.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.773+0000 7f076ba05640 1 -- 172.21.15.39:0/2562420343 shutdown_connections 2024-05-14T14:40:57.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.773+0000 7f076ba05640 1 -- 172.21.15.39:0/2562420343 wait complete. 2024-05-14T14:40:57.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.775+0000 7f076ba05640 1 Processor -- start 2024-05-14T14:40:57.760 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.775+0000 7f076ba05640 1 -- start start 2024-05-14T14:40:57.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.776+0000 7f076ba05640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07640ce590 0x7f07640ca780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:57.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.776+0000 7f076ba05640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07640d0200 0x7f07640ccef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:57.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.776+0000 7f076ba05640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0764161c20 0x7f0764160430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:57.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.776+0000 7f076ba05640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f07641629c0 con 0x7f0764161c20 2024-05-14T14:40:57.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.776+0000 7f076ba05640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f07641626e0 con 0x7f07640d0200 2024-05-14T14:40:57.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.776+0000 7f076ba05640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f07640d0b50 con 0x7f07640ce590 2024-05-14T14:40:57.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.776+0000 7f0769fa2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0764161c20 0x7f0764160430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:57.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.777+0000 7f0769fa2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0764161c20 0x7f0764160430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:36906/0 (socket says 172.21.15.39:36906) 2024-05-14T14:40:57.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.777+0000 7f0769fa2640 1 -- 172.21.15.39:0/1154364207 learned_addr learned my addr 172.21.15.39:0/1154364207 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:57.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.777+0000 7f0768fa0640 1 --2- 172.21.15.39:0/1154364207 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07640d0200 0x7f07640ccef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:57.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.777+0000 7f07697a1640 1 --2- 172.21.15.39:0/1154364207 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07640ce590 0x7f07640ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:57.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.777+0000 7f0768fa0640 1 -- 172.21.15.39:0/1154364207 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07640ce590 msgr2=0x7f07640ca780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:57.763 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.777+0000 7f0768fa0640 1 --2- 172.21.15.39:0/1154364207 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07640ce590 0x7f07640ca780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:57.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.777+0000 7f0768fa0640 1 -- 172.21.15.39:0/1154364207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0764161c20 msgr2=0x7f0764160430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:57.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.777+0000 7f0768fa0640 1 --2- 172.21.15.39:0/1154364207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0764161c20 0x7f0764160430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:57.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.777+0000 7f0768fa0640 1 -- 172.21.15.39:0/1154364207 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07641f4500 con 0x7f07640d0200 2024-05-14T14:40:57.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.777+0000 7f0769fa2640 1 --2- 172.21.15.39:0/1154364207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0764161c20 0x7f0764160430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T14:40:57.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.777+0000 7f0768fa0640 1 --2- 172.21.15.39:0/1154364207 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07640d0200 0x7f07640ccef0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f075800e8a0 tx=0x7f075800ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:57.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.777+0000 7f0761ffb640 1 -- 172.21.15.39:0/1154364207 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0758017070 con 0x7f07640d0200 2024-05-14T14:40:57.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.777+0000 7f0761ffb640 1 -- 172.21.15.39:0/1154364207 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f075800c940 con 0x7f07640d0200 2024-05-14T14:40:57.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.777+0000 7f076ba05640 1 -- 172.21.15.39:0/1154364207 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07640cb240 con 0x7f07640d0200 2024-05-14T14:40:57.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.777+0000 7f0761ffb640 1 -- 172.21.15.39:0/1154364207 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f075800cd30 con 0x7f07640d0200 2024-05-14T14:40:57.764 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.778+0000 7f076ba05640 1 -- 172.21.15.39:0/1154364207 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07640cb800 con 0x7f07640d0200 2024-05-14T14:40:57.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.778+0000 7f076ba05640 1 -- 172.21.15.39:0/1154364207 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0764076aa0 con 0x7f07640d0200 2024-05-14T14:40:57.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.779+0000 7f0761ffb640 1 -- 172.21.15.39:0/1154364207 <== mon.1 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f075801a070 con 0x7f07640d0200 2024-05-14T14:40:57.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.780+0000 7f0761ffb640 1 --2- 172.21.15.39:0/1154364207 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f07500762d0 0x7f07500787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:57.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.780+0000 7f0761ffb640 1 -- 172.21.15.39:0/1154364207 <== mon.1 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5335+0+0 (secure 0 0 0) 0x7f07580979f0 con 0x7f07640d0200 2024-05-14T14:40:57.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.780+0000 7f07697a1640 1 --2- 172.21.15.39:0/1154364207 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f07500762d0 0x7f07500787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:57.765 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.781+0000 7f07697a1640 1 --2- 172.21.15.39:0/1154364207 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f07500762d0 0x7f07500787e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f075c034000 tx=0x7f075c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:57.769 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.784+0000 7f0761ffb640 1 -- 172.21.15.39:0/1154364207 <== mon.1 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0758060d40 con 0x7f07640d0200 2024-05-14T14:40:57.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:57.989+0000 7f076ba05640 1 -- 172.21.15.39:0/1154364207 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f07640cd960 con 0x7f07640d0200 2024-05-14T14:40:58.568 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.583+0000 7f0761ffb640 1 -- 172.21.15.39:0/1154364207 <== mon.1 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) ==== 97+0+0 (secure 0 0 0) 0x7f0758065040 con 0x7f07640d0200 2024-05-14T14:40:58.568 INFO:teuthology.orchestra.run.smithi039.stderr: removed all blocklist entries 2024-05-14T14:40:58.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.586+0000 7f076ba05640 1 -- 172.21.15.39:0/1154364207 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f07500762d0 msgr2=0x7f07500787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:58.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.586+0000 7f076ba05640 1 --2- 172.21.15.39:0/1154364207 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f07500762d0 0x7f07500787e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f075c034000 tx=0x7f075c02e000 comp rx=0 tx=0).stop 2024-05-14T14:40:58.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.586+0000 7f076ba05640 1 -- 172.21.15.39:0/1154364207 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07640d0200 msgr2=0x7f07640ccef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:58.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.586+0000 7f076ba05640 1 --2- 172.21.15.39:0/1154364207 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07640d0200 0x7f07640ccef0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f075800e8a0 tx=0x7f075800ed60 comp rx=0 tx=0).stop 2024-05-14T14:40:58.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.586+0000 7f076ba05640 1 -- 172.21.15.39:0/1154364207 shutdown_connections 2024-05-14T14:40:58.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.586+0000 7f076ba05640 1 --2- 172.21.15.39:0/1154364207 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f07500762d0 0x7f07500787e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:58.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.586+0000 7f076ba05640 1 --2- 172.21.15.39:0/1154364207 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0764161c20 0x7f0764160430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:58.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.586+0000 7f076ba05640 1 --2- 172.21.15.39:0/1154364207 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f07640d0200 0x7f07640ccef0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:58.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.586+0000 7f076ba05640 1 --2- 172.21.15.39:0/1154364207 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f07640ce590 0x7f07640ca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:58.571 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.586+0000 7f076ba05640 1 -- 172.21.15.39:0/1154364207 >> 172.21.15.39:0/1154364207 conn(0x7f0764071660 msgr2=0x7f076415e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:58.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.586+0000 7f076ba05640 1 -- 172.21.15.39:0/1154364207 shutdown_connections 2024-05-14T14:40:58.572 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.586+0000 7f076ba05640 1 -- 172.21.15.39:0/1154364207 wait complete. 2024-05-14T14:40:58.585 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-05-14T14:40:58.704 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.719+0000 7f6d66443640 1 Processor -- start 2024-05-14T14:40:58.705 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.719+0000 7f6d66443640 1 -- start start 2024-05-14T14:40:58.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.721+0000 7f6d66443640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6d601602f0 0x7f6d601644b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:58.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.721+0000 7f6d66443640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d600b4fc0 con 0x7f6d600b4820 2024-05-14T14:40:58.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.721+0000 7f6d66443640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d600d4fc0 con 0x7f6d6006cc60 2024-05-14T14:40:58.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.721+0000 7f6d66443640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f6d600b4d70 con 0x7f6d601602f0 2024-05-14T14:40:58.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.721+0000 7f6d5ffff640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f6d600b4820 0x7f6d60163da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:54112/0 (socket says 172.21.15.39:54112) 2024-05-14T14:40:58.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.721+0000 7f6d5ffff640 1 -- 172.21.15.39:0/2139849085 learned_addr learned my addr 172.21.15.39:0/2139849085 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:58.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.721+0000 7f6d5effd640 1 -- 172.21.15.39:0/2139849085 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2767445895 0 0) 0x7f6d600b4fc0 con 0x7f6d600b4820 2024-05-14T14:40:58.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.721+0000 7f6d5effd640 1 -- 172.21.15.39:0/2139849085 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d4c003520 con 0x7f6d600b4820 2024-05-14T14:40:58.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.721+0000 7f6d5f7fe640 1 --2- 172.21.15.39:0/2139849085 >> v2:172.21.15.62:3300/0 conn(0x7f6d601602f0 0x7f6d601644b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:58.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.722+0000 7f6d5effd640 1 -- 172.21.15.39:0/2139849085 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3874748719 0 0) 0x7f6d4c003520 con 0x7f6d600b4820 2024-05-14T14:40:58.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.722+0000 7f6d5effd640 1 -- 172.21.15.39:0/2139849085 >> v2:172.21.15.62:3300/0 conn(0x7f6d601602f0 msgr2=0x7f6d601644b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:58.708 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.722+0000 7f6d5effd640 1 --2- 172.21.15.39:0/2139849085 >> v2:172.21.15.62:3300/0 conn(0x7f6d601602f0 0x7f6d601644b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:58.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.722+0000 7f6d5effd640 1 -- 172.21.15.39:0/2139849085 >> v1:172.21.15.62:6789/0 conn(0x7f6d6006cc60 legacy=0x7f6d6006d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:58.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.722+0000 7f6d5effd640 1 -- 172.21.15.39:0/2139849085 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d600d52a0 con 0x7f6d600b4820 2024-05-14T14:40:58.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.722+0000 7f6d5effd640 1 -- 172.21.15.39:0/2139849085 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1803005051 0 0) 0x7f6d500016f0 con 0x7f6d600b4820 2024-05-14T14:40:58.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.722+0000 7f6d5effd640 1 -- 172.21.15.39:0/2139849085 >> v1:172.21.15.39:6789/0 conn(0x7f6d600b4820 legacy=0x7f6d60163da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:58.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.722+0000 7f6d5effd640 1 --2- 172.21.15.39:0/2139849085 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d4c003a50 0x7f6d4c003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:58.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.722+0000 7f6d5effd640 1 --2- 172.21.15.39:0/2139849085 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d4c004800 0x7f6d4c004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:58.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.722+0000 7f6d5effd640 1 --2- 172.21.15.39:0/2139849085 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d4c005300 0x7f6d4c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:58.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.722+0000 7f6d5effd640 1 -- 172.21.15.39:0/2139849085 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6d600b4d70 con 0x7f6d4c005300 2024-05-14T14:40:58.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.722+0000 7f6d5effd640 1 -- 172.21.15.39:0/2139849085 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6d4c00c2a0 con 0x7f6d4c003a50 2024-05-14T14:40:58.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.722+0000 7f6d5effd640 1 -- 172.21.15.39:0/2139849085 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f6d4c00c4a0 con 0x7f6d4c004800 2024-05-14T14:40:58.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.722+0000 7f6d649e0640 1 --2- 172.21.15.39:0/2139849085 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d4c005300 0x7f6d4c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:58.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.722+0000 7f6d5ffff640 1 --2- 172.21.15.39:0/2139849085 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d4c003a50 0x7f6d4c003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:58.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.722+0000 7f6d5f7fe640 1 --2- 172.21.15.39:0/2139849085 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d4c004800 0x7f6d4c004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:58.709 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.722+0000 7f6d649e0640 1 -- 172.21.15.39:0/2139849085 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d4c004800 msgr2=0x7f6d4c004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:58.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.722+0000 7f6d649e0640 1 --2- 172.21.15.39:0/2139849085 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d4c004800 0x7f6d4c004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:58.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.722+0000 7f6d649e0640 1 -- 172.21.15.39:0/2139849085 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d4c003a50 msgr2=0x7f6d4c003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:58.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.722+0000 7f6d649e0640 1 --2- 172.21.15.39:0/2139849085 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d4c003a50 0x7f6d4c003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:58.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.722+0000 7f6d649e0640 1 -- 172.21.15.39:0/2139849085 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d4c003520 con 0x7f6d4c005300 2024-05-14T14:40:58.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.723+0000 7f6d649e0640 1 -- 172.21.15.39:0/2139849085 reap_dead start 2024-05-14T14:40:58.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.723+0000 7f6d649e0640 1 --2- 172.21.15.39:0/2139849085 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d4c005300 0x7f6d4c00b9c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6d58001e90 tx=0x7f6d4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d2dfc75977bcc1b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:58.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.723+0000 7f6d5effd640 1 -- 172.21.15.39:0/2139849085 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d58001ab0 con 0x7f6d4c005300 2024-05-14T14:40:58.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.723+0000 7f6d5effd640 1 -- 172.21.15.39:0/2139849085 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d5802ae50 con 0x7f6d4c005300 2024-05-14T14:40:58.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.723+0000 7f6d5effd640 1 -- 172.21.15.39:0/2139849085 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d58003bb0 con 0x7f6d4c005300 2024-05-14T14:40:58.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.724+0000 7f6d66443640 1 -- 172.21.15.39:0/2139849085 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d4c005300 msgr2=0x7f6d4c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:58.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.724+0000 7f6d66443640 1 --2- 172.21.15.39:0/2139849085 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d4c005300 0x7f6d4c00b9c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6d58001e90 tx=0x7f6d4c005830 comp rx=0 tx=0).stop 2024-05-14T14:40:58.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.724+0000 7f6d66443640 1 -- 172.21.15.39:0/2139849085 shutdown_connections 2024-05-14T14:40:58.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.724+0000 7f6d66443640 1 --2- 172.21.15.39:0/2139849085 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d4c005300 0x7f6d4c00b9c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:58.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.724+0000 7f6d66443640 1 -- 172.21.15.39:0/2139849085 >> 172.21.15.39:0/2139849085 conn(0x7f6d600d6670 msgr2=0x7f6d600d2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:58.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.724+0000 7f6d66443640 1 -- 172.21.15.39:0/2139849085 shutdown_connections 2024-05-14T14:40:58.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.724+0000 7f6d66443640 1 -- 172.21.15.39:0/2139849085 wait complete. 2024-05-14T14:40:58.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.726+0000 7f6d66443640 1 Processor -- start 2024-05-14T14:40:58.712 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.726+0000 7f6d66443640 1 -- start start 2024-05-14T14:40:58.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.727+0000 7f6d66443640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d4c005300 0x7f6d600cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:58.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.727+0000 7f6d66443640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d600ccd50 0x7f6d6014b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:58.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.727+0000 7f6d66443640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d601f62d0 0x7f6d6014bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:58.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.727+0000 7f6d66443640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f6d60163da0 con 0x7f6d600ccd50 2024-05-14T14:40:58.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.727+0000 7f6d66443640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f6d6006c7d0 con 0x7f6d4c005300 2024-05-14T14:40:58.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.727+0000 7f6d66443640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f6d60163f20 con 0x7f6d601f62d0 2024-05-14T14:40:58.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.727+0000 7f6d5f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d600ccd50 0x7f6d6014b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:58.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.727+0000 7f6d5f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d600ccd50 0x7f6d6014b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48426/0 (socket says 172.21.15.39:48426) 2024-05-14T14:40:58.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.727+0000 7f6d5f7fe640 1 -- 172.21.15.39:0/1689082026 learned_addr learned my addr 172.21.15.39:0/1689082026 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:58.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.728+0000 7f6d5ffff640 1 --2- 172.21.15.39:0/1689082026 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d4c005300 0x7f6d600cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:58.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.728+0000 7f6d649e0640 1 --2- 172.21.15.39:0/1689082026 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d601f62d0 0x7f6d6014bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:58.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.728+0000 7f6d5f7fe640 1 -- 172.21.15.39:0/1689082026 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d601f62d0 msgr2=0x7f6d6014bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:58.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.728+0000 7f6d5f7fe640 1 --2- 172.21.15.39:0/1689082026 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d601f62d0 0x7f6d6014bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:58.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.728+0000 7f6d5f7fe640 1 -- 172.21.15.39:0/1689082026 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d4c005300 msgr2=0x7f6d600cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:58.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.728+0000 7f6d5f7fe640 1 --2- 172.21.15.39:0/1689082026 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d4c005300 0x7f6d600cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:58.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.728+0000 7f6d5f7fe640 1 -- 172.21.15.39:0/1689082026 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d6014c350 con 0x7f6d600ccd50 2024-05-14T14:40:58.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.728+0000 7f6d649e0640 1 --2- 172.21.15.39:0/1689082026 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d601f62d0 0x7f6d6014bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:40:58.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.728+0000 7f6d5f7fe640 1 --2- 172.21.15.39:0/1689082026 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d600ccd50 0x7f6d6014b790 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6d4800b7f0 tx=0x7f6d4800bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:58.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.728+0000 7f6d5cff9640 1 -- 172.21.15.39:0/1689082026 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d48018070 con 0x7f6d600ccd50 2024-05-14T14:40:58.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.728+0000 7f6d5cff9640 1 -- 172.21.15.39:0/1689082026 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d48010830 con 0x7f6d600ccd50 2024-05-14T14:40:58.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.728+0000 7f6d66443640 1 -- 172.21.15.39:0/1689082026 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d600cf8e0 con 0x7f6d600ccd50 2024-05-14T14:40:58.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.728+0000 7f6d5cff9640 1 -- 172.21.15.39:0/1689082026 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d48010c00 con 0x7f6d600ccd50 2024-05-14T14:40:58.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.728+0000 7f6d66443640 1 -- 172.21.15.39:0/1689082026 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d601eae80 con 0x7f6d600ccd50 2024-05-14T14:40:58.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.729+0000 7f6d66443640 1 -- 172.21.15.39:0/1689082026 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d60076aa0 con 0x7f6d600ccd50 2024-05-14T14:40:58.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.730+0000 7f6d5cff9640 1 -- 172.21.15.39:0/1689082026 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f6d4801b070 con 0x7f6d600ccd50 2024-05-14T14:40:58.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.730+0000 7f6d5cff9640 1 --2- 172.21.15.39:0/1689082026 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f6d40076300 0x7f6d40078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:58.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.731+0000 7f6d5cff9640 1 -- 172.21.15.39:0/1689082026 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5249+0+0 (secure 0 0 0) 0x7f6d48097b50 con 0x7f6d600ccd50 2024-05-14T14:40:58.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.731+0000 7f6d5ffff640 1 --2- 172.21.15.39:0/1689082026 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f6d40076300 0x7f6d40078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:58.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.731+0000 7f6d5ffff640 1 --2- 172.21.15.39:0/1689082026 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f6d40076300 0x7f6d40078810 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6d600d2ff0 tx=0x7f6d50009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:58.720 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.735+0000 7f6d5cff9640 1 -- 172.21.15.39:0/1689082026 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f6d48061670 con 0x7f6d600ccd50 2024-05-14T14:40:58.984 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:58.999+0000 7f6d66443640 1 -- 172.21.15.39:0/1689082026 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f6d600b6830 con 0x7f6d600ccd50 2024-05-14T14:40:58.985 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.000+0000 7f6d5cff9640 1 -- 172.21.15.39:0/1689082026 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v5) ==== 80+0+6645 (secure 0 0 0) 0x7f6d48060f70 con 0x7f6d600ccd50 2024-05-14T14:40:58.985 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:40:58.985 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-05-14T14:40:58.985 INFO:teuthology.orchestra.run.smithi039.stdout: "auth_dump": [ 2024-05-14T14:40:58.985 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-14T14:40:58.985 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mds.a", 2024-05-14T14:40:58.985 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQCSd0Nm4a9FMxAApbmS1XfEyR4q6CO6UDG+cw==", 2024-05-14T14:40:58.985 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-05-14T14:40:58.986 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2024-05-14T14:40:58.986 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow *", 2024-05-14T14:40:58.986 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow *", 2024-05-14T14:40:58.986 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-05-14T14:40:58.986 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-14T14:40:58.986 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-14T14:40:58.986 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-14T14:40:58.986 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mds.b", 2024-05-14T14:40:58.986 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQCTd0NmZGVHBRAAg0uPt2eDuXLhfPbeqJYZmg==", 2024-05-14T14:40:58.986 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-05-14T14:40:58.986 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2024-05-14T14:40:58.987 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow *", 2024-05-14T14:40:58.987 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow *", 2024-05-14T14:40:58.987 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-05-14T14:40:58.987 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-14T14:40:58.987 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-14T14:40:58.987 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-14T14:40:58.987 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mds.c", 2024-05-14T14:40:58.987 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQCSd0NmO5cJOxAAb2mw8iod6DV2NbQFmdrSTw==", 2024-05-14T14:40:58.987 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-05-14T14:40:58.987 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2024-05-14T14:40:58.987 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow *", 2024-05-14T14:40:58.987 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow *", 2024-05-14T14:40:58.987 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-05-14T14:40:58.987 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-14T14:40:58.988 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-14T14:40:58.988 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-14T14:40:58.988 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mds.d", 2024-05-14T14:40:58.988 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQCTd0NmZrFTDRAAggDxYQt3mBD/mHPvaZQu8A==", 2024-05-14T14:40:58.988 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-05-14T14:40:58.988 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2024-05-14T14:40:58.988 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow *", 2024-05-14T14:40:58.988 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow *", 2024-05-14T14:40:58.988 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-05-14T14:40:58.988 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-14T14:40:58.988 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-14T14:40:58.988 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-14T14:40:58.988 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.0", 2024-05-14T14:40:58.988 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQCZd0NmrAuUORAA52j0Y3kmqDkQAUqUj8kxuw==", 2024-05-14T14:40:58.988 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-05-14T14:40:58.989 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2024-05-14T14:40:58.989 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2024-05-14T14:40:58.989 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-05-14T14:40:58.989 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-14T14:40:58.989 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-14T14:40:58.989 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-14T14:40:58.989 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.1", 2024-05-14T14:40:58.989 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQCcd0NmgEOsORAAHkw/LYA2JX4jFMI7NJ6zWQ==", 2024-05-14T14:40:58.989 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-05-14T14:40:58.989 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2024-05-14T14:40:58.989 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2024-05-14T14:40:58.989 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-05-14T14:40:58.989 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-14T14:40:58.989 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-14T14:40:58.989 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-14T14:40:58.990 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.2", 2024-05-14T14:40:58.990 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQCfd0NmxtFoOhAAJAdu3pBXuh0zUW5tRhUqrQ==", 2024-05-14T14:40:58.990 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-05-14T14:40:58.990 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2024-05-14T14:40:58.990 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2024-05-14T14:40:58.990 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-05-14T14:40:58.990 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-14T14:40:58.990 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-14T14:40:58.990 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-14T14:40:58.990 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.3", 2024-05-14T14:40:58.990 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQCid0Nm1tLiORAAOauIbA7k+qRs9R2u25XF8w==", 2024-05-14T14:40:58.990 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-05-14T14:40:58.990 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2024-05-14T14:40:58.990 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2024-05-14T14:40:58.991 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-05-14T14:40:58.991 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-14T14:40:58.991 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-14T14:40:58.991 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-14T14:40:58.991 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.4", 2024-05-14T14:40:58.991 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQCpd0NmbBTJAhAA2vLCiFiVDFwvGaY/nTVsUg==", 2024-05-14T14:40:58.991 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-05-14T14:40:58.991 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2024-05-14T14:40:58.991 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2024-05-14T14:40:58.991 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-05-14T14:40:58.991 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-14T14:40:58.991 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-14T14:40:58.991 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-14T14:40:58.991 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.5", 2024-05-14T14:40:58.991 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQCsd0NmIV/hAhAAMoFlzq4YeQtFij1yh1CH+A==", 2024-05-14T14:40:58.992 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-05-14T14:40:58.992 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2024-05-14T14:40:58.992 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2024-05-14T14:40:58.992 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-05-14T14:40:58.992 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-14T14:40:58.992 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-14T14:40:58.992 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-14T14:40:58.992 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.6", 2024-05-14T14:40:58.992 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQCvd0Nm/+r5ARAAb2WnICCWfiys0UC4oFDP+Q==", 2024-05-14T14:40:58.992 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-05-14T14:40:58.992 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2024-05-14T14:40:58.992 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2024-05-14T14:40:58.992 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-05-14T14:40:58.992 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-14T14:40:58.992 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-14T14:40:58.993 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-14T14:40:58.993 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "osd.7", 2024-05-14T14:40:58.993 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQCyd0NmJnsfARAANNJ2L6G1vIQvRpKbJVya6A==", 2024-05-14T14:40:58.993 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-05-14T14:40:58.993 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow profile osd", 2024-05-14T14:40:58.993 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile osd", 2024-05-14T14:40:58.993 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-05-14T14:40:58.993 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-14T14:40:58.993 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-14T14:40:58.993 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-14T14:40:58.993 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.0", 2024-05-14T14:40:58.994 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQCTd0NmL7k5EhAAA1EBx0QBmemnkBYg0scBMA==", 2024-05-14T14:40:58.994 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-05-14T14:40:58.994 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2024-05-14T14:40:58.994 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow r", 2024-05-14T14:40:58.994 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow rw", 2024-05-14T14:40:58.994 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow rwx" 2024-05-14T14:40:58.994 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-14T14:40:58.994 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-14T14:40:58.994 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-14T14:40:58.994 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.1", 2024-05-14T14:40:58.994 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQCTd0NmwtkHGhAA54KfnG/4EZ81C+vby9bcXA==", 2024-05-14T14:40:58.994 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-05-14T14:40:58.994 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2024-05-14T14:40:58.995 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow r", 2024-05-14T14:40:58.995 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow rw", 2024-05-14T14:40:58.995 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow rwx" 2024-05-14T14:40:58.995 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-14T14:40:58.995 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-14T14:40:58.995 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-14T14:40:58.995 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.2", 2024-05-14T14:40:58.995 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQCTd0NmvBkcFhAA0/hU07EBXNgk+88pgFySbg==", 2024-05-14T14:40:58.995 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-05-14T14:40:58.995 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2024-05-14T14:40:58.995 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow r", 2024-05-14T14:40:58.995 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow rw", 2024-05-14T14:40:58.995 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow rwx" 2024-05-14T14:40:58.995 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-14T14:40:58.996 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-14T14:40:58.996 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-14T14:40:58.996 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.3", 2024-05-14T14:40:58.996 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQCTd0NmhwfbHRAAYHuMMMTGhPDN9RDy75Wkqw==", 2024-05-14T14:40:58.996 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-05-14T14:40:58.996 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow", 2024-05-14T14:40:58.996 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow r", 2024-05-14T14:40:58.996 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow rw", 2024-05-14T14:40:58.997 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow rwx" 2024-05-14T14:40:58.997 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-14T14:40:58.997 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-14T14:40:58.997 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-14T14:40:58.997 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.admin", 2024-05-14T14:40:58.997 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A==", 2024-05-14T14:40:58.997 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-05-14T14:40:58.997 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow *", 2024-05-14T14:40:58.997 INFO:teuthology.orchestra.run.smithi039.stdout: "mgr": "allow *", 2024-05-14T14:40:58.997 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow *", 2024-05-14T14:40:58.997 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-05-14T14:40:58.997 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-14T14:40:58.997 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-14T14:40:58.998 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-14T14:40:58.998 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.bootstrap-mds", 2024-05-14T14:40:58.998 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQC4d0NmXC5qCRAAhd4t1shzcSs/gEUYAhqP3w==", 2024-05-14T14:40:58.998 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-05-14T14:40:58.998 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile bootstrap-mds" 2024-05-14T14:40:58.998 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-14T14:40:58.998 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-14T14:40:58.998 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-14T14:40:58.998 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.bootstrap-mgr", 2024-05-14T14:40:58.998 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQC4d0Nm6DZqCRAA5V+4R8fFXwfUFmqiGJ8/fQ==", 2024-05-14T14:40:58.998 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-05-14T14:40:58.998 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile bootstrap-mgr" 2024-05-14T14:40:58.998 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-14T14:40:58.999 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-14T14:40:58.999 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-14T14:40:58.999 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.bootstrap-osd", 2024-05-14T14:40:58.999 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQC4d0Nmcj9qCRAA4yuh/vYLtDqKeux1hS5f0Q==", 2024-05-14T14:40:58.999 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-05-14T14:40:58.999 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile bootstrap-osd" 2024-05-14T14:40:58.999 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-14T14:40:58.999 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-14T14:40:58.999 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-14T14:40:58.999 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.bootstrap-rbd", 2024-05-14T14:40:58.999 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQC4d0Nm8kZqCRAA3fn/xI3ffd+bV0HhwWwdcw==", 2024-05-14T14:40:58.999 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-05-14T14:40:59.000 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile bootstrap-rbd" 2024-05-14T14:40:59.000 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-14T14:40:59.000 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-14T14:40:59.000 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-14T14:40:59.000 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-05-14T14:40:59.000 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQC4d0NmqU5qCRAAR7tc/Gq01+yzdznfn9h60g==", 2024-05-14T14:40:59.000 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-05-14T14:40:59.000 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-05-14T14:40:59.000 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-14T14:40:59.000 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-14T14:40:59.000 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-14T14:40:59.000 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "client.bootstrap-rgw", 2024-05-14T14:40:59.000 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQC4d0NmelZqCRAAg3nuLmy1LPSNH+TlMykILA==", 2024-05-14T14:40:59.000 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-05-14T14:40:59.000 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile bootstrap-rgw" 2024-05-14T14:40:59.001 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-14T14:40:59.001 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-14T14:40:59.001 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-14T14:40:59.001 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mgr.x", 2024-05-14T14:40:59.001 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQCSd0NmjEFVLxAA/dcONNAHSobwjkRZKBDwOA==", 2024-05-14T14:40:59.001 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-05-14T14:40:59.001 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow *", 2024-05-14T14:40:59.001 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile mgr", 2024-05-14T14:40:59.001 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-05-14T14:40:59.001 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-14T14:40:59.001 INFO:teuthology.orchestra.run.smithi039.stdout: }, 2024-05-14T14:40:59.002 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-14T14:40:59.002 INFO:teuthology.orchestra.run.smithi039.stdout: "entity": "mgr.y", 2024-05-14T14:40:59.002 INFO:teuthology.orchestra.run.smithi039.stdout: "key": "AQCSd0Nmmy8TKhAAo6Ta4NrmDXm+h/bmI+LHTg==", 2024-05-14T14:40:59.002 INFO:teuthology.orchestra.run.smithi039.stdout: "caps": { 2024-05-14T14:40:59.002 INFO:teuthology.orchestra.run.smithi039.stdout: "mds": "allow *", 2024-05-14T14:40:59.002 INFO:teuthology.orchestra.run.smithi039.stdout: "mon": "allow profile mgr", 2024-05-14T14:40:59.002 INFO:teuthology.orchestra.run.smithi039.stdout: "osd": "allow *" 2024-05-14T14:40:59.002 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-14T14:40:59.002 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-14T14:40:59.002 INFO:teuthology.orchestra.run.smithi039.stdout: ] 2024-05-14T14:40:59.002 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-05-14T14:40:59.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.002+0000 7f6d66443640 1 -- 172.21.15.39:0/1689082026 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f6d40076300 msgr2=0x7f6d40078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:59.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.002+0000 7f6d66443640 1 --2- 172.21.15.39:0/1689082026 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f6d40076300 0x7f6d40078810 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6d600d2ff0 tx=0x7f6d50009040 comp rx=0 tx=0).stop 2024-05-14T14:40:59.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.002+0000 7f6d66443640 1 -- 172.21.15.39:0/1689082026 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d600ccd50 msgr2=0x7f6d6014b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:59.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.002+0000 7f6d66443640 1 --2- 172.21.15.39:0/1689082026 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d600ccd50 0x7f6d6014b790 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6d4800b7f0 tx=0x7f6d4800bcb0 comp rx=0 tx=0).stop 2024-05-14T14:40:59.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.002+0000 7f6d66443640 1 -- 172.21.15.39:0/1689082026 shutdown_connections 2024-05-14T14:40:59.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.002+0000 7f6d66443640 1 --2- 172.21.15.39:0/1689082026 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f6d40076300 0x7f6d40078810 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:59.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.002+0000 7f6d66443640 1 --2- 172.21.15.39:0/1689082026 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f6d601f62d0 0x7f6d6014bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:59.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.002+0000 7f6d66443640 1 --2- 172.21.15.39:0/1689082026 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f6d600ccd50 0x7f6d6014b790 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:59.004 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.002+0000 7f6d66443640 1 --2- 172.21.15.39:0/1689082026 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6d4c005300 0x7f6d600cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:59.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.002+0000 7f6d66443640 1 -- 172.21.15.39:0/1689082026 >> 172.21.15.39:0/1689082026 conn(0x7f6d600d6670 msgr2=0x7f6d600b59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:59.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.002+0000 7f6d66443640 1 -- 172.21.15.39:0/1689082026 shutdown_connections 2024-05-14T14:40:59.005 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.002+0000 7f6d66443640 1 -- 172.21.15.39:0/1689082026 wait complete. 2024-05-14T14:40:59.005 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-05-14T14:40:59.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.136+0000 7f0e983dd640 1 Processor -- start 2024-05-14T14:40:59.121 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.136+0000 7f0e983dd640 1 -- start start 2024-05-14T14:40:59.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.138+0000 7f0e983dd640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0e90160470 0x7f0e900ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:59.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.138+0000 7f0e983dd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0e900b5560 0x7f0e900b5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:59.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.138+0000 7f0e983dd640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e900b5eb0 con 0x7f0e9006e3f0 2024-05-14T14:40:59.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.138+0000 7f0e983dd640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f0e90164670 con 0x7f0e90160470 2024-05-14T14:40:59.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.138+0000 7f0e983dd640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f0e90164950 con 0x7f0e900b5560 2024-05-14T14:40:59.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.138+0000 7f0e96179640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0e90160470 0x7f0e900ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:59.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.138+0000 7f0e96179640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f0e90160470 0x7f0e900ce680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48440/0 (socket says 172.21.15.39:48440) 2024-05-14T14:40:59.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.138+0000 7f0e96179640 1 -- 172.21.15.39:0/1514104641 learned_addr learned my addr 172.21.15.39:0/1514104641 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:59.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.138+0000 7f0e96179640 1 -- 172.21.15.39:0/1514104641 >> v2:172.21.15.62:3300/0 conn(0x7f0e900b5560 msgr2=0x7f0e900b5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:59.124 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.138+0000 7f0e9697a640 1 --2- 172.21.15.39:0/1514104641 >> v2:172.21.15.62:3300/0 conn(0x7f0e900b5560 0x7f0e900b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:59.124 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.138+0000 7f0e96179640 1 --2- 172.21.15.39:0/1514104641 >> v2:172.21.15.62:3300/0 conn(0x7f0e900b5560 0x7f0e900b5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:59.124 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.138+0000 7f0e96179640 1 -- 172.21.15.39:0/1514104641 >> v1:172.21.15.62:6789/0 conn(0x7f0e9006e3f0 legacy=0x7f0e90163eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:59.124 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.138+0000 7f0e96179640 1 -- 172.21.15.39:0/1514104641 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e90164c30 con 0x7f0e90160470 2024-05-14T14:40:59.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.139+0000 7f0e96179640 1 --2- 172.21.15.39:0/1514104641 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0e90160470 0x7f0e900ce680 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0e9006e1c0 tx=0x7f0e8002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a2245a2d78d97f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:59.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.139+0000 7f0e95177640 1 -- 172.21.15.39:0/1514104641 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e80036070 con 0x7f0e90160470 2024-05-14T14:40:59.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.139+0000 7f0e95177640 1 -- 172.21.15.39:0/1514104641 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e80031600 con 0x7f0e90160470 2024-05-14T14:40:59.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.139+0000 7f0e95177640 1 -- 172.21.15.39:0/1514104641 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e800319d0 con 0x7f0e90160470 2024-05-14T14:40:59.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.140+0000 7f0e983dd640 1 -- 172.21.15.39:0/1514104641 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0e90160470 msgr2=0x7f0e900ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:59.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.140+0000 7f0e983dd640 1 --2- 172.21.15.39:0/1514104641 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0e90160470 0x7f0e900ce680 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0e9006e1c0 tx=0x7f0e8002a6a0 comp rx=0 tx=0).stop 2024-05-14T14:40:59.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.140+0000 7f0e983dd640 1 -- 172.21.15.39:0/1514104641 shutdown_connections 2024-05-14T14:40:59.125 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.140+0000 7f0e983dd640 1 --2- 172.21.15.39:0/1514104641 >> v2:172.21.15.62:3300/0 conn(0x7f0e900b5560 0x7f0e900b5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:59.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.140+0000 7f0e983dd640 1 --2- 172.21.15.39:0/1514104641 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0e90160470 0x7f0e900ce680 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:59.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.140+0000 7f0e983dd640 1 -- 172.21.15.39:0/1514104641 >> 172.21.15.39:0/1514104641 conn(0x7f0e900d0740 msgr2=0x7f0e900d0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:59.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.140+0000 7f0e983dd640 1 -- 172.21.15.39:0/1514104641 shutdown_connections 2024-05-14T14:40:59.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.140+0000 7f0e983dd640 1 -- 172.21.15.39:0/1514104641 wait complete. 2024-05-14T14:40:59.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.142+0000 7f0e983dd640 1 Processor -- start 2024-05-14T14:40:59.126 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.142+0000 7f0e983dd640 1 -- start start 2024-05-14T14:40:59.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.143+0000 7f0e983dd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e9006e3f0 0x7f0e900b8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:59.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.143+0000 7f0e983dd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e900b5560 0x7f0e900cc460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:59.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.143+0000 7f0e983dd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0e90160470 0x7f0e900cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:59.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.143+0000 7f0e983dd640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f0e900d2a40 con 0x7f0e90160470 2024-05-14T14:40:59.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.143+0000 7f0e983dd640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9006e800 con 0x7f0e900b5560 2024-05-14T14:40:59.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.143+0000 7f0e983dd640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f0e900d2bc0 con 0x7f0e9006e3f0 2024-05-14T14:40:59.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.143+0000 7f0e9697a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0e90160470 0x7f0e900cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:59.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.143+0000 7f0e9697a640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0e90160470 0x7f0e900cc9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48456/0 (socket says 172.21.15.39:48456) 2024-05-14T14:40:59.131 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.143+0000 7f0e9697a640 1 -- 172.21.15.39:0/1692521153 learned_addr learned my addr 172.21.15.39:0/1692521153 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:59.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.143+0000 7f0e96179640 1 --2- 172.21.15.39:0/1692521153 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e9006e3f0 0x7f0e900b8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:59.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.143+0000 7f0e95978640 1 --2- 172.21.15.39:0/1692521153 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e900b5560 0x7f0e900cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:59.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.144+0000 7f0e9697a640 1 -- 172.21.15.39:0/1692521153 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e9006e3f0 msgr2=0x7f0e900b8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:59.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.144+0000 7f0e9697a640 1 --2- 172.21.15.39:0/1692521153 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e9006e3f0 0x7f0e900b8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:59.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.144+0000 7f0e9697a640 1 -- 172.21.15.39:0/1692521153 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e900b5560 msgr2=0x7f0e900cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:59.132 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.144+0000 7f0e9697a640 1 --2- 172.21.15.39:0/1692521153 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e900b5560 0x7f0e900cc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:59.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.144+0000 7f0e9697a640 1 -- 172.21.15.39:0/1692521153 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e900cae70 con 0x7f0e90160470 2024-05-14T14:40:59.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.144+0000 7f0e9697a640 1 --2- 172.21.15.39:0/1692521153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0e90160470 0x7f0e900cc9a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0e8800c540 tx=0x7f0e8800ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:59.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.144+0000 7f0e8effd640 1 -- 172.21.15.39:0/1692521153 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e88015070 con 0x7f0e90160470 2024-05-14T14:40:59.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.144+0000 7f0e8effd640 1 -- 172.21.15.39:0/1692521153 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e88004240 con 0x7f0e90160470 2024-05-14T14:40:59.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.144+0000 7f0e983dd640 1 -- 172.21.15.39:0/1692521153 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e900cb150 con 0x7f0e90160470 2024-05-14T14:40:59.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.144+0000 7f0e8effd640 1 -- 172.21.15.39:0/1692521153 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e88003610 con 0x7f0e90160470 2024-05-14T14:40:59.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.144+0000 7f0e983dd640 1 -- 172.21.15.39:0/1692521153 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e900cb710 con 0x7f0e90160470 2024-05-14T14:40:59.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.145+0000 7f0e983dd640 1 -- 172.21.15.39:0/1692521153 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e90069040 con 0x7f0e90160470 2024-05-14T14:40:59.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.146+0000 7f0e8effd640 1 -- 172.21.15.39:0/1692521153 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f0e880037b0 con 0x7f0e90160470 2024-05-14T14:40:59.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.147+0000 7f0e8effd640 1 --2- 172.21.15.39:0/1692521153 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0e7c076300 0x7f0e7c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:59.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.147+0000 7f0e8effd640 1 -- 172.21.15.39:0/1692521153 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5249+0+0 (secure 0 0 0) 0x7f0e88097130 con 0x7f0e90160470 2024-05-14T14:40:59.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.147+0000 7f0e96179640 1 --2- 172.21.15.39:0/1692521153 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0e7c076300 0x7f0e7c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:59.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.147+0000 7f0e96179640 1 --2- 172.21.15.39:0/1692521153 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0e7c076300 0x7f0e7c078810 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0e80033000 tx=0x7f0e80009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:59.137 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.151+0000 7f0e8effd640 1 -- 172.21.15.39:0/1692521153 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f0e90069040 con 0x7f0e90160470 2024-05-14T14:40:59.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.419+0000 7f0e983dd640 1 -- 172.21.15.39:0/1692521153 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f0e90076aa0 con 0x7f0e90160470 2024-05-14T14:40:59.406 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.422+0000 7f0e8effd640 1 -- 172.21.15.39:0/1692521153 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f0e88060570 con 0x7f0e90160470 2024-05-14T14:40:59.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.425+0000 7f0e983dd640 1 -- 172.21.15.39:0/1692521153 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0e7c076300 msgr2=0x7f0e7c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:59.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.425+0000 7f0e983dd640 1 --2- 172.21.15.39:0/1692521153 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0e7c076300 0x7f0e7c078810 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0e80033000 tx=0x7f0e80009000 comp rx=0 tx=0).stop 2024-05-14T14:40:59.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.425+0000 7f0e983dd640 1 -- 172.21.15.39:0/1692521153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0e90160470 msgr2=0x7f0e900cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:59.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.425+0000 7f0e983dd640 1 --2- 172.21.15.39:0/1692521153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0e90160470 0x7f0e900cc9a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0e8800c540 tx=0x7f0e8800ca00 comp rx=0 tx=0).stop 2024-05-14T14:40:59.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.425+0000 7f0e983dd640 1 -- 172.21.15.39:0/1692521153 shutdown_connections 2024-05-14T14:40:59.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.425+0000 7f0e983dd640 1 --2- 172.21.15.39:0/1692521153 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0e7c076300 0x7f0e7c078810 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:59.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.425+0000 7f0e983dd640 1 --2- 172.21.15.39:0/1692521153 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0e90160470 0x7f0e900cc9a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:59.410 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.425+0000 7f0e983dd640 1 --2- 172.21.15.39:0/1692521153 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0e900b5560 0x7f0e900cc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:59.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.425+0000 7f0e983dd640 1 --2- 172.21.15.39:0/1692521153 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0e9006e3f0 0x7f0e900b8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:59.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.425+0000 7f0e983dd640 1 -- 172.21.15.39:0/1692521153 >> 172.21.15.39:0/1692521153 conn(0x7f0e900d0740 msgr2=0x7f0e900b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:59.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.425+0000 7f0e983dd640 1 -- 172.21.15.39:0/1692521153 shutdown_connections 2024-05-14T14:40:59.411 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.425+0000 7f0e983dd640 1 -- 172.21.15.39:0/1692521153 wait complete. 2024-05-14T14:40:59.421 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-05-14T14:40:59.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.553+0000 7f96963eb640 1 Processor -- start 2024-05-14T14:40:59.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.553+0000 7f96963eb640 1 -- start start 2024-05-14T14:40:59.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.554+0000 7f96963eb640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f96900ce470 0x7f969015e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:59.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.554+0000 7f96963eb640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96900ce970 con 0x7f96900b6e90 2024-05-14T14:40:59.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.554+0000 7f96963eb640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96900cec50 con 0x7f96900d0870 2024-05-14T14:40:59.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.554+0000 7f96963eb640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f96900d24b0 con 0x7f96900ce470 2024-05-14T14:40:59.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.554+0000 7f968f7fe640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f96900b6e90 0x7f96900d0160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:54124/0 (socket says 172.21.15.39:54124) 2024-05-14T14:40:59.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.554+0000 7f968f7fe640 1 -- 172.21.15.39:0/114829031 learned_addr learned my addr 172.21.15.39:0/114829031 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:40:59.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.555+0000 7f968effd640 1 -- 172.21.15.39:0/114829031 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3800149413 0 0) 0x7f96900ce970 con 0x7f96900b6e90 2024-05-14T14:40:59.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.555+0000 7f968effd640 1 -- 172.21.15.39:0/114829031 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9678003520 con 0x7f96900b6e90 2024-05-14T14:40:59.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.555+0000 7f968ffff640 1 --2- 172.21.15.39:0/114829031 >> v2:172.21.15.62:3300/0 conn(0x7f96900ce470 0x7f969015e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:59.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.555+0000 7f968effd640 1 -- 172.21.15.39:0/114829031 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1292497462 0 0) 0x7f9678003520 con 0x7f96900b6e90 2024-05-14T14:40:59.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.555+0000 7f968effd640 1 -- 172.21.15.39:0/114829031 >> v2:172.21.15.62:3300/0 conn(0x7f96900ce470 msgr2=0x7f969015e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:59.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.555+0000 7f968effd640 1 --2- 172.21.15.39:0/114829031 >> v2:172.21.15.62:3300/0 conn(0x7f96900ce470 0x7f969015e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:59.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.555+0000 7f968effd640 1 -- 172.21.15.39:0/114829031 >> v1:172.21.15.62:6789/0 conn(0x7f96900d0870 legacy=0x7f96900d2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:59.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.555+0000 7f968effd640 1 -- 172.21.15.39:0/114829031 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96900cef30 con 0x7f96900b6e90 2024-05-14T14:40:59.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.555+0000 7f968effd640 1 -- 172.21.15.39:0/114829031 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1803005051 0 0) 0x7f96840016f0 con 0x7f96900b6e90 2024-05-14T14:40:59.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.555+0000 7f968effd640 1 -- 172.21.15.39:0/114829031 >> v1:172.21.15.39:6789/0 conn(0x7f96900b6e90 legacy=0x7f96900d0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:59.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.555+0000 7f968effd640 1 --2- 172.21.15.39:0/114829031 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9678003a50 0x7f9678003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:59.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.555+0000 7f968effd640 1 --2- 172.21.15.39:0/114829031 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9678004800 0x7f9678004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:59.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.555+0000 7f968effd640 1 --2- 172.21.15.39:0/114829031 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9678005350 0x7f967800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:59.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.555+0000 7f968effd640 1 -- 172.21.15.39:0/114829031 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f96900d24b0 con 0x7f9678004800 2024-05-14T14:40:59.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.555+0000 7f968effd640 1 -- 172.21.15.39:0/114829031 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f967800c280 con 0x7f9678003a50 2024-05-14T14:40:59.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.555+0000 7f968effd640 1 -- 172.21.15.39:0/114829031 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f967800c480 con 0x7f9678005350 2024-05-14T14:40:59.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.555+0000 7f968f7fe640 1 --2- 172.21.15.39:0/114829031 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9678004800 0x7f9678004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:59.546 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.555+0000 7f968ffff640 1 --2- 172.21.15.39:0/114829031 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9678003a50 0x7f9678003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:59.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.555+0000 7f9694988640 1 --2- 172.21.15.39:0/114829031 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9678005350 0x7f967800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:59.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.555+0000 7f968f7fe640 1 -- 172.21.15.39:0/114829031 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9678005350 msgr2=0x7f967800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:59.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.555+0000 7f968f7fe640 1 --2- 172.21.15.39:0/114829031 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9678005350 0x7f967800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:59.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.555+0000 7f968f7fe640 1 -- 172.21.15.39:0/114829031 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9678003a50 msgr2=0x7f9678003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:59.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.555+0000 7f968f7fe640 1 --2- 172.21.15.39:0/114829031 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9678003a50 0x7f9678003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:59.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.555+0000 7f968f7fe640 1 -- 172.21.15.39:0/114829031 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9678003520 con 0x7f9678004800 2024-05-14T14:40:59.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.555+0000 7f9694988640 1 --2- 172.21.15.39:0/114829031 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9678005350 0x7f967800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:40:59.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.555+0000 7f9694988640 1 -- 172.21.15.39:0/114829031 reap_dead start 2024-05-14T14:40:59.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.556+0000 7f968f7fe640 1 --2- 172.21.15.39:0/114829031 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9678004800 0x7f9678004c10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f968400c210 tx=0x7f9678005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=763d1dd073ee114c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:59.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.556+0000 7f968effd640 1 -- 172.21.15.39:0/114829031 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9684007d30 con 0x7f9678004800 2024-05-14T14:40:59.547 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.556+0000 7f968effd640 1 -- 172.21.15.39:0/114829031 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9684005af0 con 0x7f9678004800 2024-05-14T14:40:59.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.556+0000 7f968effd640 1 -- 172.21.15.39:0/114829031 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9684007070 con 0x7f9678004800 2024-05-14T14:40:59.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.557+0000 7f96963eb640 1 -- 172.21.15.39:0/114829031 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9678004800 msgr2=0x7f9678004c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:59.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.557+0000 7f96963eb640 1 --2- 172.21.15.39:0/114829031 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9678004800 0x7f9678004c10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f968400c210 tx=0x7f9678005830 comp rx=0 tx=0).stop 2024-05-14T14:40:59.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.557+0000 7f96963eb640 1 -- 172.21.15.39:0/114829031 shutdown_connections 2024-05-14T14:40:59.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.557+0000 7f96963eb640 1 --2- 172.21.15.39:0/114829031 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9678004800 0x7f9678004c10 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:59.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.557+0000 7f96963eb640 1 -- 172.21.15.39:0/114829031 >> 172.21.15.39:0/114829031 conn(0x7f9690071660 msgr2=0x7f9690071a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:59.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.557+0000 7f96963eb640 1 -- 172.21.15.39:0/114829031 shutdown_connections 2024-05-14T14:40:59.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.557+0000 7f96963eb640 1 -- 172.21.15.39:0/114829031 wait complete. 2024-05-14T14:40:59.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.559+0000 7f96963eb640 1 Processor -- start 2024-05-14T14:40:59.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.559+0000 7f96963eb640 1 -- start start 2024-05-14T14:40:59.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.560+0000 7f96963eb640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9678004800 0x7f96901f9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:59.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.560+0000 7f96963eb640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96901f6680 0x7f969006fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:59.551 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.560+0000 7f96963eb640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f969015a720 0x7f969015ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:59.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.560+0000 7f96963eb640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f96900d0f20 con 0x7f96901f6680 2024-05-14T14:40:59.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.560+0000 7f96963eb640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f96900d0da0 con 0x7f9678004800 2024-05-14T14:40:59.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.560+0000 7f96963eb640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f9690161c50 con 0x7f969015a720 2024-05-14T14:40:59.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.561+0000 7f968f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96901f6680 0x7f969006fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:59.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.561+0000 7f968f7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96901f6680 0x7f969006fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48486/0 (socket says 172.21.15.39:48486) 2024-05-14T14:40:59.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.561+0000 7f968f7fe640 1 -- 172.21.15.39:0/832416092 learned_addr learned my addr 172.21.15.39:0/832416092 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:59.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.561+0000 7f9694988640 1 --2- 172.21.15.39:0/832416092 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f969015a720 0x7f969015ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:59.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.561+0000 7f968ffff640 1 --2- 172.21.15.39:0/832416092 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9678004800 0x7f96901f9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:59.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.561+0000 7f968f7fe640 1 -- 172.21.15.39:0/832416092 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f969015a720 msgr2=0x7f969015ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:59.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.561+0000 7f968f7fe640 1 --2- 172.21.15.39:0/832416092 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f969015a720 0x7f969015ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:59.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.561+0000 7f968f7fe640 1 -- 172.21.15.39:0/832416092 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9678004800 msgr2=0x7f96901f9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:59.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.561+0000 7f968f7fe640 1 --2- 172.21.15.39:0/832416092 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9678004800 0x7f96901f9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:59.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.561+0000 7f968f7fe640 1 -- 172.21.15.39:0/832416092 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f969015b070 con 0x7f96901f6680 2024-05-14T14:40:59.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.561+0000 7f9694988640 1 --2- 172.21.15.39:0/832416092 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f969015a720 0x7f969015ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:40:59.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.561+0000 7f968f7fe640 1 --2- 172.21.15.39:0/832416092 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96901f6680 0x7f969006fa90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f968402ad70 tx=0x7f96900ceb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:59.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.561+0000 7f968cff9640 1 -- 172.21.15.39:0/832416092 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96840016b0 con 0x7f96901f6680 2024-05-14T14:40:59.552 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.561+0000 7f968cff9640 1 -- 172.21.15.39:0/832416092 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9684042070 con 0x7f96901f6680 2024-05-14T14:40:59.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.561+0000 7f96963eb640 1 -- 172.21.15.39:0/832416092 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f969015f440 con 0x7f96901f6680 2024-05-14T14:40:59.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.561+0000 7f968cff9640 1 -- 172.21.15.39:0/832416092 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9684007270 con 0x7f96901f6680 2024-05-14T14:40:59.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.561+0000 7f96963eb640 1 -- 172.21.15.39:0/832416092 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f969015fa00 con 0x7f96901f6680 2024-05-14T14:40:59.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.563+0000 7f96963eb640 1 -- 172.21.15.39:0/832416092 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9690076aa0 con 0x7f96901f6680 2024-05-14T14:40:59.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.563+0000 7f968cff9640 1 -- 172.21.15.39:0/832416092 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f9684007410 con 0x7f96901f6680 2024-05-14T14:40:59.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.564+0000 7f968cff9640 1 --2- 172.21.15.39:0/832416092 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f967c0762d0 0x7f967c0787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:59.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.564+0000 7f968cff9640 1 -- 172.21.15.39:0/832416092 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5249+0+0 (secure 0 0 0) 0x7f96840b74a0 con 0x7f96901f6680 2024-05-14T14:40:59.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.564+0000 7f968ffff640 1 --2- 172.21.15.39:0/832416092 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f967c0762d0 0x7f967c0787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:59.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.564+0000 7f968ffff640 1 --2- 172.21.15.39:0/832416092 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f967c0762d0 0x7f967c0787e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9680009b80 tx=0x7f9680008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:59.553 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.568+0000 7f968cff9640 1 -- 172.21.15.39:0/832416092 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f969015b070 con 0x7f96901f6680 2024-05-14T14:40:59.821 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.836+0000 7f96963eb640 1 -- 172.21.15.39:0/832416092 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f969015f1d0 con 0x7f96901f6680 2024-05-14T14:40:59.824 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.840+0000 7f968cff9640 1 -- 172.21.15.39:0/832416092 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f9684080f30 con 0x7f96901f6680 2024-05-14T14:40:59.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.842+0000 7f96963eb640 1 -- 172.21.15.39:0/832416092 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f967c0762d0 msgr2=0x7f967c0787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:59.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.842+0000 7f96963eb640 1 --2- 172.21.15.39:0/832416092 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f967c0762d0 0x7f967c0787e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9680009b80 tx=0x7f9680008040 comp rx=0 tx=0).stop 2024-05-14T14:40:59.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.842+0000 7f96963eb640 1 -- 172.21.15.39:0/832416092 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96901f6680 msgr2=0x7f969006fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:59.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.842+0000 7f96963eb640 1 --2- 172.21.15.39:0/832416092 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96901f6680 0x7f969006fa90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f968402ad70 tx=0x7f96900ceb40 comp rx=0 tx=0).stop 2024-05-14T14:40:59.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.842+0000 7f96963eb640 1 -- 172.21.15.39:0/832416092 shutdown_connections 2024-05-14T14:40:59.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.842+0000 7f96963eb640 1 --2- 172.21.15.39:0/832416092 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f967c0762d0 0x7f967c0787e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:59.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.842+0000 7f96963eb640 1 --2- 172.21.15.39:0/832416092 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f969015a720 0x7f969015ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:59.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.842+0000 7f96963eb640 1 --2- 172.21.15.39:0/832416092 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f96901f6680 0x7f969006fa90 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:59.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.842+0000 7f96963eb640 1 --2- 172.21.15.39:0/832416092 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9678004800 0x7f96901f9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:59.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.842+0000 7f96963eb640 1 -- 172.21.15.39:0/832416092 >> 172.21.15.39:0/832416092 conn(0x7f9690071660 msgr2=0x7f969015a010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:59.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.842+0000 7f96963eb640 1 -- 172.21.15.39:0/832416092 shutdown_connections 2024-05-14T14:40:59.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.842+0000 7f96963eb640 1 -- 172.21.15.39:0/832416092 wait complete. 2024-05-14T14:40:59.839 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-05-14T14:40:59.955 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.970+0000 7febd6243640 1 Processor -- start 2024-05-14T14:40:59.956 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.970+0000 7febd6243640 1 -- start start 2024-05-14T14:40:59.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.972+0000 7febd6243640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7febd0160470 0x7febd00ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:59.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.972+0000 7febd6243640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7febd006e3f0 0x7febd0163eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:59.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.972+0000 7febd6243640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7febd00b5560 0x7febd00b5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:59.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.972+0000 7febd6243640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7febd01643f0 con 0x7febd00b5560 2024-05-14T14:40:59.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.972+0000 7febd6243640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7febd00b5eb0 con 0x7febd006e3f0 2024-05-14T14:40:59.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.972+0000 7febd6243640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7febd0164670 con 0x7febd0160470 2024-05-14T14:40:59.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.972+0000 7febcffff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7febd00b5560 0x7febd00b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:59.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.972+0000 7febcffff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7febd00b5560 0x7febd00b5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48490/0 (socket says 172.21.15.39:48490) 2024-05-14T14:40:59.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.972+0000 7febcffff640 1 -- 172.21.15.39:0/2052429287 learned_addr learned my addr 172.21.15.39:0/2052429287 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:59.957 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.972+0000 7febcf7fe640 1 --2- 172.21.15.39:0/2052429287 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7febd0160470 0x7febd00ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:59.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.972+0000 7febceffd640 1 --2- 172.21.15.39:0/2052429287 >> v2:172.21.15.62:3300/0 conn(0x7febd006e3f0 0x7febd0163eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:59.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.972+0000 7febcffff640 1 -- 172.21.15.39:0/2052429287 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7febd0160470 msgr2=0x7febd00ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:59.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.972+0000 7febcffff640 1 --2- 172.21.15.39:0/2052429287 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7febd0160470 0x7febd00ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:59.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.972+0000 7febcffff640 1 -- 172.21.15.39:0/2052429287 >> v2:172.21.15.62:3300/0 conn(0x7febd006e3f0 msgr2=0x7febd0163eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:40:59.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.972+0000 7febcffff640 1 --2- 172.21.15.39:0/2052429287 >> v2:172.21.15.62:3300/0 conn(0x7febd006e3f0 0x7febd0163eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:59.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.972+0000 7febcffff640 1 -- 172.21.15.39:0/2052429287 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febd0164950 con 0x7febd00b5560 2024-05-14T14:40:59.958 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.972+0000 7febceffd640 1 --2- 172.21.15.39:0/2052429287 >> v2:172.21.15.62:3300/0 conn(0x7febd006e3f0 0x7febd0163eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:40:59.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.973+0000 7febcffff640 1 --2- 172.21.15.39:0/2052429287 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7febd00b5560 0x7febd00b5970 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7febd008ce80 tx=0x7febc802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f6207795c4ef6f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:59.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.973+0000 7febce7fc640 1 -- 172.21.15.39:0/2052429287 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc8037070 con 0x7febd00b5560 2024-05-14T14:40:59.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.973+0000 7febce7fc640 1 -- 172.21.15.39:0/2052429287 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febc8032440 con 0x7febd00b5560 2024-05-14T14:40:59.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.973+0000 7febce7fc640 1 -- 172.21.15.39:0/2052429287 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc8032810 con 0x7febd00b5560 2024-05-14T14:40:59.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.974+0000 7febd6243640 1 -- 172.21.15.39:0/2052429287 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7febd00b5560 msgr2=0x7febd00b5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:59.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.974+0000 7febd6243640 1 --2- 172.21.15.39:0/2052429287 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7febd00b5560 0x7febd00b5970 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7febd008ce80 tx=0x7febc802a1e0 comp rx=0 tx=0).stop 2024-05-14T14:40:59.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.974+0000 7febd6243640 1 -- 172.21.15.39:0/2052429287 shutdown_connections 2024-05-14T14:40:59.959 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.974+0000 7febd6243640 1 --2- 172.21.15.39:0/2052429287 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7febd00b5560 0x7febd00b5970 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:59.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.974+0000 7febd6243640 1 --2- 172.21.15.39:0/2052429287 >> v2:172.21.15.62:3300/0 conn(0x7febd006e3f0 0x7febd0163eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:59.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.974+0000 7febd6243640 1 --2- 172.21.15.39:0/2052429287 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7febd0160470 0x7febd00ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:59.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.974+0000 7febd6243640 1 -- 172.21.15.39:0/2052429287 >> 172.21.15.39:0/2052429287 conn(0x7febd00d0740 msgr2=0x7febd00d0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:40:59.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.974+0000 7febd6243640 1 -- 172.21.15.39:0/2052429287 shutdown_connections 2024-05-14T14:40:59.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.974+0000 7febd6243640 1 -- 172.21.15.39:0/2052429287 wait complete. 2024-05-14T14:40:59.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.976+0000 7febd6243640 1 Processor -- start 2024-05-14T14:40:59.960 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.976+0000 7febd6243640 1 -- start start 2024-05-14T14:40:59.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.977+0000 7febd6243640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7febd006e3f0 0x7febd01628c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:59.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.977+0000 7febd6243640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febd00b5560 0x7febd015a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:59.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.977+0000 7febd6243640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7febd0160470 0x7febd00cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:59.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.977+0000 7febd6243640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7febd006e800 con 0x7febd0160470 2024-05-14T14:40:59.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.977+0000 7febd6243640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7febd00d2520 con 0x7febd00b5560 2024-05-14T14:40:59.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.977+0000 7febd6243640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7febd00d2a40 con 0x7febd006e3f0 2024-05-14T14:40:59.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.977+0000 7febcffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7febd0160470 0x7febd00cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:59.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.977+0000 7febcffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7febd0160470 0x7febd00cbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48502/0 (socket says 172.21.15.39:48502) 2024-05-14T14:40:59.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.977+0000 7febcffff640 1 -- 172.21.15.39:0/804230014 learned_addr learned my addr 172.21.15.39:0/804230014 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:40:59.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.977+0000 7febceffd640 1 --2- 172.21.15.39:0/804230014 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febd00b5560 0x7febd015a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:59.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.977+0000 7febcf7fe640 1 --2- 172.21.15.39:0/804230014 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7febd006e3f0 0x7febd01628c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:59.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.978+0000 7febcffff640 1 -- 172.21.15.39:0/804230014 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7febd006e3f0 msgr2=0x7febd01628c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:59.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.978+0000 7febcffff640 1 --2- 172.21.15.39:0/804230014 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7febd006e3f0 0x7febd01628c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:59.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.978+0000 7febcffff640 1 -- 172.21.15.39:0/804230014 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febd00b5560 msgr2=0x7febd015a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:40:59.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.978+0000 7febcffff640 1 --2- 172.21.15.39:0/804230014 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febd00b5560 0x7febd015a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:40:59.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.978+0000 7febcffff640 1 -- 172.21.15.39:0/804230014 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febd0162e00 con 0x7febd0160470 2024-05-14T14:40:59.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.978+0000 7febcffff640 1 --2- 172.21.15.39:0/804230014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7febd0160470 0x7febd00cbd10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7febc80090b0 tx=0x7febc80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:59.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.978+0000 7febb7fff640 1 -- 172.21.15.39:0/804230014 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc8041020 con 0x7febd0160470 2024-05-14T14:40:59.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.978+0000 7febb7fff640 1 -- 172.21.15.39:0/804230014 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febc80306c0 con 0x7febd0160470 2024-05-14T14:40:59.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.978+0000 7febd6243640 1 -- 172.21.15.39:0/804230014 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febd0163750 con 0x7febd0160470 2024-05-14T14:40:59.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.978+0000 7febb7fff640 1 -- 172.21.15.39:0/804230014 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febc8037040 con 0x7febd0160470 2024-05-14T14:40:59.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.978+0000 7febd6243640 1 -- 172.21.15.39:0/804230014 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febd0161de0 con 0x7febd0160470 2024-05-14T14:40:59.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.979+0000 7febd6243640 1 -- 172.21.15.39:0/804230014 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febd0076aa0 con 0x7febd0160470 2024-05-14T14:40:59.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.980+0000 7febb7fff640 1 -- 172.21.15.39:0/804230014 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7febc8044020 con 0x7febd0160470 2024-05-14T14:40:59.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.980+0000 7febb7fff640 1 --2- 172.21.15.39:0/804230014 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7febbc076300 0x7febbc078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:40:59.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.981+0000 7febcf7fe640 1 --2- 172.21.15.39:0/804230014 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7febbc076300 0x7febbc078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:40:59.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.981+0000 7febb7fff640 1 -- 172.21.15.39:0/804230014 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5249+0+0 (secure 0 0 0) 0x7febc80b7bf0 con 0x7febd0160470 2024-05-14T14:40:59.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.981+0000 7febcf7fe640 1 --2- 172.21.15.39:0/804230014 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7febbc076300 0x7febbc078810 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7febc00039e0 tx=0x7febc0009830 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:40:59.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:40:59.985+0000 7febb7fff640 1 -- 172.21.15.39:0/804230014 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7febc804b030 con 0x7febd0160470 2024-05-14T14:41:00.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.253+0000 7febd6243640 1 -- 172.21.15.39:0/804230014 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7febd00b45b0 con 0x7febd0160470 2024-05-14T14:41:00.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.257+0000 7febb7fff640 1 -- 172.21.15.39:0/804230014 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7febc8080fb0 con 0x7febd0160470 2024-05-14T14:41:00.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.259+0000 7febd6243640 1 -- 172.21.15.39:0/804230014 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7febbc076300 msgr2=0x7febbc078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:00.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.259+0000 7febd6243640 1 --2- 172.21.15.39:0/804230014 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7febbc076300 0x7febbc078810 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7febc00039e0 tx=0x7febc0009830 comp rx=0 tx=0).stop 2024-05-14T14:41:00.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.259+0000 7febd6243640 1 -- 172.21.15.39:0/804230014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7febd0160470 msgr2=0x7febd00cbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:00.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.259+0000 7febd6243640 1 --2- 172.21.15.39:0/804230014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7febd0160470 0x7febd00cbd10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7febc80090b0 tx=0x7febc80046c0 comp rx=0 tx=0).stop 2024-05-14T14:41:00.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.259+0000 7febd6243640 1 -- 172.21.15.39:0/804230014 shutdown_connections 2024-05-14T14:41:00.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.259+0000 7febd6243640 1 --2- 172.21.15.39:0/804230014 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7febbc076300 0x7febbc078810 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:00.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.259+0000 7febd6243640 1 --2- 172.21.15.39:0/804230014 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7febd0160470 0x7febd00cbd10 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:00.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.259+0000 7febd6243640 1 --2- 172.21.15.39:0/804230014 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febd00b5560 0x7febd015a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:00.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.259+0000 7febd6243640 1 --2- 172.21.15.39:0/804230014 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7febd006e3f0 0x7febd01628c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:00.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.259+0000 7febd6243640 1 -- 172.21.15.39:0/804230014 >> 172.21.15.39:0/804230014 conn(0x7febd00d0740 msgr2=0x7febd00b3ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:00.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.259+0000 7febd6243640 1 -- 172.21.15.39:0/804230014 shutdown_connections 2024-05-14T14:41:00.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.260+0000 7febd6243640 1 -- 172.21.15.39:0/804230014 wait complete. 2024-05-14T14:41:00.255 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-05-14T14:41:00.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.387+0000 7f4863ca8640 1 Processor -- start 2024-05-14T14:41:00.372 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.387+0000 7f4863ca8640 1 -- start start 2024-05-14T14:41:00.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.389+0000 7f4863ca8640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f485c163d40 0x7f485c0b5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:00.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.389+0000 7f4863ca8640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f485c0d1540 0x7f485c0d0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:00.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.389+0000 7f4863ca8640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f485c0d12d0 con 0x7f485c0d0ec0 2024-05-14T14:41:00.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.389+0000 7f4863ca8640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f485c0d4a20 con 0x7f485c163d40 2024-05-14T14:41:00.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.389+0000 7f4863ca8640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f485c0d4d00 con 0x7f485c0d1540 2024-05-14T14:41:00.374 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.389+0000 7f4862245640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f485c0d0ec0 0x7f485c06c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:54132/0 (socket says 172.21.15.39:54132) 2024-05-14T14:41:00.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.389+0000 7f4862245640 1 -- 172.21.15.39:0/557646484 learned_addr learned my addr 172.21.15.39:0/557646484 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:41:00.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.389+0000 7f4861243640 1 --2- 172.21.15.39:0/557646484 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f485c0d1540 0x7f485c0d0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:00.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.389+0000 7f4861a44640 1 --2- 172.21.15.39:0/557646484 >> v2:172.21.15.62:3300/0 conn(0x7f485c163d40 0x7f485c0b5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:00.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.389+0000 7f4860a42640 1 -- 172.21.15.39:0/557646484 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4041693863 0 0) 0x7f4854001490 con 0x7f485c0d0ec0 2024-05-14T14:41:00.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.389+0000 7f4860a42640 1 -- 172.21.15.39:0/557646484 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4848003520 con 0x7f485c0d0ec0 2024-05-14T14:41:00.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.389+0000 7f4861243640 1 -- 172.21.15.39:0/557646484 >> v2:172.21.15.62:3300/0 conn(0x7f485c163d40 msgr2=0x7f485c0b5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:00.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.389+0000 7f4861243640 1 --2- 172.21.15.39:0/557646484 >> v2:172.21.15.62:3300/0 conn(0x7f485c163d40 0x7f485c0b5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:00.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.389+0000 7f4861243640 1 -- 172.21.15.39:0/557646484 >> v1:172.21.15.39:6789/0 conn(0x7f485c0d0ec0 legacy=0x7f485c06c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:00.375 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.389+0000 7f4861243640 1 -- 172.21.15.39:0/557646484 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f485c0d4fe0 con 0x7f485c0d1540 2024-05-14T14:41:00.376 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.390+0000 7f4861243640 1 --2- 172.21.15.39:0/557646484 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f485c0d1540 0x7f485c0d0980 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f484c0097a0 tx=0x7f484c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=910ffb519c3bba66 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:00.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.390+0000 7f4860a42640 1 -- 172.21.15.39:0/557646484 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484c037070 con 0x7f485c0d1540 2024-05-14T14:41:00.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.390+0000 7f4860a42640 1 -- 172.21.15.39:0/557646484 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f484c032440 con 0x7f485c0d1540 2024-05-14T14:41:00.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.390+0000 7f4860a42640 1 -- 172.21.15.39:0/557646484 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484c0327f0 con 0x7f485c0d1540 2024-05-14T14:41:00.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.391+0000 7f4863ca8640 1 -- 172.21.15.39:0/557646484 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f485c0d1540 msgr2=0x7f485c0d0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:00.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.391+0000 7f4863ca8640 1 --2- 172.21.15.39:0/557646484 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f485c0d1540 0x7f485c0d0980 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f484c0097a0 tx=0x7f484c02a180 comp rx=0 tx=0).stop 2024-05-14T14:41:00.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.391+0000 7f4863ca8640 1 -- 172.21.15.39:0/557646484 shutdown_connections 2024-05-14T14:41:00.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.391+0000 7f4863ca8640 1 --2- 172.21.15.39:0/557646484 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f485c0d1540 0x7f485c0d0980 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:00.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.391+0000 7f4863ca8640 1 --2- 172.21.15.39:0/557646484 >> v2:172.21.15.62:3300/0 conn(0x7f485c163d40 0x7f485c0b5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:00.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.391+0000 7f4863ca8640 1 -- 172.21.15.39:0/557646484 >> 172.21.15.39:0/557646484 conn(0x7f485c0d2d40 msgr2=0x7f485c0d5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:00.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.391+0000 7f4863ca8640 1 -- 172.21.15.39:0/557646484 shutdown_connections 2024-05-14T14:41:00.377 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.391+0000 7f4863ca8640 1 -- 172.21.15.39:0/557646484 wait complete. 2024-05-14T14:41:00.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.393+0000 7f4863ca8640 1 Processor -- start 2024-05-14T14:41:00.378 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.393+0000 7f4863ca8640 1 -- start start 2024-05-14T14:41:00.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.394+0000 7f4863ca8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f485c0d0ec0 0x7f485c14f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:00.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.394+0000 7f4863ca8640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f485c0d1540 0x7f485c1eabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:00.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.394+0000 7f4863ca8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f485c163d40 0x7f485c1eb130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:00.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.394+0000 7f4863ca8640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f485c0d45d0 con 0x7f485c163d40 2024-05-14T14:41:00.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.394+0000 7f4863ca8640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f485c0d55a0 con 0x7f485c0d0ec0 2024-05-14T14:41:00.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.394+0000 7f4863ca8640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f485c0d4750 con 0x7f485c0d1540 2024-05-14T14:41:00.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.394+0000 7f4862245640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f485c163d40 0x7f485c1eb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:00.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.394+0000 7f4862245640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f485c163d40 0x7f485c1eb130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48516/0 (socket says 172.21.15.39:48516) 2024-05-14T14:41:00.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.394+0000 7f4862245640 1 -- 172.21.15.39:0/4181003516 learned_addr learned my addr 172.21.15.39:0/4181003516 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:41:00.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.395+0000 7f4861a44640 1 --2- 172.21.15.39:0/4181003516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f485c0d0ec0 0x7f485c14f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:00.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.395+0000 7f4861243640 1 --2- 172.21.15.39:0/4181003516 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f485c0d1540 0x7f485c1eabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:00.381 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.395+0000 7f4862245640 1 -- 172.21.15.39:0/4181003516 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f485c0d1540 msgr2=0x7f485c1eabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:00.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.395+0000 7f4862245640 1 --2- 172.21.15.39:0/4181003516 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f485c0d1540 0x7f485c1eabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:00.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.395+0000 7f4862245640 1 -- 172.21.15.39:0/4181003516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f485c0d0ec0 msgr2=0x7f485c14f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:00.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.395+0000 7f4862245640 1 --2- 172.21.15.39:0/4181003516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f485c0d0ec0 0x7f485c14f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:00.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.395+0000 7f4862245640 1 -- 172.21.15.39:0/4181003516 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f485c14f5d0 con 0x7f485c163d40 2024-05-14T14:41:00.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.395+0000 7f4862245640 1 --2- 172.21.15.39:0/4181003516 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f485c163d40 0x7f485c1eb130 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f485400caa0 tx=0x7f485400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:00.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.395+0000 7f48527fc640 1 -- 172.21.15.39:0/4181003516 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485400ac00 con 0x7f485c163d40 2024-05-14T14:41:00.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.395+0000 7f48527fc640 1 -- 172.21.15.39:0/4181003516 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f485400ada0 con 0x7f485c163d40 2024-05-14T14:41:00.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.395+0000 7f4863ca8640 1 -- 172.21.15.39:0/4181003516 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f485c0ccb10 con 0x7f485c163d40 2024-05-14T14:41:00.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.395+0000 7f48527fc640 1 -- 172.21.15.39:0/4181003516 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4854012620 con 0x7f485c163d40 2024-05-14T14:41:00.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.395+0000 7f4863ca8640 1 -- 172.21.15.39:0/4181003516 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f485c0ca0a0 con 0x7f485c163d40 2024-05-14T14:41:00.382 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.396+0000 7f4863ca8640 1 -- 172.21.15.39:0/4181003516 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f485c076aa0 con 0x7f485c163d40 2024-05-14T14:41:00.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.397+0000 7f48527fc640 1 -- 172.21.15.39:0/4181003516 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f48540127c0 con 0x7f485c163d40 2024-05-14T14:41:00.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.397+0000 7f48527fc640 1 --2- 172.21.15.39:0/4181003516 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4840076300 0x7f4840078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:00.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.398+0000 7f48527fc640 1 -- 172.21.15.39:0/4181003516 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5249+0+0 (secure 0 0 0) 0x7f4854097ae0 con 0x7f485c163d40 2024-05-14T14:41:00.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.398+0000 7f4861a44640 1 --2- 172.21.15.39:0/4181003516 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4840076300 0x7f4840078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:00.383 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.398+0000 7f4861a44640 1 --2- 172.21.15.39:0/4181003516 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4840076300 0x7f4840078810 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f485c0c9400 tx=0x7f4858008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:00.387 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.402+0000 7f48527fc640 1 -- 172.21.15.39:0/4181003516 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f485c14f5d0 con 0x7f485c163d40 2024-05-14T14:41:00.653 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.668+0000 7f4863ca8640 1 -- 172.21.15.39:0/4181003516 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f485c0d40f0 con 0x7f485c163d40 2024-05-14T14:41:00.656 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.672+0000 7f48527fc640 1 -- 172.21.15.39:0/4181003516 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7f485c0d12d0 con 0x7f485c163d40 2024-05-14T14:41:00.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.674+0000 7f4863ca8640 1 -- 172.21.15.39:0/4181003516 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4840076300 msgr2=0x7f4840078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:00.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.674+0000 7f4863ca8640 1 --2- 172.21.15.39:0/4181003516 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4840076300 0x7f4840078810 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f485c0c9400 tx=0x7f4858008040 comp rx=0 tx=0).stop 2024-05-14T14:41:00.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.674+0000 7f4863ca8640 1 -- 172.21.15.39:0/4181003516 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f485c163d40 msgr2=0x7f485c1eb130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:00.659 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.674+0000 7f4863ca8640 1 --2- 172.21.15.39:0/4181003516 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f485c163d40 0x7f485c1eb130 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f485400caa0 tx=0x7f485400cf60 comp rx=0 tx=0).stop 2024-05-14T14:41:00.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.674+0000 7f4863ca8640 1 -- 172.21.15.39:0/4181003516 shutdown_connections 2024-05-14T14:41:00.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.674+0000 7f4863ca8640 1 --2- 172.21.15.39:0/4181003516 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4840076300 0x7f4840078810 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:00.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.674+0000 7f4863ca8640 1 --2- 172.21.15.39:0/4181003516 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f485c163d40 0x7f485c1eb130 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:00.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.674+0000 7f4863ca8640 1 --2- 172.21.15.39:0/4181003516 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f485c0d1540 0x7f485c1eabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:00.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.674+0000 7f4863ca8640 1 --2- 172.21.15.39:0/4181003516 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f485c0d0ec0 0x7f485c14f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:00.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.674+0000 7f4863ca8640 1 -- 172.21.15.39:0/4181003516 >> 172.21.15.39:0/4181003516 conn(0x7f485c0d2d40 msgr2=0x7f485c0b5680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:00.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.674+0000 7f4863ca8640 1 -- 172.21.15.39:0/4181003516 shutdown_connections 2024-05-14T14:41:00.660 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.674+0000 7f4863ca8640 1 -- 172.21.15.39:0/4181003516 wait complete. 2024-05-14T14:41:00.670 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-05-14T14:41:00.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.802+0000 7f4fe5db4640 1 Processor -- start 2024-05-14T14:41:00.787 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.802+0000 7f4fe5db4640 1 -- start start 2024-05-14T14:41:00.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.803+0000 7f4fe5db4640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4fe00d4690 0x7f4fe006c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:00.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.803+0000 7f4fe5db4640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4fe00d11b0 0x7f4fe01602a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:00.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.803+0000 7f4fe5db4640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fe006cda0 con 0x7f4fe006de40 2024-05-14T14:41:00.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.803+0000 7f4fe5db4640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f4fe006d9b0 con 0x7f4fe00d4690 2024-05-14T14:41:00.791 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.803+0000 7f4fe5db4640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f4fe006d080 con 0x7f4fe00d11b0 2024-05-14T14:41:00.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.804+0000 7f4fdffff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4fe00d11b0 0x7f4fe01602a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:00.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.804+0000 7f4fdf7fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4fe00d4690 0x7f4fe006c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:00.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.804+0000 7f4fdffff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4fe00d11b0 0x7f4fe01602a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.39:47894/0 (socket says 172.21.15.39:47894) 2024-05-14T14:41:00.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.804+0000 7f4fdffff640 1 -- 172.21.15.39:0/3386079769 learned_addr learned my addr 172.21.15.39:0/3386079769 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:41:00.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.804+0000 7f4fdf7fe640 1 -- 172.21.15.39:0/3386079769 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4fe00d11b0 msgr2=0x7f4fe01602a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:00.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.804+0000 7f4fdf7fe640 1 --2- 172.21.15.39:0/3386079769 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4fe00d11b0 0x7f4fe01602a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:00.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.804+0000 7f4fdf7fe640 1 -- 172.21.15.39:0/3386079769 >> v1:172.21.15.62:6789/0 conn(0x7f4fe006de40 legacy=0x7f4fe00d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:00.792 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.804+0000 7f4fdf7fe640 1 -- 172.21.15.39:0/3386079769 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fe006d360 con 0x7f4fe00d4690 2024-05-14T14:41:00.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.804+0000 7f4fdffff640 1 --2- 172.21.15.39:0/3386079769 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4fe00d11b0 0x7f4fe01602a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T14:41:00.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.805+0000 7f4fdf7fe640 1 --2- 172.21.15.39:0/3386079769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4fe00d4690 0x7f4fe006c6a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4fd00097a0 tx=0x7f4fd002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f24edc44658683fc server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:00.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.805+0000 7f4fde7fc640 1 -- 172.21.15.39:0/3386079769 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd0037070 con 0x7f4fe00d4690 2024-05-14T14:41:00.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.805+0000 7f4fde7fc640 1 -- 172.21.15.39:0/3386079769 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fd0032440 con 0x7f4fe00d4690 2024-05-14T14:41:00.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.805+0000 7f4fde7fc640 1 -- 172.21.15.39:0/3386079769 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd0032810 con 0x7f4fe00d4690 2024-05-14T14:41:00.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.806+0000 7f4fe5db4640 1 -- 172.21.15.39:0/3386079769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4fe00d4690 msgr2=0x7f4fe006c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:00.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.806+0000 7f4fe5db4640 1 --2- 172.21.15.39:0/3386079769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4fe00d4690 0x7f4fe006c6a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4fd00097a0 tx=0x7f4fd002a180 comp rx=0 tx=0).stop 2024-05-14T14:41:00.793 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.806+0000 7f4fe5db4640 1 -- 172.21.15.39:0/3386079769 shutdown_connections 2024-05-14T14:41:00.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.806+0000 7f4fe5db4640 1 --2- 172.21.15.39:0/3386079769 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4fe00d11b0 0x7f4fe01602a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:00.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.806+0000 7f4fe5db4640 1 --2- 172.21.15.39:0/3386079769 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4fe00d4690 0x7f4fe006c6a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:00.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.806+0000 7f4fe5db4640 1 -- 172.21.15.39:0/3386079769 >> 172.21.15.39:0/3386079769 conn(0x7f4fe00d28c0 msgr2=0x7f4fe00d2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:00.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.806+0000 7f4fe5db4640 1 -- 172.21.15.39:0/3386079769 shutdown_connections 2024-05-14T14:41:00.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.806+0000 7f4fe5db4640 1 -- 172.21.15.39:0/3386079769 wait complete. 2024-05-14T14:41:00.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.808+0000 7f4fe5db4640 1 Processor -- start 2024-05-14T14:41:00.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.808+0000 7f4fe5db4640 1 -- start start 2024-05-14T14:41:00.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.809+0000 7f4fe5db4640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4fe006de40 0x7f4fe015ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:00.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.809+0000 7f4fe5db4640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4fe00d4690 0x7f4fe00c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:00.798 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.809+0000 7f4fe5db4640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4fe0154160 0x7f4fe0146120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:00.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.809+0000 7f4fe5db4640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe00b9220 con 0x7f4fe0154160 2024-05-14T14:41:00.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.809+0000 7f4fe5db4640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe00d17f0 con 0x7f4fe00d4690 2024-05-14T14:41:00.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.809+0000 7f4fe5db4640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f4fe00b93a0 con 0x7f4fe006de40 2024-05-14T14:41:00.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.809+0000 7f4fdffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4fe0154160 0x7f4fe0146120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:00.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.809+0000 7f4fdffff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4fe0154160 0x7f4fe0146120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48528/0 (socket says 172.21.15.39:48528) 2024-05-14T14:41:00.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.809+0000 7f4fdffff640 1 -- 172.21.15.39:0/3852927681 learned_addr learned my addr 172.21.15.39:0/3852927681 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:41:00.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.810+0000 7f4fdf7fe640 1 --2- 172.21.15.39:0/3852927681 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4fe006de40 0x7f4fe015ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:00.799 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.810+0000 7f4fdeffd640 1 --2- 172.21.15.39:0/3852927681 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4fe00d4690 0x7f4fe00c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:00.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.810+0000 7f4fdffff640 1 -- 172.21.15.39:0/3852927681 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4fe006de40 msgr2=0x7f4fe015ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:00.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.810+0000 7f4fdffff640 1 --2- 172.21.15.39:0/3852927681 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4fe006de40 0x7f4fe015ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:00.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.810+0000 7f4fdffff640 1 -- 172.21.15.39:0/3852927681 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4fe00d4690 msgr2=0x7f4fe00c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:00.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.810+0000 7f4fdffff640 1 --2- 172.21.15.39:0/3852927681 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4fe00d4690 0x7f4fe00c7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:00.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.810+0000 7f4fdffff640 1 -- 172.21.15.39:0/3852927681 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fe01442e0 con 0x7f4fe0154160 2024-05-14T14:41:00.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.810+0000 7f4fdffff640 1 --2- 172.21.15.39:0/3852927681 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4fe0154160 0x7f4fe0146120 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8009e70 tx=0x7f4fd800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:00.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.810+0000 7f4fc7fff640 1 -- 172.21.15.39:0/3852927681 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd800cbe0 con 0x7f4fe0154160 2024-05-14T14:41:00.800 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.810+0000 7f4fc7fff640 1 -- 172.21.15.39:0/3852927681 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fd800cd80 con 0x7f4fe0154160 2024-05-14T14:41:00.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.810+0000 7f4fc7fff640 1 -- 172.21.15.39:0/3852927681 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd8003bb0 con 0x7f4fe0154160 2024-05-14T14:41:00.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.810+0000 7f4fe5db4640 1 -- 172.21.15.39:0/3852927681 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fe01445c0 con 0x7f4fe0154160 2024-05-14T14:41:00.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.810+0000 7f4fe5db4640 1 -- 172.21.15.39:0/3852927681 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fe0144b80 con 0x7f4fe0154160 2024-05-14T14:41:00.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.811+0000 7f4fe5db4640 1 -- 172.21.15.39:0/3852927681 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fe0076aa0 con 0x7f4fe0154160 2024-05-14T14:41:00.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.812+0000 7f4fc7fff640 1 -- 172.21.15.39:0/3852927681 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4fd801b030 con 0x7f4fe0154160 2024-05-14T14:41:00.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.812+0000 7f4fc7fff640 1 --2- 172.21.15.39:0/3852927681 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4fcc076300 0x7f4fcc078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:00.801 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.812+0000 7f4fc7fff640 1 -- 172.21.15.39:0/3852927681 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5249+0+0 (secure 0 0 0) 0x7f4fd8097730 con 0x7f4fe0154160 2024-05-14T14:41:00.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.813+0000 7f4fdf7fe640 1 --2- 172.21.15.39:0/3852927681 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4fcc076300 0x7f4fcc078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:00.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.813+0000 7f4fdf7fe640 1 --2- 172.21.15.39:0/3852927681 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4fcc076300 0x7f4fcc078810 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0034000 tx=0x7f4fd002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:00.802 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:00.817+0000 7f4fc7fff640 1 -- 172.21.15.39:0/3852927681 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f4fd8022020 con 0x7f4fe0154160 2024-05-14T14:41:01.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.082+0000 7f4fe5db4640 1 -- 172.21.15.39:0/3852927681 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f4fe015dd80 con 0x7f4fe0154160 2024-05-14T14:41:01.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.089+0000 7f4fc7fff640 1 -- 172.21.15.39:0/3852927681 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v10) ==== 97+0+0 (secure 0 0 0) 0x7f4fd8010040 con 0x7f4fe0154160 2024-05-14T14:41:01.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.091+0000 7f4fe5db4640 1 -- 172.21.15.39:0/3852927681 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4fcc076300 msgr2=0x7f4fcc078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:01.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.091+0000 7f4fe5db4640 1 --2- 172.21.15.39:0/3852927681 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4fcc076300 0x7f4fcc078810 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0034000 tx=0x7f4fd002e000 comp rx=0 tx=0).stop 2024-05-14T14:41:01.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.091+0000 7f4fe5db4640 1 -- 172.21.15.39:0/3852927681 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4fe0154160 msgr2=0x7f4fe0146120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:01.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.091+0000 7f4fe5db4640 1 --2- 172.21.15.39:0/3852927681 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4fe0154160 0x7f4fe0146120 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8009e70 tx=0x7f4fd800c490 comp rx=0 tx=0).stop 2024-05-14T14:41:01.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.091+0000 7f4fe5db4640 1 -- 172.21.15.39:0/3852927681 shutdown_connections 2024-05-14T14:41:01.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.091+0000 7f4fe5db4640 1 --2- 172.21.15.39:0/3852927681 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4fcc076300 0x7f4fcc078810 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:01.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.091+0000 7f4fe5db4640 1 --2- 172.21.15.39:0/3852927681 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4fe0154160 0x7f4fe0146120 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:01.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.091+0000 7f4fe5db4640 1 --2- 172.21.15.39:0/3852927681 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4fe00d4690 0x7f4fe00c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:01.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.091+0000 7f4fe5db4640 1 --2- 172.21.15.39:0/3852927681 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f4fe006de40 0x7f4fe015ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:01.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.091+0000 7f4fe5db4640 1 -- 172.21.15.39:0/3852927681 >> 172.21.15.39:0/3852927681 conn(0x7f4fe00d28c0 msgr2=0x7f4fe015e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:01.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.091+0000 7f4fe5db4640 1 -- 172.21.15.39:0/3852927681 shutdown_connections 2024-05-14T14:41:01.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.091+0000 7f4fe5db4640 1 -- 172.21.15.39:0/3852927681 wait complete. 2024-05-14T14:41:01.088 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-05-14T14:41:01.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.218+0000 7fb96b4af640 1 Processor -- start 2024-05-14T14:41:01.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.219+0000 7fb96b4af640 1 -- start start 2024-05-14T14:41:01.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.220+0000 7fb96b4af640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb9640b5c70 0x7fb96406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:01.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.220+0000 7fb96b4af640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9640cea90 con 0x7fb964160470 2024-05-14T14:41:01.205 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.220+0000 7fb96b4af640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb964164670 con 0x7fb9640ce680 2024-05-14T14:41:01.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.220+0000 7fb96b4af640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fb964164950 con 0x7fb9640b5c70 2024-05-14T14:41:01.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.220+0000 7fb96924b640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fb964160470 0x7fb964163eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:54140/0 (socket says 172.21.15.39:54140) 2024-05-14T14:41:01.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.220+0000 7fb96924b640 1 -- 172.21.15.39:0/1441390855 learned_addr learned my addr 172.21.15.39:0/1441390855 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:41:01.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.220+0000 7fb969a4c640 1 --2- 172.21.15.39:0/1441390855 >> v2:172.21.15.62:3300/0 conn(0x7fb9640b5c70 0x7fb96406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:01.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.220+0000 7fb963fff640 1 -- 172.21.15.39:0/1441390855 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 555320332 0 0) 0x7fb9640cea90 con 0x7fb964160470 2024-05-14T14:41:01.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.220+0000 7fb963fff640 1 -- 172.21.15.39:0/1441390855 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb94c003520 con 0x7fb964160470 2024-05-14T14:41:01.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.221+0000 7fb963fff640 1 -- 172.21.15.39:0/1441390855 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3198407466 0 0) 0x7fb94c003520 con 0x7fb964160470 2024-05-14T14:41:01.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.221+0000 7fb969a4c640 1 -- 172.21.15.39:0/1441390855 >> v1:172.21.15.62:6789/0 conn(0x7fb9640ce680 legacy=0x7fb9640b5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:01.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.221+0000 7fb969a4c640 1 -- 172.21.15.39:0/1441390855 >> v1:172.21.15.39:6789/0 conn(0x7fb964160470 legacy=0x7fb964163eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:01.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.221+0000 7fb969a4c640 1 -- 172.21.15.39:0/1441390855 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb964164c30 con 0x7fb9640b5c70 2024-05-14T14:41:01.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.221+0000 7fb969a4c640 1 --2- 172.21.15.39:0/1441390855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9640b5c70 0x7fb96406e3f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb954009d90 tx=0x7fb95402a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ce241c8c1125563 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:01.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.222+0000 7fb963fff640 1 -- 172.21.15.39:0/1441390855 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95c0016f0 con 0x7fb9640b5c70 2024-05-14T14:41:01.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.222+0000 7fb963fff640 1 -- 172.21.15.39:0/1441390855 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb954007540 con 0x7fb9640b5c70 2024-05-14T14:41:01.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.222+0000 7fb963fff640 1 -- 172.21.15.39:0/1441390855 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9540078f0 con 0x7fb9640b5c70 2024-05-14T14:41:01.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.222+0000 7fb96b4af640 1 -- 172.21.15.39:0/1441390855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9640b5c70 msgr2=0x7fb96406e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:01.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.222+0000 7fb96b4af640 1 --2- 172.21.15.39:0/1441390855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9640b5c70 0x7fb96406e3f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb954009d90 tx=0x7fb95402a680 comp rx=0 tx=0).stop 2024-05-14T14:41:01.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.222+0000 7fb96b4af640 1 -- 172.21.15.39:0/1441390855 shutdown_connections 2024-05-14T14:41:01.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.222+0000 7fb96b4af640 1 --2- 172.21.15.39:0/1441390855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb9640b5c70 0x7fb96406e3f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:01.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.222+0000 7fb96b4af640 1 -- 172.21.15.39:0/1441390855 >> 172.21.15.39:0/1441390855 conn(0x7fb9640d0740 msgr2=0x7fb9640d0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:01.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.223+0000 7fb96b4af640 1 -- 172.21.15.39:0/1441390855 shutdown_connections 2024-05-14T14:41:01.208 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.223+0000 7fb96b4af640 1 -- 172.21.15.39:0/1441390855 wait complete. 2024-05-14T14:41:01.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.224+0000 7fb96b4af640 1 Processor -- start 2024-05-14T14:41:01.209 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.224+0000 7fb96b4af640 1 -- start start 2024-05-14T14:41:01.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.226+0000 7fb96b4af640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9640ce680 0x7fb96415aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:01.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.226+0000 7fb96b4af640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb964160470 0x7fb964162e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:01.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.226+0000 7fb96b4af640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb96415b2c0 0x7fb9641633b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:01.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.226+0000 7fb96b4af640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb9640d2bc0 con 0x7fb96415b2c0 2024-05-14T14:41:01.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.226+0000 7fb96b4af640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb9640d2a40 con 0x7fb964160470 2024-05-14T14:41:01.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.226+0000 7fb96b4af640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fb9640d2d40 con 0x7fb9640ce680 2024-05-14T14:41:01.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.226+0000 7fb969a4c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb96415b2c0 0x7fb9641633b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:01.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.226+0000 7fb969a4c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb96415b2c0 0x7fb9641633b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48536/0 (socket says 172.21.15.39:48536) 2024-05-14T14:41:01.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.226+0000 7fb969a4c640 1 -- 172.21.15.39:0/1338360800 learned_addr learned my addr 172.21.15.39:0/1338360800 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:41:01.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.226+0000 7fb968a4a640 1 --2- 172.21.15.39:0/1338360800 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb964160470 0x7fb964162e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:01.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.226+0000 7fb96924b640 1 --2- 172.21.15.39:0/1338360800 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9640ce680 0x7fb96415aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:01.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.226+0000 7fb969a4c640 1 -- 172.21.15.39:0/1338360800 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9640ce680 msgr2=0x7fb96415aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:01.212 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.226+0000 7fb969a4c640 1 --2- 172.21.15.39:0/1338360800 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9640ce680 0x7fb96415aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:01.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.226+0000 7fb969a4c640 1 -- 172.21.15.39:0/1338360800 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb964160470 msgr2=0x7fb964162e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:01.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.226+0000 7fb969a4c640 1 --2- 172.21.15.39:0/1338360800 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb964160470 0x7fb964162e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:01.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.226+0000 7fb969a4c640 1 -- 172.21.15.39:0/1338360800 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9640af570 con 0x7fb96415b2c0 2024-05-14T14:41:01.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.226+0000 7fb968a4a640 1 --2- 172.21.15.39:0/1338360800 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb964160470 0x7fb964162e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:41:01.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.226+0000 7fb969a4c640 1 --2- 172.21.15.39:0/1338360800 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb96415b2c0 0x7fb9641633b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb954009eb0 tx=0x7fb954004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:01.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.226+0000 7fb961ffb640 1 -- 172.21.15.39:0/1338360800 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb954009450 con 0x7fb96415b2c0 2024-05-14T14:41:01.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.226+0000 7fb961ffb640 1 -- 172.21.15.39:0/1338360800 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb954004240 con 0x7fb96415b2c0 2024-05-14T14:41:01.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.226+0000 7fb96b4af640 1 -- 172.21.15.39:0/1338360800 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9640b0f50 con 0x7fb96415b2c0 2024-05-14T14:41:01.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.226+0000 7fb961ffb640 1 -- 172.21.15.39:0/1338360800 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9540045f0 con 0x7fb96415b2c0 2024-05-14T14:41:01.213 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.227+0000 7fb96b4af640 1 -- 172.21.15.39:0/1338360800 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9640af850 con 0x7fb96415b2c0 2024-05-14T14:41:01.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.228+0000 7fb96b4af640 1 -- 172.21.15.39:0/1338360800 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9640aec80 con 0x7fb96415b2c0 2024-05-14T14:41:01.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.228+0000 7fb961ffb640 1 -- 172.21.15.39:0/1338360800 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb954039040 con 0x7fb96415b2c0 2024-05-14T14:41:01.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.229+0000 7fb961ffb640 1 --2- 172.21.15.39:0/1338360800 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fb9500762d0 0x7fb9500787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:01.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.229+0000 7fb961ffb640 1 -- 172.21.15.39:0/1338360800 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5249+0+0 (secure 0 0 0) 0x7fb9540b8730 con 0x7fb96415b2c0 2024-05-14T14:41:01.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.229+0000 7fb96924b640 1 --2- 172.21.15.39:0/1338360800 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fb9500762d0 0x7fb9500787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:01.214 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.229+0000 7fb96924b640 1 --2- 172.21.15.39:0/1338360800 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fb9500762d0 0x7fb9500787e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb95c001220 tx=0x7fb95c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:01.218 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.234+0000 7fb961ffb640 1 -- 172.21.15.39:0/1338360800 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb954040030 con 0x7fb96415b2c0 2024-05-14T14:41:01.480 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.496+0000 7fb96b4af640 1 -- 172.21.15.39:0/1338360800 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7fb964076aa0 con 0x7fb96415b2c0 2024-05-14T14:41:01.487 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.503+0000 7fb961ffb640 1 -- 172.21.15.39:0/1338360800 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v11) ==== 90+0+0 (secure 0 0 0) 0x7fb954082250 con 0x7fb96415b2c0 2024-05-14T14:41:01.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.505+0000 7fb96b4af640 1 -- 172.21.15.39:0/1338360800 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fb9500762d0 msgr2=0x7fb9500787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:01.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.505+0000 7fb96b4af640 1 --2- 172.21.15.39:0/1338360800 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fb9500762d0 0x7fb9500787e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb95c001220 tx=0x7fb95c009040 comp rx=0 tx=0).stop 2024-05-14T14:41:01.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.505+0000 7fb96b4af640 1 -- 172.21.15.39:0/1338360800 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb96415b2c0 msgr2=0x7fb9641633b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:01.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.505+0000 7fb96b4af640 1 --2- 172.21.15.39:0/1338360800 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb96415b2c0 0x7fb9641633b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb954009eb0 tx=0x7fb954004a40 comp rx=0 tx=0).stop 2024-05-14T14:41:01.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.505+0000 7fb96b4af640 1 -- 172.21.15.39:0/1338360800 shutdown_connections 2024-05-14T14:41:01.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.505+0000 7fb96b4af640 1 --2- 172.21.15.39:0/1338360800 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fb9500762d0 0x7fb9500787e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:01.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.505+0000 7fb96b4af640 1 --2- 172.21.15.39:0/1338360800 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb96415b2c0 0x7fb9641633b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:01.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.505+0000 7fb96b4af640 1 --2- 172.21.15.39:0/1338360800 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb964160470 0x7fb964162e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:01.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.505+0000 7fb96b4af640 1 --2- 172.21.15.39:0/1338360800 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb9640ce680 0x7fb96415aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:01.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.505+0000 7fb96b4af640 1 -- 172.21.15.39:0/1338360800 >> 172.21.15.39:0/1338360800 conn(0x7fb9640d0740 msgr2=0x7fb964068610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:01.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.505+0000 7fb96b4af640 1 -- 172.21.15.39:0/1338360800 shutdown_connections 2024-05-14T14:41:01.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.505+0000 7fb96b4af640 1 -- 172.21.15.39:0/1338360800 wait complete. 2024-05-14T14:41:01.501 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-14T14:41:01.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.631+0000 7fcf6d99d640 1 Processor -- start 2024-05-14T14:41:01.616 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.631+0000 7fcf6d99d640 1 -- start start 2024-05-14T14:41:01.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.632+0000 7fcf6d99d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf68162680 0x7fcf680af040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:01.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.632+0000 7fcf6d99d640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf6806d150 con 0x7fcf680b6580 2024-05-14T14:41:01.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.632+0000 7fcf6d99d640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf6806d430 con 0x7fcf68162270 2024-05-14T14:41:01.619 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.632+0000 7fcf6d99d640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fcf6806d710 con 0x7fcf68162680 2024-05-14T14:41:01.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.632+0000 7fcf66ffd640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fcf680b6580 0x7fcf68161b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:54142/0 (socket says 172.21.15.39:54142) 2024-05-14T14:41:01.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.633+0000 7fcf66ffd640 1 -- 172.21.15.39:0/946962334 learned_addr learned my addr 172.21.15.39:0/946962334 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:41:01.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.633+0000 7fcf677fe640 1 --2- 172.21.15.39:0/946962334 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf68162680 0x7fcf680af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:01.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.633+0000 7fcf65ffb640 1 -- 172.21.15.39:0/946962334 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 566224047 0 0) 0x7fcf6806d150 con 0x7fcf680b6580 2024-05-14T14:41:01.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.633+0000 7fcf65ffb640 1 -- 172.21.15.39:0/946962334 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf50003520 con 0x7fcf680b6580 2024-05-14T14:41:01.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.633+0000 7fcf65ffb640 1 -- 172.21.15.39:0/946962334 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2282877035 0 0) 0x7fcf50003520 con 0x7fcf680b6580 2024-05-14T14:41:01.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.633+0000 7fcf65ffb640 1 -- 172.21.15.39:0/946962334 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf68162680 msgr2=0x7fcf680af040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:01.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.633+0000 7fcf65ffb640 1 --2- 172.21.15.39:0/946962334 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf68162680 0x7fcf680af040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:01.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.633+0000 7fcf65ffb640 1 -- 172.21.15.39:0/946962334 >> v1:172.21.15.62:6789/0 conn(0x7fcf68162270 legacy=0x7fcf680ae930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:01.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.633+0000 7fcf65ffb640 1 -- 172.21.15.39:0/946962334 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf6806d9f0 con 0x7fcf680b6580 2024-05-14T14:41:01.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.633+0000 7fcf65ffb640 1 -- 172.21.15.39:0/946962334 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1803005051 0 0) 0x7fcf580016f0 con 0x7fcf680b6580 2024-05-14T14:41:01.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.633+0000 7fcf65ffb640 1 -- 172.21.15.39:0/946962334 >> v1:172.21.15.39:6789/0 conn(0x7fcf680b6580 legacy=0x7fcf68161b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:01.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.633+0000 7fcf65ffb640 1 --2- 172.21.15.39:0/946962334 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf500039e0 0x7fcf50003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:01.620 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.633+0000 7fcf65ffb640 1 --2- 172.21.15.39:0/946962334 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf50004800 0x7fcf50004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:01.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.633+0000 7fcf65ffb640 1 --2- 172.21.15.39:0/946962334 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf68162680 0x7fcf5000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:01.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.633+0000 7fcf65ffb640 1 -- 172.21.15.39:0/946962334 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6806d710 con 0x7fcf500039e0 2024-05-14T14:41:01.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.633+0000 7fcf65ffb640 1 -- 172.21.15.39:0/946962334 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fcf50005590 con 0x7fcf50004800 2024-05-14T14:41:01.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.633+0000 7fcf65ffb640 1 -- 172.21.15.39:0/946962334 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fcf5000bf00 con 0x7fcf68162680 2024-05-14T14:41:01.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.633+0000 7fcf66ffd640 1 --2- 172.21.15.39:0/946962334 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf500039e0 0x7fcf50003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:01.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.634+0000 7fcf677fe640 1 --2- 172.21.15.39:0/946962334 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf68162680 0x7fcf5000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:01.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.634+0000 7fcf667fc640 1 --2- 172.21.15.39:0/946962334 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf50004800 0x7fcf50004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:01.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.634+0000 7fcf66ffd640 1 -- 172.21.15.39:0/946962334 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf68162680 msgr2=0x7fcf5000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:01.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.634+0000 7fcf66ffd640 1 --2- 172.21.15.39:0/946962334 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf68162680 0x7fcf5000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:01.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.634+0000 7fcf66ffd640 1 -- 172.21.15.39:0/946962334 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf50004800 msgr2=0x7fcf50004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:01.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.634+0000 7fcf66ffd640 1 --2- 172.21.15.39:0/946962334 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf50004800 0x7fcf50004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:01.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.634+0000 7fcf66ffd640 1 -- 172.21.15.39:0/946962334 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf50003520 con 0x7fcf500039e0 2024-05-14T14:41:01.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.634+0000 7fcf667fc640 1 --2- 172.21.15.39:0/946962334 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf50004800 0x7fcf50004c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:41:01.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.634+0000 7fcf66ffd640 1 --2- 172.21.15.39:0/946962334 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf500039e0 0x7fcf50003e10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcf680b0a50 tx=0x7fcf50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bcf89a13d6bcb5d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:01.621 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.635+0000 7fcf65ffb640 1 -- 172.21.15.39:0/946962334 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf58007d10 con 0x7fcf500039e0 2024-05-14T14:41:01.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.635+0000 7fcf65ffb640 1 -- 172.21.15.39:0/946962334 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf58005ad0 con 0x7fcf500039e0 2024-05-14T14:41:01.622 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.635+0000 7fcf65ffb640 1 -- 172.21.15.39:0/946962334 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf58007070 con 0x7fcf500039e0 2024-05-14T14:41:01.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.635+0000 7fcf6d99d640 1 -- 172.21.15.39:0/946962334 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf500039e0 msgr2=0x7fcf50003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:01.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.635+0000 7fcf6d99d640 1 --2- 172.21.15.39:0/946962334 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf500039e0 0x7fcf50003e10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcf680b0a50 tx=0x7fcf50005830 comp rx=0 tx=0).stop 2024-05-14T14:41:01.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.635+0000 7fcf677fe640 1 -- 172.21.15.39:0/946962334 reap_dead start 2024-05-14T14:41:01.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.635+0000 7fcf6d99d640 1 -- 172.21.15.39:0/946962334 shutdown_connections 2024-05-14T14:41:01.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.635+0000 7fcf6d99d640 1 -- 172.21.15.39:0/946962334 >> 172.21.15.39:0/946962334 conn(0x7fcf680d1c80 msgr2=0x7fcf680d2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:01.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.635+0000 7fcf6d99d640 1 -- 172.21.15.39:0/946962334 shutdown_connections 2024-05-14T14:41:01.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.635+0000 7fcf6d99d640 1 -- 172.21.15.39:0/946962334 wait complete. 2024-05-14T14:41:01.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.637+0000 7fcf6d99d640 1 Processor -- start 2024-05-14T14:41:01.623 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.637+0000 7fcf6d99d640 1 -- start start 2024-05-14T14:41:01.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.639+0000 7fcf6d99d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf500039e0 0x7fcf681432b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:01.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.639+0000 7fcf6d99d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf6815f640 0x7fcf68161460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:01.625 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.639+0000 7fcf6d99d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf68141d50 0x7fcf68142160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:01.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.639+0000 7fcf6d99d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6815f410 con 0x7fcf500039e0 2024-05-14T14:41:01.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.639+0000 7fcf6d99d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6815f290 con 0x7fcf6815f640 2024-05-14T14:41:01.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.639+0000 7fcf6d99d640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fcf680af040 con 0x7fcf68141d50 2024-05-14T14:41:01.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.639+0000 7fcf66ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf500039e0 0x7fcf681432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:01.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.639+0000 7fcf66ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf500039e0 0x7fcf681432b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48552/0 (socket says 172.21.15.39:48552) 2024-05-14T14:41:01.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.639+0000 7fcf66ffd640 1 -- 172.21.15.39:0/43504104 learned_addr learned my addr 172.21.15.39:0/43504104 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:41:01.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.639+0000 7fcf677fe640 1 --2- 172.21.15.39:0/43504104 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf68141d50 0x7fcf68142160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:01.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.639+0000 7fcf667fc640 1 --2- 172.21.15.39:0/43504104 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf6815f640 0x7fcf68161460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:01.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.639+0000 7fcf66ffd640 1 -- 172.21.15.39:0/43504104 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf68141d50 msgr2=0x7fcf68142160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:01.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.639+0000 7fcf66ffd640 1 --2- 172.21.15.39:0/43504104 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf68141d50 0x7fcf68142160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:01.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.639+0000 7fcf66ffd640 1 -- 172.21.15.39:0/43504104 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf6815f640 msgr2=0x7fcf68161460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:01.626 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.639+0000 7fcf66ffd640 1 --2- 172.21.15.39:0/43504104 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf6815f640 0x7fcf68161460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:01.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.639+0000 7fcf66ffd640 1 -- 172.21.15.39:0/43504104 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf681426a0 con 0x7fcf500039e0 2024-05-14T14:41:01.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.639+0000 7fcf677fe640 1 --2- 172.21.15.39:0/43504104 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf68141d50 0x7fcf68142160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:41:01.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.639+0000 7fcf667fc640 1 --2- 172.21.15.39:0/43504104 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf6815f640 0x7fcf68161460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:41:01.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.639+0000 7fcf66ffd640 1 --2- 172.21.15.39:0/43504104 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf500039e0 0x7fcf681432b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fcf5800c2d0 tx=0x7fcf6806d8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:01.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.639+0000 7fcf4ffff640 1 -- 172.21.15.39:0/43504104 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf58040020 con 0x7fcf500039e0 2024-05-14T14:41:01.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.640+0000 7fcf4ffff640 1 -- 172.21.15.39:0/43504104 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf580014b0 con 0x7fcf500039e0 2024-05-14T14:41:01.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.640+0000 7fcf6d99d640 1 -- 172.21.15.39:0/43504104 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf681437f0 con 0x7fcf500039e0 2024-05-14T14:41:01.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.640+0000 7fcf4ffff640 1 -- 172.21.15.39:0/43504104 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf58037040 con 0x7fcf500039e0 2024-05-14T14:41:01.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.640+0000 7fcf6d99d640 1 -- 172.21.15.39:0/43504104 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf68140cb0 con 0x7fcf500039e0 2024-05-14T14:41:01.627 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.641+0000 7fcf6d99d640 1 -- 172.21.15.39:0/43504104 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf68076aa0 con 0x7fcf500039e0 2024-05-14T14:41:01.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.641+0000 7fcf4ffff640 1 -- 172.21.15.39:0/43504104 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcf58043020 con 0x7fcf500039e0 2024-05-14T14:41:01.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.642+0000 7fcf4ffff640 1 --2- 172.21.15.39:0/43504104 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fcf540762d0 0x7fcf540787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:01.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.642+0000 7fcf4ffff640 1 -- 172.21.15.39:0/43504104 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5249+0+0 (secure 0 0 0) 0x7fcf580b6df0 con 0x7fcf500039e0 2024-05-14T14:41:01.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.642+0000 7fcf667fc640 1 --2- 172.21.15.39:0/43504104 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fcf540762d0 0x7fcf540787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:01.628 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.642+0000 7fcf667fc640 1 --2- 172.21.15.39:0/43504104 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fcf540762d0 0x7fcf540787e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcf680cf6f0 tx=0x7fcf5c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:01.631 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.647+0000 7fcf4ffff640 1 -- 172.21.15.39:0/43504104 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcf681426a0 con 0x7fcf500039e0 2024-05-14T14:41:01.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.843+0000 7fcf6d99d640 1 -- 172.21.15.39:0/43504104 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fcf68159af0 con 0x7fcf500039e0 2024-05-14T14:41:01.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.844+0000 7fcf4ffff640 1 -- 172.21.15.39:0/43504104 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v32) ==== 84+0+65 (secure 0 0 0) 0x7fcf58080880 con 0x7fcf500039e0 2024-05-14T14:41:01.829 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:41:01.829 INFO:teuthology.orchestra.run.smithi039.stdout:[ 2024-05-14T14:41:01.829 INFO:teuthology.orchestra.run.smithi039.stdout: { 2024-05-14T14:41:01.829 INFO:teuthology.orchestra.run.smithi039.stdout: "poolnum": 1, 2024-05-14T14:41:01.829 INFO:teuthology.orchestra.run.smithi039.stdout: "poolname": ".mgr" 2024-05-14T14:41:01.829 INFO:teuthology.orchestra.run.smithi039.stdout: } 2024-05-14T14:41:01.829 INFO:teuthology.orchestra.run.smithi039.stdout:] 2024-05-14T14:41:01.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.846+0000 7fcf6d99d640 1 -- 172.21.15.39:0/43504104 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fcf540762d0 msgr2=0x7fcf540787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:01.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.846+0000 7fcf6d99d640 1 --2- 172.21.15.39:0/43504104 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fcf540762d0 0x7fcf540787e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcf680cf6f0 tx=0x7fcf5c009040 comp rx=0 tx=0).stop 2024-05-14T14:41:01.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.846+0000 7fcf6d99d640 1 -- 172.21.15.39:0/43504104 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf500039e0 msgr2=0x7fcf681432b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:01.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.846+0000 7fcf6d99d640 1 --2- 172.21.15.39:0/43504104 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf500039e0 0x7fcf681432b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fcf5800c2d0 tx=0x7fcf6806d8e0 comp rx=0 tx=0).stop 2024-05-14T14:41:01.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.846+0000 7fcf6d99d640 1 -- 172.21.15.39:0/43504104 shutdown_connections 2024-05-14T14:41:01.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.846+0000 7fcf6d99d640 1 --2- 172.21.15.39:0/43504104 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fcf540762d0 0x7fcf540787e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:01.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.846+0000 7fcf6d99d640 1 --2- 172.21.15.39:0/43504104 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf68141d50 0x7fcf68142160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:01.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.846+0000 7fcf6d99d640 1 --2- 172.21.15.39:0/43504104 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf6815f640 0x7fcf68161460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:01.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.846+0000 7fcf6d99d640 1 --2- 172.21.15.39:0/43504104 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf500039e0 0x7fcf681432b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:01.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.846+0000 7fcf6d99d640 1 -- 172.21.15.39:0/43504104 >> 172.21.15.39:0/43504104 conn(0x7fcf680d1c80 msgr2=0x7fcf680ae930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:01.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.846+0000 7fcf6d99d640 1 -- 172.21.15.39:0/43504104 shutdown_connections 2024-05-14T14:41:01.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.846+0000 7fcf6d99d640 1 -- 172.21.15.39:0/43504104 wait complete. 2024-05-14T14:41:01.842 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-14T14:41:01.842 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-14T14:41:01.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.976+0000 7f53cbac6640 1 Processor -- start 2024-05-14T14:41:01.961 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.977+0000 7f53cbac6640 1 -- start start 2024-05-14T14:41:01.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.978+0000 7f53cbac6640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53c4160420 0x7f53c40d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:01.963 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.978+0000 7f53cbac6640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f53c40d1140 0x7f53c406d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:01.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.978+0000 7f53cbac6640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53c40b9310 con 0x7f53c406d5f0 2024-05-14T14:41:01.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.978+0000 7f53cbac6640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f53c40d1550 con 0x7f53c40d1140 2024-05-14T14:41:01.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.978+0000 7f53cbac6640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f53c406dd70 con 0x7f53c4160420 2024-05-14T14:41:01.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.978+0000 7f53c9862640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53c4160420 0x7f53c40d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:01.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.978+0000 7f53c9061640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f53c40d1140 0x7f53c406d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:01.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.978+0000 7f53c9862640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53c4160420 0x7f53c40d0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.39:47954/0 (socket says 172.21.15.39:47954) 2024-05-14T14:41:01.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.978+0000 7f53c9862640 1 -- 172.21.15.39:0/4025245992 learned_addr learned my addr 172.21.15.39:0/4025245992 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:41:01.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.979+0000 7f53c9862640 1 -- 172.21.15.39:0/4025245992 >> v2:172.21.15.62:3300/0 conn(0x7f53c40d1140 msgr2=0x7f53c406d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:01.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.979+0000 7f53c9862640 1 --2- 172.21.15.39:0/4025245992 >> v2:172.21.15.62:3300/0 conn(0x7f53c40d1140 0x7f53c406d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:01.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.979+0000 7f53c9862640 1 -- 172.21.15.39:0/4025245992 >> v1:172.21.15.62:6789/0 conn(0x7f53c406d5f0 legacy=0x7f53c40d49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:01.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.979+0000 7f53c9862640 1 -- 172.21.15.39:0/4025245992 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c40b9590 con 0x7f53c4160420 2024-05-14T14:41:01.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.980+0000 7f53c9862640 1 --2- 172.21.15.39:0/4025245992 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53c4160420 0x7f53c40d0c00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f53b4009e50 tx=0x7f53b402a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ae5c1cb7896dd38 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:01.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.980+0000 7f53c8860640 1 -- 172.21.15.39:0/4025245992 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b4036070 con 0x7f53c4160420 2024-05-14T14:41:01.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.980+0000 7f53c8860640 1 -- 172.21.15.39:0/4025245992 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53b4031600 con 0x7f53c4160420 2024-05-14T14:41:01.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.980+0000 7f53c8860640 1 -- 172.21.15.39:0/4025245992 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b40319d0 con 0x7f53c4160420 2024-05-14T14:41:01.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.981+0000 7f53cbac6640 1 -- 172.21.15.39:0/4025245992 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53c4160420 msgr2=0x7f53c40d0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:01.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.981+0000 7f53cbac6640 1 --2- 172.21.15.39:0/4025245992 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53c4160420 0x7f53c40d0c00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f53b4009e50 tx=0x7f53b402a680 comp rx=0 tx=0).stop 2024-05-14T14:41:01.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.981+0000 7f53cbac6640 1 -- 172.21.15.39:0/4025245992 shutdown_connections 2024-05-14T14:41:01.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.981+0000 7f53cbac6640 1 --2- 172.21.15.39:0/4025245992 >> v2:172.21.15.62:3300/0 conn(0x7f53c40d1140 0x7f53c406d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:01.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.981+0000 7f53cbac6640 1 --2- 172.21.15.39:0/4025245992 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53c4160420 0x7f53c40d0c00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:01.966 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.981+0000 7f53cbac6640 1 -- 172.21.15.39:0/4025245992 >> 172.21.15.39:0/4025245992 conn(0x7f53c40d27d0 msgr2=0x7f53c40d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:01.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.981+0000 7f53cbac6640 1 -- 172.21.15.39:0/4025245992 shutdown_connections 2024-05-14T14:41:01.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.981+0000 7f53cbac6640 1 -- 172.21.15.39:0/4025245992 wait complete. 2024-05-14T14:41:01.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.982+0000 7f53cbac6640 1 Processor -- start 2024-05-14T14:41:01.967 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.983+0000 7f53cbac6640 1 -- start start 2024-05-14T14:41:01.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.984+0000 7f53cbac6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53c406d5f0 0x7f53c40cf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:01.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.984+0000 7f53cbac6640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53c40d1140 0x7f53c4156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:01.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.984+0000 7f53cbac6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53c4160420 0x7f53c41f9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:01.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.984+0000 7f53cbac6640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f53c4160830 con 0x7f53c4160420 2024-05-14T14:41:01.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.984+0000 7f53cbac6640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f53c40b9b50 con 0x7f53c406d5f0 2024-05-14T14:41:01.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.984+0000 7f53cbac6640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f53c406da00 con 0x7f53c40d1140 2024-05-14T14:41:01.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.984+0000 7f53ca063640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53c4160420 0x7f53c41f9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:01.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.984+0000 7f53ca063640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53c4160420 0x7f53c41f9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48554/0 (socket says 172.21.15.39:48554) 2024-05-14T14:41:01.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.984+0000 7f53ca063640 1 -- 172.21.15.39:0/3143226469 learned_addr learned my addr 172.21.15.39:0/3143226469 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:41:01.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.984+0000 7f53c9061640 1 --2- 172.21.15.39:0/3143226469 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53c40d1140 0x7f53c4156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:01.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.984+0000 7f53c9862640 1 --2- 172.21.15.39:0/3143226469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53c406d5f0 0x7f53c40cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:01.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.984+0000 7f53ca063640 1 -- 172.21.15.39:0/3143226469 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53c40d1140 msgr2=0x7f53c4156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:01.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.984+0000 7f53ca063640 1 --2- 172.21.15.39:0/3143226469 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53c40d1140 0x7f53c4156e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:01.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.984+0000 7f53ca063640 1 -- 172.21.15.39:0/3143226469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53c406d5f0 msgr2=0x7f53c40cf430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:01.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.984+0000 7f53ca063640 1 --2- 172.21.15.39:0/3143226469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53c406d5f0 0x7f53c40cf430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:01.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.984+0000 7f53ca063640 1 -- 172.21.15.39:0/3143226469 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53c40ce970 con 0x7f53c4160420 2024-05-14T14:41:01.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.984+0000 7f53ca063640 1 --2- 172.21.15.39:0/3143226469 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53c4160420 0x7f53c41f9b30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f53bc00c3c0 tx=0x7f53bc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:01.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.985+0000 7f53c27fc640 1 -- 172.21.15.39:0/3143226469 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc017070 con 0x7f53c4160420 2024-05-14T14:41:01.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.985+0000 7f53c27fc640 1 -- 172.21.15.39:0/3143226469 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53bc0052d0 con 0x7f53c4160420 2024-05-14T14:41:01.971 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.985+0000 7f53cbac6640 1 -- 172.21.15.39:0/3143226469 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53c4159fc0 con 0x7f53c4160420 2024-05-14T14:41:01.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.985+0000 7f53c27fc640 1 -- 172.21.15.39:0/3143226469 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53bc003810 con 0x7f53c4160420 2024-05-14T14:41:01.972 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.985+0000 7f53cbac6640 1 -- 172.21.15.39:0/3143226469 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53c41573a0 con 0x7f53c4160420 2024-05-14T14:41:01.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.986+0000 7f53cbac6640 1 -- 172.21.15.39:0/3143226469 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53c415f600 con 0x7f53c4160420 2024-05-14T14:41:01.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.987+0000 7f53c27fc640 1 -- 172.21.15.39:0/3143226469 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f53bc01a070 con 0x7f53c4160420 2024-05-14T14:41:01.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.987+0000 7f53c27fc640 1 --2- 172.21.15.39:0/3143226469 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f53b00762d0 0x7f53b00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:01.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.987+0000 7f53c27fc640 1 -- 172.21.15.39:0/3143226469 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5249+0+0 (secure 0 0 0) 0x7f53bc096710 con 0x7f53c4160420 2024-05-14T14:41:01.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.987+0000 7f53c9862640 1 --2- 172.21.15.39:0/3143226469 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f53b00762d0 0x7f53b00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:01.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.988+0000 7f53c9862640 1 --2- 172.21.15.39:0/3143226469 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f53b00762d0 0x7f53b00787e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f53b4033000 tx=0x7f53b4009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:01.976 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:01.992+0000 7f53c27fc640 1 -- 172.21.15.39:0/3143226469 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f53c415f600 con 0x7f53c4160420 2024-05-14T14:41:02.169 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.184+0000 7f53cbac6640 1 -- 172.21.15.39:0/3143226469 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f53c4076aa0 con 0x7f53c4160420 2024-05-14T14:41:02.671 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.686+0000 7f53c27fc640 1 -- 172.21.15.39:0/3143226469 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v33) ==== 138+0+0 (secure 0 0 0) 0x7f53c40b9310 con 0x7f53c4160420 2024-05-14T14:41:02.671 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_metadata' created 2024-05-14T14:41:02.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.689+0000 7f53cbac6640 1 -- 172.21.15.39:0/3143226469 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f53b00762d0 msgr2=0x7f53b00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:02.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.689+0000 7f53cbac6640 1 --2- 172.21.15.39:0/3143226469 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f53b00762d0 0x7f53b00787e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f53b4033000 tx=0x7f53b4009000 comp rx=0 tx=0).stop 2024-05-14T14:41:02.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.689+0000 7f53cbac6640 1 -- 172.21.15.39:0/3143226469 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53c4160420 msgr2=0x7f53c41f9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:02.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.689+0000 7f53cbac6640 1 --2- 172.21.15.39:0/3143226469 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53c4160420 0x7f53c41f9b30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f53bc00c3c0 tx=0x7f53bc00c880 comp rx=0 tx=0).stop 2024-05-14T14:41:02.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.689+0000 7f53cbac6640 1 -- 172.21.15.39:0/3143226469 shutdown_connections 2024-05-14T14:41:02.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.689+0000 7f53cbac6640 1 --2- 172.21.15.39:0/3143226469 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f53b00762d0 0x7f53b00787e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:02.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.689+0000 7f53cbac6640 1 --2- 172.21.15.39:0/3143226469 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f53c4160420 0x7f53c41f9b30 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:02.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.689+0000 7f53cbac6640 1 --2- 172.21.15.39:0/3143226469 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f53c40d1140 0x7f53c4156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:02.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.689+0000 7f53cbac6640 1 --2- 172.21.15.39:0/3143226469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53c406d5f0 0x7f53c40cf430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:02.674 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.689+0000 7f53cbac6640 1 -- 172.21.15.39:0/3143226469 >> 172.21.15.39:0/3143226469 conn(0x7f53c40d27d0 msgr2=0x7f53c415fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:02.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.689+0000 7f53cbac6640 1 -- 172.21.15.39:0/3143226469 shutdown_connections 2024-05-14T14:41:02.675 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.689+0000 7f53cbac6640 1 -- 172.21.15.39:0/3143226469 wait complete. 2024-05-14T14:41:02.689 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-14T14:41:02.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.831+0000 7f928c461640 1 Processor -- start 2024-05-14T14:41:02.816 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.832+0000 7f928c461640 1 -- start start 2024-05-14T14:41:02.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.833+0000 7f928c461640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9284073620 0x7f928415e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:02.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.833+0000 7f928c461640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9284161cc0 0x7f92840d2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:02.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.833+0000 7f928c461640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92840b32d0 con 0x7f92840ce370 2024-05-14T14:41:02.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.833+0000 7f928c461640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f92840d23a0 con 0x7f9284161cc0 2024-05-14T14:41:02.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.833+0000 7f928c461640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f92841623c0 con 0x7f9284073620 2024-05-14T14:41:02.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.833+0000 7f928a9fe640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9284161cc0 0x7f92840d2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:02.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.833+0000 7f928a9fe640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f9284161cc0 0x7f92840d2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48568/0 (socket says 172.21.15.39:48568) 2024-05-14T14:41:02.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.833+0000 7f928a9fe640 1 -- 172.21.15.39:0/3650610837 learned_addr learned my addr 172.21.15.39:0/3650610837 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:41:02.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.833+0000 7f92899fc640 1 --2- 172.21.15.39:0/3650610837 >> v2:172.21.15.62:3300/0 conn(0x7f9284073620 0x7f928415e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:02.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.834+0000 7f928a9fe640 1 -- 172.21.15.39:0/3650610837 >> v2:172.21.15.62:3300/0 conn(0x7f9284073620 msgr2=0x7f928415e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:02.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.834+0000 7f928a9fe640 1 --2- 172.21.15.39:0/3650610837 >> v2:172.21.15.62:3300/0 conn(0x7f9284073620 0x7f928415e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:02.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.834+0000 7f928a9fe640 1 -- 172.21.15.39:0/3650610837 >> v1:172.21.15.62:6789/0 conn(0x7f92840ce370 legacy=0x7f9284072f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:02.819 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.834+0000 7f928a9fe640 1 -- 172.21.15.39:0/3650610837 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92841626a0 con 0x7f9284161cc0 2024-05-14T14:41:02.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.834+0000 7f928a9fe640 1 --2- 172.21.15.39:0/3650610837 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9284161cc0 0x7f92840d2830 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f928408d080 tx=0x7f927c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcdb33018279f5f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:02.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.835+0000 7f92891fb640 1 -- 172.21.15.39:0/3650610837 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f927c036070 con 0x7f9284161cc0 2024-05-14T14:41:02.822 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.835+0000 7f92891fb640 1 -- 172.21.15.39:0/3650610837 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f927c031600 con 0x7f9284161cc0 2024-05-14T14:41:02.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.835+0000 7f92891fb640 1 -- 172.21.15.39:0/3650610837 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f927c0319d0 con 0x7f9284161cc0 2024-05-14T14:41:02.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.835+0000 7f928c461640 1 -- 172.21.15.39:0/3650610837 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9284161cc0 msgr2=0x7f92840d2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:02.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.835+0000 7f928c461640 1 --2- 172.21.15.39:0/3650610837 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9284161cc0 0x7f92840d2830 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f928408d080 tx=0x7f927c02a6a0 comp rx=0 tx=0).stop 2024-05-14T14:41:02.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.836+0000 7f928c461640 1 -- 172.21.15.39:0/3650610837 shutdown_connections 2024-05-14T14:41:02.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.836+0000 7f928c461640 1 --2- 172.21.15.39:0/3650610837 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f9284161cc0 0x7f92840d2830 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:02.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.836+0000 7f928c461640 1 --2- 172.21.15.39:0/3650610837 >> v2:172.21.15.62:3300/0 conn(0x7f9284073620 0x7f928415e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:02.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.836+0000 7f928c461640 1 -- 172.21.15.39:0/3650610837 >> 172.21.15.39:0/3650610837 conn(0x7f92840d3a80 msgr2=0x7f92840d3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:02.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.836+0000 7f928c461640 1 -- 172.21.15.39:0/3650610837 shutdown_connections 2024-05-14T14:41:02.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.836+0000 7f928c461640 1 -- 172.21.15.39:0/3650610837 wait complete. 2024-05-14T14:41:02.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.837+0000 7f928c461640 1 Processor -- start 2024-05-14T14:41:02.823 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.837+0000 7f928c461640 1 -- start start 2024-05-14T14:41:02.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.839+0000 7f928c461640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92840ce370 0x7f92841542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:02.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.839+0000 7f928c461640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9284161cc0 0x7f92841f4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:02.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.839+0000 7f928c461640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9284158520 0x7f9284160150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:02.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.839+0000 7f928c461640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f92840b6c90 con 0x7f92840ce370 2024-05-14T14:41:02.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.839+0000 7f928c461640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f92841620d0 con 0x7f9284161cc0 2024-05-14T14:41:02.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.839+0000 7f928c461640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f92840b6e10 con 0x7f9284158520 2024-05-14T14:41:02.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.839+0000 7f928a1fd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92840ce370 0x7f92841542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:02.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.839+0000 7f928a1fd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92840ce370 0x7f92841542c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48584/0 (socket says 172.21.15.39:48584) 2024-05-14T14:41:02.826 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.839+0000 7f928a1fd640 1 -- 172.21.15.39:0/3554562934 learned_addr learned my addr 172.21.15.39:0/3554562934 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:41:02.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.839+0000 7f92899fc640 1 --2- 172.21.15.39:0/3554562934 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9284161cc0 0x7f92841f4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:02.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.839+0000 7f928a9fe640 1 --2- 172.21.15.39:0/3554562934 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9284158520 0x7f9284160150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:02.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.839+0000 7f928a1fd640 1 -- 172.21.15.39:0/3554562934 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9284158520 msgr2=0x7f9284160150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:02.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.839+0000 7f928a1fd640 1 --2- 172.21.15.39:0/3554562934 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9284158520 0x7f9284160150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:02.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.839+0000 7f928a1fd640 1 -- 172.21.15.39:0/3554562934 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9284161cc0 msgr2=0x7f92841f4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:02.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.839+0000 7f928a1fd640 1 --2- 172.21.15.39:0/3554562934 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9284161cc0 0x7f92841f4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:02.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.839+0000 7f928a1fd640 1 -- 172.21.15.39:0/3554562934 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92841f5140 con 0x7f92840ce370 2024-05-14T14:41:02.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.839+0000 7f928a1fd640 1 --2- 172.21.15.39:0/3554562934 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92840ce370 0x7f92841542c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f928000c3a0 tx=0x7f928000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:02.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.839+0000 7f927affd640 1 -- 172.21.15.39:0/3554562934 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9280017070 con 0x7f92840ce370 2024-05-14T14:41:02.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.839+0000 7f927affd640 1 -- 172.21.15.39:0/3554562934 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92800052d0 con 0x7f92840ce370 2024-05-14T14:41:02.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.839+0000 7f927affd640 1 -- 172.21.15.39:0/3554562934 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92800037f0 con 0x7f92840ce370 2024-05-14T14:41:02.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.840+0000 7f928c461640 1 -- 172.21.15.39:0/3554562934 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9284158ac0 con 0x7f92840ce370 2024-05-14T14:41:02.827 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.840+0000 7f928c461640 1 -- 172.21.15.39:0/3554562934 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9284159080 con 0x7f92840ce370 2024-05-14T14:41:02.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.840+0000 7f928c461640 1 -- 172.21.15.39:0/3554562934 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9284076aa0 con 0x7f92840ce370 2024-05-14T14:41:02.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.841+0000 7f927affd640 1 -- 172.21.15.39:0/3554562934 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f928001a070 con 0x7f92840ce370 2024-05-14T14:41:02.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.842+0000 7f927affd640 1 --2- 172.21.15.39:0/3554562934 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f92680762d0 0x7f92680787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:02.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.842+0000 7f92899fc640 1 --2- 172.21.15.39:0/3554562934 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f92680762d0 0x7f92680787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:02.828 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.842+0000 7f927affd640 1 -- 172.21.15.39:0/3554562934 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5619+0+0 (secure 0 0 0) 0x7f9280096820 con 0x7f92840ce370 2024-05-14T14:41:02.829 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.842+0000 7f92899fc640 1 --2- 172.21.15.39:0/3554562934 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f92680762d0 0x7f92680787e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9284154a70 tx=0x7f9274008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:02.831 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:02.847+0000 7f927affd640 1 -- 172.21.15.39:0/3554562934 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f92841f5140 con 0x7f92840ce370 2024-05-14T14:41:03.021 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.036+0000 7f928c461640 1 -- 172.21.15.39:0/3554562934 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f92840d1bd0 con 0x7f92840ce370 2024-05-14T14:41:03.685 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.700+0000 7f927affd640 1 -- 172.21.15.39:0/3554562934 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v34) ==== 170+0+0 (secure 0 0 0) 0x7f92800681c0 con 0x7f92840ce370 2024-05-14T14:41:03.685 INFO:teuthology.orchestra.run.smithi039.stderr:pool 'cephfs_data' created 2024-05-14T14:41:03.688 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.703+0000 7f928c461640 1 -- 172.21.15.39:0/3554562934 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f92680762d0 msgr2=0x7f92680787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:03.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.703+0000 7f928c461640 1 --2- 172.21.15.39:0/3554562934 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f92680762d0 0x7f92680787e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9284154a70 tx=0x7f9274008040 comp rx=0 tx=0).stop 2024-05-14T14:41:03.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.703+0000 7f928c461640 1 -- 172.21.15.39:0/3554562934 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92840ce370 msgr2=0x7f92841542c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:03.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.703+0000 7f928c461640 1 --2- 172.21.15.39:0/3554562934 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92840ce370 0x7f92841542c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f928000c3a0 tx=0x7f928000c860 comp rx=0 tx=0).stop 2024-05-14T14:41:03.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.703+0000 7f928c461640 1 -- 172.21.15.39:0/3554562934 shutdown_connections 2024-05-14T14:41:03.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.703+0000 7f928c461640 1 --2- 172.21.15.39:0/3554562934 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f92680762d0 0x7f92680787e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:03.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.703+0000 7f928c461640 1 --2- 172.21.15.39:0/3554562934 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f9284158520 0x7f9284160150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:03.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.703+0000 7f928c461640 1 --2- 172.21.15.39:0/3554562934 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9284161cc0 0x7f92841f4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:03.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.703+0000 7f928c461640 1 --2- 172.21.15.39:0/3554562934 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f92840ce370 0x7f92841542c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:03.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.703+0000 7f928c461640 1 -- 172.21.15.39:0/3554562934 >> 172.21.15.39:0/3554562934 conn(0x7f92840d3a80 msgr2=0x7f92840d2870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:03.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.704+0000 7f928c461640 1 -- 172.21.15.39:0/3554562934 shutdown_connections 2024-05-14T14:41:03.689 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.704+0000 7f928c461640 1 -- 172.21.15.39:0/3554562934 wait complete. 2024-05-14T14:41:03.712 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-14T14:41:03.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.845+0000 7f192bb0d640 1 Processor -- start 2024-05-14T14:41:03.830 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.845+0000 7f192bb0d640 1 -- start start 2024-05-14T14:41:03.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.847+0000 7f192bb0d640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f19240d1de0 0x7f19240ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:03.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.847+0000 7f192bb0d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f192415e420 0x7f19240d0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:03.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.847+0000 7f192bb0d640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f192415e830 con 0x7f19240d0750 2024-05-14T14:41:03.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.847+0000 7f192bb0d640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f1924162000 con 0x7f19240d1de0 2024-05-14T14:41:03.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.847+0000 7f192bb0d640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f19241622e0 con 0x7f192415e420 2024-05-14T14:41:03.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.847+0000 7f19298a9640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f19240d1de0 0x7f19240ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:03.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.847+0000 7f19298a9640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f19240d1de0 0x7f19240ce510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48596/0 (socket says 172.21.15.39:48596) 2024-05-14T14:41:03.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.847+0000 7f192a0aa640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f19240d0750 0x7f1924070250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:54144/0 (socket says 172.21.15.39:54144) 2024-05-14T14:41:03.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.847+0000 7f19298a9640 1 -- 172.21.15.39:0/2145729809 learned_addr learned my addr 172.21.15.39:0/2145729809 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:41:03.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.847+0000 7f19290a8640 1 --2- 172.21.15.39:0/2145729809 >> v2:172.21.15.62:3300/0 conn(0x7f192415e420 0x7f19240d0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:03.832 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.847+0000 7f19298a9640 1 -- 172.21.15.39:0/2145729809 >> v2:172.21.15.62:3300/0 conn(0x7f192415e420 msgr2=0x7f19240d0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:03.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.847+0000 7f19298a9640 1 --2- 172.21.15.39:0/2145729809 >> v2:172.21.15.62:3300/0 conn(0x7f192415e420 0x7f19240d0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:03.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.847+0000 7f19298a9640 1 -- 172.21.15.39:0/2145729809 >> v1:172.21.15.39:6789/0 conn(0x7f19240d0750 legacy=0x7f1924070250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:03.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.847+0000 7f19298a9640 1 -- 172.21.15.39:0/2145729809 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19241625c0 con 0x7f19240d1de0 2024-05-14T14:41:03.833 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.847+0000 7f19288a7640 1 -- 172.21.15.39:0/2145729809 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1341176214 0 0) 0x7f192415e830 con 0x7f19240d0750 2024-05-14T14:41:03.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.848+0000 7f19298a9640 1 --2- 172.21.15.39:0/2145729809 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19240d1de0 0x7f19240ce510 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f19240d4aa0 tx=0x7f191c02a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da7aad03ee027fc0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:03.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.848+0000 7f19288a7640 1 -- 172.21.15.39:0/2145729809 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191c037070 con 0x7f19240d1de0 2024-05-14T14:41:03.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.848+0000 7f19288a7640 1 -- 172.21.15.39:0/2145729809 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f191c032440 con 0x7f19240d1de0 2024-05-14T14:41:03.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.848+0000 7f19288a7640 1 -- 172.21.15.39:0/2145729809 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191c032810 con 0x7f19240d1de0 2024-05-14T14:41:03.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.849+0000 7f192bb0d640 1 -- 172.21.15.39:0/2145729809 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19240d1de0 msgr2=0x7f19240ce510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:03.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.849+0000 7f192bb0d640 1 --2- 172.21.15.39:0/2145729809 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19240d1de0 0x7f19240ce510 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f19240d4aa0 tx=0x7f191c02a150 comp rx=0 tx=0).stop 2024-05-14T14:41:03.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.849+0000 7f192bb0d640 1 -- 172.21.15.39:0/2145729809 shutdown_connections 2024-05-14T14:41:03.834 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.849+0000 7f192bb0d640 1 --2- 172.21.15.39:0/2145729809 >> v2:172.21.15.62:3300/0 conn(0x7f192415e420 0x7f19240d0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:03.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.849+0000 7f192bb0d640 1 --2- 172.21.15.39:0/2145729809 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19240d1de0 0x7f19240ce510 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:03.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.849+0000 7f192bb0d640 1 -- 172.21.15.39:0/2145729809 >> 172.21.15.39:0/2145729809 conn(0x7f19240b5780 msgr2=0x7f19240b5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:03.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.849+0000 7f192bb0d640 1 -- 172.21.15.39:0/2145729809 shutdown_connections 2024-05-14T14:41:03.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.849+0000 7f192bb0d640 1 -- 172.21.15.39:0/2145729809 wait complete. 2024-05-14T14:41:03.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.851+0000 7f192bb0d640 1 Processor -- start 2024-05-14T14:41:03.835 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.851+0000 7f192bb0d640 1 -- start start 2024-05-14T14:41:03.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.852+0000 7f192bb0d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19240d0750 0x7f19240c33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:03.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.852+0000 7f192bb0d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19240d1de0 0x7f1924151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:03.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.852+0000 7f192bb0d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f192415e420 0x7f1924151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:03.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.852+0000 7f192bb0d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f19240cf660 con 0x7f19240d0750 2024-05-14T14:41:03.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.852+0000 7f192bb0d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f19240d0b60 con 0x7f19240d1de0 2024-05-14T14:41:03.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.852+0000 7f192bb0d640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f19240d3530 con 0x7f192415e420 2024-05-14T14:41:03.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.852+0000 7f19298a9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19240d0750 0x7f19240c33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:03.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.852+0000 7f19298a9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19240d0750 0x7f19240c33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48604/0 (socket says 172.21.15.39:48604) 2024-05-14T14:41:03.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.852+0000 7f19298a9640 1 -- 172.21.15.39:0/2923312732 learned_addr learned my addr 172.21.15.39:0/2923312732 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:41:03.843 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.852+0000 7f19290a8640 1 --2- 172.21.15.39:0/2923312732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19240d1de0 0x7f1924151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:03.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.852+0000 7f192a0aa640 1 --2- 172.21.15.39:0/2923312732 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f192415e420 0x7f1924151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:03.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.853+0000 7f19298a9640 1 -- 172.21.15.39:0/2923312732 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f192415e420 msgr2=0x7f1924151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:03.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.853+0000 7f19298a9640 1 --2- 172.21.15.39:0/2923312732 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f192415e420 0x7f1924151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:03.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.853+0000 7f19298a9640 1 -- 172.21.15.39:0/2923312732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19240d1de0 msgr2=0x7f1924151420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:03.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.853+0000 7f19298a9640 1 --2- 172.21.15.39:0/2923312732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19240d1de0 0x7f1924151420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:03.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.853+0000 7f19298a9640 1 -- 172.21.15.39:0/2923312732 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19240c3920 con 0x7f19240d0750 2024-05-14T14:41:03.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.853+0000 7f19298a9640 1 --2- 172.21.15.39:0/2923312732 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19240d0750 0x7f19240c33e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f191c02a190 tx=0x7f191c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:03.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.853+0000 7f19227fc640 1 -- 172.21.15.39:0/2923312732 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191c037040 con 0x7f19240d0750 2024-05-14T14:41:03.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.853+0000 7f19227fc640 1 -- 172.21.15.39:0/2923312732 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f191c042070 con 0x7f19240d0750 2024-05-14T14:41:03.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.853+0000 7f192bb0d640 1 -- 172.21.15.39:0/2923312732 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f192415fea0 con 0x7f19240d0750 2024-05-14T14:41:03.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.853+0000 7f19227fc640 1 -- 172.21.15.39:0/2923312732 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191c030880 con 0x7f19240d0750 2024-05-14T14:41:03.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.853+0000 7f192bb0d640 1 -- 172.21.15.39:0/2923312732 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1924160460 con 0x7f19240d0750 2024-05-14T14:41:03.844 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.854+0000 7f192bb0d640 1 -- 172.21.15.39:0/2923312732 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1924076aa0 con 0x7f19240d0750 2024-05-14T14:41:03.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.855+0000 7f19227fc640 1 -- 172.21.15.39:0/2923312732 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f191c030a20 con 0x7f19240d0750 2024-05-14T14:41:03.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.855+0000 7f19227fc640 1 --2- 172.21.15.39:0/2923312732 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f19100762d0 0x7f19100787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:03.845 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.855+0000 7f19227fc640 1 -- 172.21.15.39:0/2923312732 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6001+0+0 (secure 0 0 0) 0x7f191c0b7e70 con 0x7f19240d0750 2024-05-14T14:41:03.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.855+0000 7f19290a8640 1 --2- 172.21.15.39:0/2923312732 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f19100762d0 0x7f19100787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:03.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.856+0000 7f19290a8640 1 --2- 172.21.15.39:0/2923312732 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f19100762d0 0x7f19100787e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1924152d30 tx=0x7f1918009110 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:03.846 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:03.861+0000 7f19227fc640 1 -- 172.21.15.39:0/2923312732 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f191c0810e0 con 0x7f19240d0750 2024-05-14T14:41:04.073 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.089+0000 7f192bb0d640 1 -- 172.21.15.39:0/2923312732 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f1924070970 con 0x7f19240d0750 2024-05-14T14:41:04.706 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.721+0000 7f19227fc640 1 -- 172.21.15.39:0/2923312732 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) ==== 172+0+0 (secure 0 0 0) 0x7f191c0853e0 con 0x7f19240d0750 2024-05-14T14:41:04.706 INFO:teuthology.orchestra.run.smithi039.stderr:new fs with metadata pool 5 and data pool 6 2024-05-14T14:41:04.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.725+0000 7f192bb0d640 1 -- 172.21.15.39:0/2923312732 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f19100762d0 msgr2=0x7f19100787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:04.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.725+0000 7f192bb0d640 1 --2- 172.21.15.39:0/2923312732 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f19100762d0 0x7f19100787e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1924152d30 tx=0x7f1918009110 comp rx=0 tx=0).stop 2024-05-14T14:41:04.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.725+0000 7f192bb0d640 1 -- 172.21.15.39:0/2923312732 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19240d0750 msgr2=0x7f19240c33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:04.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.725+0000 7f192bb0d640 1 --2- 172.21.15.39:0/2923312732 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19240d0750 0x7f19240c33e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f191c02a190 tx=0x7f191c0046c0 comp rx=0 tx=0).stop 2024-05-14T14:41:04.710 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.725+0000 7f192bb0d640 1 -- 172.21.15.39:0/2923312732 shutdown_connections 2024-05-14T14:41:04.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.725+0000 7f192bb0d640 1 --2- 172.21.15.39:0/2923312732 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f19100762d0 0x7f19100787e0 secure :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1924152d30 tx=0x7f1918009110 comp rx=0 tx=0).stop 2024-05-14T14:41:04.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.725+0000 7f192bb0d640 1 --2- 172.21.15.39:0/2923312732 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f192415e420 0x7f1924151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:04.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.725+0000 7f192bb0d640 1 --2- 172.21.15.39:0/2923312732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f19240d1de0 0x7f1924151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:04.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.725+0000 7f192bb0d640 1 --2- 172.21.15.39:0/2923312732 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f19240d0750 0x7f19240c33e0 secure :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f191c02a190 tx=0x7f191c0046c0 comp rx=0 tx=0).stop 2024-05-14T14:41:04.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.725+0000 7f192bb0d640 1 -- 172.21.15.39:0/2923312732 >> 172.21.15.39:0/2923312732 conn(0x7f19240b5780 msgr2=0x7f1924158ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:04.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.726+0000 7f192bb0d640 1 -- 172.21.15.39:0/2923312732 shutdown_connections 2024-05-14T14:41:04.711 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.726+0000 7f192bb0d640 1 -- 172.21.15.39:0/2923312732 wait complete. 2024-05-14T14:41:04.735 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T14:41:04.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.868+0000 7fecea3dc640 1 Processor -- start 2024-05-14T14:41:04.853 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.868+0000 7fecea3dc640 1 -- start start 2024-05-14T14:41:04.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.869+0000 7fecea3dc640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fece40cf140 0x7fece415e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:04.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.869+0000 7fecea3dc640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fece4162010 con 0x7fece4161c00 2024-05-14T14:41:04.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.869+0000 7fecea3dc640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fece40ce810 con 0x7fece40d02c0 2024-05-14T14:41:04.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.869+0000 7fecea3dc640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fece4162b30 con 0x7fece40cf140 2024-05-14T14:41:04.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.869+0000 7fece37fe640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fece4161c00 0x7fece40cea30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:54148/0 (socket says 172.21.15.39:54148) 2024-05-14T14:41:04.855 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.869+0000 7fece37fe640 1 -- 172.21.15.39:0/4089842162 learned_addr learned my addr 172.21.15.39:0/4089842162 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:41:04.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.869+0000 7fece8979640 1 --2- 172.21.15.39:0/4089842162 >> v2:172.21.15.39:3300/0 conn(0x7fece40cf140 0x7fece415e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:04.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.869+0000 7fece2ffd640 1 -- 172.21.15.39:0/4089842162 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3000303832 0 0) 0x7fecd8001110 con 0x7fece4161c00 2024-05-14T14:41:04.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.870+0000 7fece2ffd640 1 -- 172.21.15.39:0/4089842162 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feccc003520 con 0x7fece4161c00 2024-05-14T14:41:04.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.870+0000 7fece8979640 1 -- 172.21.15.39:0/4089842162 >> v1:172.21.15.62:6789/0 conn(0x7fece40d02c0 legacy=0x7fece40b6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:04.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.870+0000 7fece8979640 1 -- 172.21.15.39:0/4089842162 >> v1:172.21.15.39:6789/0 conn(0x7fece4161c00 legacy=0x7fece40cea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:04.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.870+0000 7fece8979640 1 -- 172.21.15.39:0/4089842162 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fece4162290 con 0x7fece40cf140 2024-05-14T14:41:04.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.870+0000 7fece8979640 1 --2- 172.21.15.39:0/4089842162 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fece40cf140 0x7fece415e0a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fecdc009d90 tx=0x7fecdc02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a45f22b7b246a556 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:04.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.870+0000 7fece2ffd640 1 -- 172.21.15.39:0/4089842162 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecdc007740 con 0x7fece40cf140 2024-05-14T14:41:04.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.871+0000 7fece2ffd640 1 -- 172.21.15.39:0/4089842162 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecdc0078e0 con 0x7fece40cf140 2024-05-14T14:41:04.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.871+0000 7fece2ffd640 1 -- 172.21.15.39:0/4089842162 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecdc007cb0 con 0x7fece40cf140 2024-05-14T14:41:04.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.871+0000 7fecea3dc640 1 -- 172.21.15.39:0/4089842162 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fece40cf140 msgr2=0x7fece415e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:04.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.871+0000 7fecea3dc640 1 --2- 172.21.15.39:0/4089842162 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fece40cf140 0x7fece415e0a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fecdc009d90 tx=0x7fecdc02a660 comp rx=0 tx=0).stop 2024-05-14T14:41:04.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.871+0000 7fecea3dc640 1 -- 172.21.15.39:0/4089842162 shutdown_connections 2024-05-14T14:41:04.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.871+0000 7fecea3dc640 1 --2- 172.21.15.39:0/4089842162 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fece40cf140 0x7fece415e0a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:04.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.871+0000 7fecea3dc640 1 -- 172.21.15.39:0/4089842162 >> 172.21.15.39:0/4089842162 conn(0x7fece4071680 msgr2=0x7fece4071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:04.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.871+0000 7fecea3dc640 1 -- 172.21.15.39:0/4089842162 shutdown_connections 2024-05-14T14:41:04.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.871+0000 7fecea3dc640 1 -- 172.21.15.39:0/4089842162 wait complete. 2024-05-14T14:41:04.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.873+0000 7fecea3dc640 1 Processor -- start 2024-05-14T14:41:04.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.873+0000 7fecea3dc640 1 -- start start 2024-05-14T14:41:04.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.875+0000 7fecea3dc640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fece40d02c0 0x7fece40ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:04.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.875+0000 7fecea3dc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fece4161c00 0x7fece40b55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:04.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.875+0000 7fecea3dc640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fece4160520 0x7fece4160930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:04.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.875+0000 7fecea3dc640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fece40d21e0 con 0x7fece4160520 2024-05-14T14:41:04.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.875+0000 7fecea3dc640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fece4162850 con 0x7fece4161c00 2024-05-14T14:41:04.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.875+0000 7fecea3dc640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fece40d2700 con 0x7fece40d02c0 2024-05-14T14:41:04.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.875+0000 7fece8979640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fece4160520 0x7fece4160930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:04.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.875+0000 7fece8979640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fece4160520 0x7fece4160930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48612/0 (socket says 172.21.15.39:48612) 2024-05-14T14:41:04.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.875+0000 7fece8979640 1 -- 172.21.15.39:0/452606771 learned_addr learned my addr 172.21.15.39:0/452606771 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:41:04.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.875+0000 7fece37fe640 1 --2- 172.21.15.39:0/452606771 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fece4161c00 0x7fece40b55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:04.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.875+0000 7fece3fff640 1 --2- 172.21.15.39:0/452606771 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fece40d02c0 0x7fece40ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:04.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.875+0000 7fece8979640 1 -- 172.21.15.39:0/452606771 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fece40d02c0 msgr2=0x7fece40ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:04.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.875+0000 7fece8979640 1 --2- 172.21.15.39:0/452606771 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fece40d02c0 0x7fece40ca3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:04.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.875+0000 7fece8979640 1 -- 172.21.15.39:0/452606771 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fece4161c00 msgr2=0x7fece40b55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:04.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.875+0000 7fece8979640 1 --2- 172.21.15.39:0/452606771 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fece4161c00 0x7fece40b55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:04.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.875+0000 7fece8979640 1 -- 172.21.15.39:0/452606771 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fece4160e70 con 0x7fece4160520 2024-05-14T14:41:04.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.875+0000 7fece37fe640 1 --2- 172.21.15.39:0/452606771 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fece4161c00 0x7fece40b55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:41:04.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.875+0000 7fece8979640 1 --2- 172.21.15.39:0/452606771 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fece4160520 0x7fece4160930 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fecdc009eb0 tx=0x7fecdc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:04.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.875+0000 7fece0ff9640 1 -- 172.21.15.39:0/452606771 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecdc03f070 con 0x7fece4160520 2024-05-14T14:41:04.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.876+0000 7fece0ff9640 1 -- 172.21.15.39:0/452606771 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecdc031bc0 con 0x7fece4160520 2024-05-14T14:41:04.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.876+0000 7fece0ff9640 1 -- 172.21.15.39:0/452606771 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecdc009450 con 0x7fece4160520 2024-05-14T14:41:04.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.876+0000 7fecea3dc640 1 -- 172.21.15.39:0/452606771 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fece40b45f0 con 0x7fece4160520 2024-05-14T14:41:04.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.876+0000 7fecea3dc640 1 -- 172.21.15.39:0/452606771 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fece415e1d0 con 0x7fece4160520 2024-05-14T14:41:04.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.877+0000 7fecea3dc640 1 -- 172.21.15.39:0/452606771 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fece4156180 con 0x7fece4160520 2024-05-14T14:41:04.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.878+0000 7fece0ff9640 1 -- 172.21.15.39:0/452606771 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fecdc03b410 con 0x7fece4160520 2024-05-14T14:41:04.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.878+0000 7fece0ff9640 1 --2- 172.21.15.39:0/452606771 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fecd00762d0 0x7fecd00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:04.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.878+0000 7fece0ff9640 1 -- 172.21.15.39:0/452606771 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6101+0+0 (secure 0 0 0) 0x7fecdc0b8be0 con 0x7fece4160520 2024-05-14T14:41:04.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.878+0000 7fece3fff640 1 --2- 172.21.15.39:0/452606771 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fecd00762d0 0x7fecd00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:04.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.879+0000 7fece3fff640 1 --2- 172.21.15.39:0/452606771 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fecd00762d0 0x7fecd00787e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fecd4000f60 tx=0x7fecd4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:04.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:04.883+0000 7fece0ff9640 1 -- 172.21.15.39:0/452606771 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fece4156180 con 0x7fece4160520 2024-05-14T14:41:05.058 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.074+0000 7fecea3dc640 1 -- 172.21.15.39:0/452606771 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fece40b4380 con 0x7fece4160520 2024-05-14T14:41:05.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.075+0000 7fece0ff9640 1 -- 172.21.15.39:0/452606771 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+16895 (secure 0 0 0) 0x7fece4160e70 con 0x7fece4160520 2024-05-14T14:41:05.060 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:41:05.060 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":35,"fsid":"d7983fec-79c7-4991-b19c-1aecead64611","created":"2024-05-14T14:39:52.157167+0000","modified":"2024-05-14T14:41:04.091131+0000","last_up_change":"2024-05-14T14:40:03.848608+0000","last_in_change":"2024-05-14T14:39:54.591920+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T14:40:04.692846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-14T14:41:02.189579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-14T14:41:03.042095+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c4ec4534-6301-4dd7-b4d6-d560b096d442","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6801","nonce":4023478848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6803","nonce":4023478848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6807","nonce":4023478848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6805","nonce":4023478848}]},"public_addr":"172.21.15.39:6801/4023478848","cluster_addr":"172.21.15.39:6803/4023478848","heartbeat_back_addr":"172.21.15.39:6807/4023478848","heartbeat_front_addr":"172.21.15.39:6805/4023478848","state":["exists","up"]},{"osd":1,"uuid":"93f91b0e-096e-4bdf-aed0-d1136f73f136","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6817","nonce":926357398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6819","nonce":926357398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6823","nonce":926357398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6821","nonce":926357398}]},"public_addr":"172.21.15.39:6817/926357398","cluster_addr":"172.21.15.39:6819/926357398","heartbeat_back_addr":"172.21.15.39:6823/926357398","heartbeat_front_addr":"172.21.15.39:6821/926357398","state":["exists","up"]},{"osd":2,"uuid":"c590b1e0-67eb-452e-8e80-d2208da17d09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6809","nonce":610616754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6811","nonce":610616754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6815","nonce":610616754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6813","nonce":610616754}]},"public_addr":"172.21.15.39:6809/610616754","cluster_addr":"172.21.15.39:6811/610616754","heartbeat_back_addr":"172.21.15.39:6815/610616754","heartbeat_front_addr":"172.21.15.39:6813/610616754","state":["exists","up"]},{"osd":3,"uuid":"d57661b0-44f6-4355-9115-83eceb9b8f71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6825","nonce":1469314579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6827","nonce":1469314579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6831","nonce":1469314579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6829","nonce":1469314579}]},"public_addr":"172.21.15.39:6825/1469314579","cluster_addr":"172.21.15.39:6827/1469314579","heartbeat_back_addr":"172.21.15.39:6831/1469314579","heartbeat_front_addr":"172.21.15.39:6829/1469314579","state":["exists","up"]},{"osd":4,"uuid":"b131436f-f6e1-4d72-a86e-de200afdcebb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6825","nonce":3481507129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6827","nonce":3481507129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6831","nonce":3481507129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6829","nonce":3481507129}]},"public_addr":"172.21.15.62:6825/3481507129","cluster_addr":"172.21.15.62:6827/3481507129","heartbeat_back_addr":"172.21.15.62:6831/3481507129","heartbeat_front_addr":"172.21.15.62:6829/3481507129","state":["exists","up"]},{"osd":5,"uuid":"12e10b40-28b1-410f-9ce0-7b427daa111e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6801","nonce":3291934116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6803","nonce":3291934116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6807","nonce":3291934116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6805","nonce":3291934116}]},"public_addr":"172.21.15.62:6801/3291934116","cluster_addr":"172.21.15.62:6803/3291934116","heartbeat_back_addr":"172.21.15.62:6807/3291934116","heartbeat_front_addr":"172.21.15.62:6805/3291934116","state":["exists","up"]},{"osd":6,"uuid":"ad8950a5-70bd-488c-8f29-010515cc4a04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6817","nonce":3005996101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6819","nonce":3005996101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6823","nonce":3005996101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6821","nonce":3005996101}]},"public_addr":"172.21.15.62:6817/3005996101","cluster_addr":"172.21.15.62:6819/3005996101","heartbeat_back_addr":"172.21.15.62:6823/3005996101","heartbeat_front_addr":"172.21.15.62:6821/3005996101","state":["exists","up"]},{"osd":7,"uuid":"e0d4b8b7-3c80-4760-a342-1d508cdecc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6809","nonce":2800379225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6811","nonce":2800379225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6815","nonce":2800379225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6813","nonce":2800379225}]},"public_addr":"172.21.15.62:6809/2800379225","cluster_addr":"172.21.15.62:6811/2800379225","heartbeat_back_addr":"172.21.15.62:6815/2800379225","heartbeat_front_addr":"172.21.15.62:6813/2800379225","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.773714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.760037+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.811225+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.752810+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.745165+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.700634+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.768477+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.747301+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T14:41:05.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.077+0000 7fecea3dc640 1 -- 172.21.15.39:0/452606771 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fecd00762d0 msgr2=0x7fecd00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:05.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.077+0000 7fecea3dc640 1 --2- 172.21.15.39:0/452606771 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fecd00762d0 0x7fecd00787e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fecd4000f60 tx=0x7fecd4009040 comp rx=0 tx=0).stop 2024-05-14T14:41:05.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.078+0000 7fecea3dc640 1 -- 172.21.15.39:0/452606771 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fece4160520 msgr2=0x7fece4160930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:05.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.078+0000 7fecea3dc640 1 --2- 172.21.15.39:0/452606771 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fece4160520 0x7fece4160930 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fecdc009eb0 tx=0x7fecdc004a40 comp rx=0 tx=0).stop 2024-05-14T14:41:05.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.078+0000 7fecea3dc640 1 -- 172.21.15.39:0/452606771 shutdown_connections 2024-05-14T14:41:05.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.078+0000 7fecea3dc640 1 --2- 172.21.15.39:0/452606771 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fecd00762d0 0x7fecd00787e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:05.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.078+0000 7fecea3dc640 1 --2- 172.21.15.39:0/452606771 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fece4160520 0x7fece4160930 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:05.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.078+0000 7fecea3dc640 1 --2- 172.21.15.39:0/452606771 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fece4161c00 0x7fece40b55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:05.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.078+0000 7fecea3dc640 1 --2- 172.21.15.39:0/452606771 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fece40d02c0 0x7fece40ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:05.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.078+0000 7fecea3dc640 1 -- 172.21.15.39:0/452606771 >> 172.21.15.39:0/452606771 conn(0x7fece4071680 msgr2=0x7fece40d2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:05.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.078+0000 7fecea3dc640 1 -- 172.21.15.39:0/452606771 shutdown_connections 2024-05-14T14:41:05.063 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.078+0000 7fecea3dc640 1 -- 172.21.15.39:0/452606771 wait complete. 2024-05-14T14:41:05.075 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T14:41:05.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.206+0000 7fcf8dd9d640 1 Processor -- start 2024-05-14T14:41:05.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.206+0000 7fcf8dd9d640 1 -- start start 2024-05-14T14:41:05.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.208+0000 7fcf8dd9d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf880d4d70 0x7fcf880d5180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:05.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.208+0000 7fcf8dd9d640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf8806c8b0 con 0x7fcf880d0bc0 2024-05-14T14:41:05.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.208+0000 7fcf8dd9d640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf8806cb90 con 0x7fcf880b4cc0 2024-05-14T14:41:05.193 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.208+0000 7fcf8dd9d640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fcf8806e060 con 0x7fcf880d4d70 2024-05-14T14:41:05.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.208+0000 7fcf8d59c640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fcf880d0bc0 0x7fcf880d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:54152/0 (socket says 172.21.15.39:54152) 2024-05-14T14:41:05.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.208+0000 7fcf8d59c640 1 -- 172.21.15.39:0/4216700726 learned_addr learned my addr 172.21.15.39:0/4216700726 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:41:05.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.208+0000 7fcf87fff640 1 --2- 172.21.15.39:0/4216700726 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf880d4d70 0x7fcf880d5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:05.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.208+0000 7fcf877fe640 1 -- 172.21.15.39:0/4216700726 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 754753279 0 0) 0x7fcf8806c8b0 con 0x7fcf880d0bc0 2024-05-14T14:41:05.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.208+0000 7fcf877fe640 1 -- 172.21.15.39:0/4216700726 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf70003520 con 0x7fcf880d0bc0 2024-05-14T14:41:05.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.209+0000 7fcf877fe640 1 -- 172.21.15.39:0/4216700726 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1392316780 0 0) 0x7fcf8806cb90 con 0x7fcf880b4cc0 2024-05-14T14:41:05.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.209+0000 7fcf87fff640 1 -- 172.21.15.39:0/4216700726 >> v1:172.21.15.62:6789/0 conn(0x7fcf880b4cc0 legacy=0x7fcf8806d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:05.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.209+0000 7fcf87fff640 1 -- 172.21.15.39:0/4216700726 >> v1:172.21.15.39:6789/0 conn(0x7fcf880d0bc0 legacy=0x7fcf880d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:05.194 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.209+0000 7fcf87fff640 1 -- 172.21.15.39:0/4216700726 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf8806ce70 con 0x7fcf880d4d70 2024-05-14T14:41:05.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.209+0000 7fcf87fff640 1 --2- 172.21.15.39:0/4216700726 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf880d4d70 0x7fcf880d5180 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c0097d0 tx=0x7fcf7c02a0e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=486902542a8cf927 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:05.195 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.210+0000 7fcf877fe640 1 -- 172.21.15.39:0/4216700726 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c037070 con 0x7fcf880d4d70 2024-05-14T14:41:05.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.210+0000 7fcf877fe640 1 -- 172.21.15.39:0/4216700726 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf7c02ab70 con 0x7fcf880d4d70 2024-05-14T14:41:05.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.210+0000 7fcf877fe640 1 -- 172.21.15.39:0/4216700726 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf80001a90 con 0x7fcf880d4d70 2024-05-14T14:41:05.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.210+0000 7fcf8dd9d640 1 -- 172.21.15.39:0/4216700726 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf880d4d70 msgr2=0x7fcf880d5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:05.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.210+0000 7fcf8dd9d640 1 --2- 172.21.15.39:0/4216700726 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf880d4d70 0x7fcf880d5180 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c0097d0 tx=0x7fcf7c02a0e0 comp rx=0 tx=0).stop 2024-05-14T14:41:05.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.210+0000 7fcf8dd9d640 1 -- 172.21.15.39:0/4216700726 shutdown_connections 2024-05-14T14:41:05.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.210+0000 7fcf8dd9d640 1 --2- 172.21.15.39:0/4216700726 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf880d4d70 0x7fcf880d5180 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:05.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.210+0000 7fcf8dd9d640 1 -- 172.21.15.39:0/4216700726 >> 172.21.15.39:0/4216700726 conn(0x7fcf880d6140 msgr2=0x7fcf880b7600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:05.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.210+0000 7fcf8dd9d640 1 -- 172.21.15.39:0/4216700726 shutdown_connections 2024-05-14T14:41:05.196 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.210+0000 7fcf8dd9d640 1 -- 172.21.15.39:0/4216700726 wait complete. 2024-05-14T14:41:05.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.212+0000 7fcf8dd9d640 1 Processor -- start 2024-05-14T14:41:05.197 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.212+0000 7fcf8dd9d640 1 -- start start 2024-05-14T14:41:05.199 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.214+0000 7fcf8dd9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf880b4cc0 0x7fcf881f9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:05.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.214+0000 7fcf8dd9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf880d0bc0 0x7fcf881fa050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:05.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.214+0000 7fcf8dd9d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf880d4d70 0x7fcf880b68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:05.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.214+0000 7fcf8dd9d640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fcf880b50d0 con 0x7fcf880d0bc0 2024-05-14T14:41:05.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.214+0000 7fcf8dd9d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8806d430 con 0x7fcf880b4cc0 2024-05-14T14:41:05.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.214+0000 7fcf8dd9d640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fcf880b91e0 con 0x7fcf880d4d70 2024-05-14T14:41:05.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.214+0000 7fcf87fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf880d0bc0 0x7fcf881fa050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:05.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.214+0000 7fcf87fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf880d0bc0 0x7fcf881fa050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48620/0 (socket says 172.21.15.39:48620) 2024-05-14T14:41:05.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.214+0000 7fcf87fff640 1 -- 172.21.15.39:0/3536560335 learned_addr learned my addr 172.21.15.39:0/3536560335 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:41:05.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.214+0000 7fcf8cd9b640 1 --2- 172.21.15.39:0/3536560335 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf880b4cc0 0x7fcf881f9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:05.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.214+0000 7fcf8d59c640 1 --2- 172.21.15.39:0/3536560335 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf880d4d70 0x7fcf880b68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:05.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.214+0000 7fcf87fff640 1 -- 172.21.15.39:0/3536560335 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf880d4d70 msgr2=0x7fcf880b68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:05.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.214+0000 7fcf87fff640 1 --2- 172.21.15.39:0/3536560335 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf880d4d70 0x7fcf880b68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:05.200 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.214+0000 7fcf87fff640 1 -- 172.21.15.39:0/3536560335 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf880b4cc0 msgr2=0x7fcf881f9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:05.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.214+0000 7fcf87fff640 1 --2- 172.21.15.39:0/3536560335 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf880b4cc0 0x7fcf881f9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:05.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.214+0000 7fcf87fff640 1 -- 172.21.15.39:0/3536560335 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf881fa8d0 con 0x7fcf880d0bc0 2024-05-14T14:41:05.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.214+0000 7fcf8d59c640 1 --2- 172.21.15.39:0/3536560335 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf880d4d70 0x7fcf880b68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:41:05.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.214+0000 7fcf87fff640 1 --2- 172.21.15.39:0/3536560335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf880d0bc0 0x7fcf881fa050 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c035040 tx=0x7fcf7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:05.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.214+0000 7fcf857fa640 1 -- 172.21.15.39:0/3536560335 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c037040 con 0x7fcf880d0bc0 2024-05-14T14:41:05.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.214+0000 7fcf857fa640 1 -- 172.21.15.39:0/3536560335 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf7c004030 con 0x7fcf880d0bc0 2024-05-14T14:41:05.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.215+0000 7fcf857fa640 1 -- 172.21.15.39:0/3536560335 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c004400 con 0x7fcf880d0bc0 2024-05-14T14:41:05.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.215+0000 7fcf8dd9d640 1 -- 172.21.15.39:0/3536560335 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf8814e450 con 0x7fcf880d0bc0 2024-05-14T14:41:05.201 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.215+0000 7fcf8dd9d640 1 -- 172.21.15.39:0/3536560335 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf8814ce50 con 0x7fcf880d0bc0 2024-05-14T14:41:05.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.215+0000 7fcf8dd9d640 1 -- 172.21.15.39:0/3536560335 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf88050870 con 0x7fcf880d0bc0 2024-05-14T14:41:05.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.216+0000 7fcf857fa640 1 -- 172.21.15.39:0/3536560335 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fcf7c03a040 con 0x7fcf880d0bc0 2024-05-14T14:41:05.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.217+0000 7fcf857fa640 1 --2- 172.21.15.39:0/3536560335 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fcf740762d0 0x7fcf740787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:05.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.217+0000 7fcf857fa640 1 -- 172.21.15.39:0/3536560335 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6101+0+0 (secure 0 0 0) 0x7fcf7c0b7c20 con 0x7fcf880d0bc0 2024-05-14T14:41:05.202 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.217+0000 7fcf8cd9b640 1 --2- 172.21.15.39:0/3536560335 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fcf740762d0 0x7fcf740787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:05.203 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.217+0000 7fcf8cd9b640 1 --2- 172.21.15.39:0/3536560335 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fcf740762d0 0x7fcf740787e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcf78007fd0 tx=0x7fcf78009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:05.206 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.221+0000 7fcf857fa640 1 -- 172.21.15.39:0/3536560335 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fcf7c042020 con 0x7fcf880d0bc0 2024-05-14T14:41:05.400 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.416+0000 7fcf8dd9d640 1 -- 172.21.15.39:0/3536560335 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcf881603e0 con 0x7fcf880d0bc0 2024-05-14T14:41:05.402 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.417+0000 7fcf857fa640 1 -- 172.21.15.39:0/3536560335 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+16895 (secure 0 0 0) 0x7fcf7c081360 con 0x7fcf880d0bc0 2024-05-14T14:41:05.402 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:41:05.402 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":35,"fsid":"d7983fec-79c7-4991-b19c-1aecead64611","created":"2024-05-14T14:39:52.157167+0000","modified":"2024-05-14T14:41:04.091131+0000","last_up_change":"2024-05-14T14:40:03.848608+0000","last_in_change":"2024-05-14T14:39:54.591920+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T14:40:04.692846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-14T14:41:02.189579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-14T14:41:03.042095+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c4ec4534-6301-4dd7-b4d6-d560b096d442","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6801","nonce":4023478848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6803","nonce":4023478848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6807","nonce":4023478848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6805","nonce":4023478848}]},"public_addr":"172.21.15.39:6801/4023478848","cluster_addr":"172.21.15.39:6803/4023478848","heartbeat_back_addr":"172.21.15.39:6807/4023478848","heartbeat_front_addr":"172.21.15.39:6805/4023478848","state":["exists","up"]},{"osd":1,"uuid":"93f91b0e-096e-4bdf-aed0-d1136f73f136","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6817","nonce":926357398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6819","nonce":926357398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6823","nonce":926357398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6821","nonce":926357398}]},"public_addr":"172.21.15.39:6817/926357398","cluster_addr":"172.21.15.39:6819/926357398","heartbeat_back_addr":"172.21.15.39:6823/926357398","heartbeat_front_addr":"172.21.15.39:6821/926357398","state":["exists","up"]},{"osd":2,"uuid":"c590b1e0-67eb-452e-8e80-d2208da17d09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6809","nonce":610616754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6811","nonce":610616754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6815","nonce":610616754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6813","nonce":610616754}]},"public_addr":"172.21.15.39:6809/610616754","cluster_addr":"172.21.15.39:6811/610616754","heartbeat_back_addr":"172.21.15.39:6815/610616754","heartbeat_front_addr":"172.21.15.39:6813/610616754","state":["exists","up"]},{"osd":3,"uuid":"d57661b0-44f6-4355-9115-83eceb9b8f71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6825","nonce":1469314579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6827","nonce":1469314579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6831","nonce":1469314579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6829","nonce":1469314579}]},"public_addr":"172.21.15.39:6825/1469314579","cluster_addr":"172.21.15.39:6827/1469314579","heartbeat_back_addr":"172.21.15.39:6831/1469314579","heartbeat_front_addr":"172.21.15.39:6829/1469314579","state":["exists","up"]},{"osd":4,"uuid":"b131436f-f6e1-4d72-a86e-de200afdcebb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6825","nonce":3481507129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6827","nonce":3481507129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6831","nonce":3481507129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6829","nonce":3481507129}]},"public_addr":"172.21.15.62:6825/3481507129","cluster_addr":"172.21.15.62:6827/3481507129","heartbeat_back_addr":"172.21.15.62:6831/3481507129","heartbeat_front_addr":"172.21.15.62:6829/3481507129","state":["exists","up"]},{"osd":5,"uuid":"12e10b40-28b1-410f-9ce0-7b427daa111e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6801","nonce":3291934116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6803","nonce":3291934116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6807","nonce":3291934116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6805","nonce":3291934116}]},"public_addr":"172.21.15.62:6801/3291934116","cluster_addr":"172.21.15.62:6803/3291934116","heartbeat_back_addr":"172.21.15.62:6807/3291934116","heartbeat_front_addr":"172.21.15.62:6805/3291934116","state":["exists","up"]},{"osd":6,"uuid":"ad8950a5-70bd-488c-8f29-010515cc4a04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6817","nonce":3005996101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6819","nonce":3005996101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6823","nonce":3005996101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6821","nonce":3005996101}]},"public_addr":"172.21.15.62:6817/3005996101","cluster_addr":"172.21.15.62:6819/3005996101","heartbeat_back_addr":"172.21.15.62:6823/3005996101","heartbeat_front_addr":"172.21.15.62:6821/3005996101","state":["exists","up"]},{"osd":7,"uuid":"e0d4b8b7-3c80-4760-a342-1d508cdecc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6809","nonce":2800379225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6811","nonce":2800379225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6815","nonce":2800379225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6813","nonce":2800379225}]},"public_addr":"172.21.15.62:6809/2800379225","cluster_addr":"172.21.15.62:6811/2800379225","heartbeat_back_addr":"172.21.15.62:6815/2800379225","heartbeat_front_addr":"172.21.15.62:6813/2800379225","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.773714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.760037+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.811225+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.752810+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.745165+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.700634+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.768477+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.747301+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T14:41:05.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.419+0000 7fcf8dd9d640 1 -- 172.21.15.39:0/3536560335 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fcf740762d0 msgr2=0x7fcf740787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:05.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.419+0000 7fcf8dd9d640 1 --2- 172.21.15.39:0/3536560335 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fcf740762d0 0x7fcf740787e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcf78007fd0 tx=0x7fcf78009040 comp rx=0 tx=0).stop 2024-05-14T14:41:05.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.419+0000 7fcf8dd9d640 1 -- 172.21.15.39:0/3536560335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf880d0bc0 msgr2=0x7fcf881fa050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:05.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.419+0000 7fcf8dd9d640 1 --2- 172.21.15.39:0/3536560335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf880d0bc0 0x7fcf881fa050 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c035040 tx=0x7fcf7c0046c0 comp rx=0 tx=0).stop 2024-05-14T14:41:05.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.419+0000 7fcf8dd9d640 1 -- 172.21.15.39:0/3536560335 shutdown_connections 2024-05-14T14:41:05.404 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.419+0000 7fcf8dd9d640 1 --2- 172.21.15.39:0/3536560335 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fcf740762d0 0x7fcf740787e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:05.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.419+0000 7fcf8dd9d640 1 --2- 172.21.15.39:0/3536560335 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fcf880d4d70 0x7fcf880b68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:05.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.419+0000 7fcf8dd9d640 1 --2- 172.21.15.39:0/3536560335 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fcf880d0bc0 0x7fcf881fa050 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:05.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.419+0000 7fcf8dd9d640 1 --2- 172.21.15.39:0/3536560335 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf880b4cc0 0x7fcf881f9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:05.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.419+0000 7fcf8dd9d640 1 -- 172.21.15.39:0/3536560335 >> 172.21.15.39:0/3536560335 conn(0x7fcf880d6140 msgr2=0x7fcf880b5c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:05.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.419+0000 7fcf8dd9d640 1 -- 172.21.15.39:0/3536560335 shutdown_connections 2024-05-14T14:41:05.405 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.419+0000 7fcf8dd9d640 1 -- 172.21.15.39:0/3536560335 wait complete. 2024-05-14T14:41:05.416 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-14T14:41:05.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.549+0000 7f8211ae0640 1 Processor -- start 2024-05-14T14:41:05.534 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.549+0000 7f8211ae0640 1 -- start start 2024-05-14T14:41:05.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.550+0000 7f8211ae0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f820c164320 0x7f820c164730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:05.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.550+0000 7f8211ae0640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f820c08cf50 con 0x7f820c0cfb20 2024-05-14T14:41:05.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.550+0000 7f8211ae0640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f820c161a40 con 0x7f820c072fd0 2024-05-14T14:41:05.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.550+0000 7f8211ae0640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f820c160910 con 0x7f820c164320 2024-05-14T14:41:05.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.550+0000 7f820b7fe640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f820c0cfb20 0x7f820c0b8250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:54162/0 (socket says 172.21.15.39:54162) 2024-05-14T14:41:05.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.551+0000 7f820b7fe640 1 -- 172.21.15.39:0/3148528770 learned_addr learned my addr 172.21.15.39:0/3148528770 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:41:05.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.551+0000 7f820bfff640 1 --2- 172.21.15.39:0/3148528770 >> v2:172.21.15.62:3300/0 conn(0x7f820c164320 0x7f820c164730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:05.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.551+0000 7f820a7fc640 1 -- 172.21.15.39:0/3148528770 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1199364087 0 0) 0x7f820c08cf50 con 0x7f820c0cfb20 2024-05-14T14:41:05.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.551+0000 7f820a7fc640 1 -- 172.21.15.39:0/3148528770 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81f4003520 con 0x7f820c0cfb20 2024-05-14T14:41:05.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.551+0000 7f820a7fc640 1 -- 172.21.15.39:0/3148528770 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2774751320 0 0) 0x7f81f4003520 con 0x7f820c0cfb20 2024-05-14T14:41:05.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.551+0000 7f820bfff640 1 -- 172.21.15.39:0/3148528770 >> v1:172.21.15.62:6789/0 conn(0x7f820c072fd0 legacy=0x7f820c0733e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:05.536 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.551+0000 7f820bfff640 1 -- 172.21.15.39:0/3148528770 >> v1:172.21.15.39:6789/0 conn(0x7f820c0cfb20 legacy=0x7f820c0b8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:05.537 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.551+0000 7f820bfff640 1 -- 172.21.15.39:0/3148528770 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f820c0d0140 con 0x7f820c164320 2024-05-14T14:41:05.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.552+0000 7f820bfff640 1 --2- 172.21.15.39:0/3148528770 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f820c164320 0x7f820c164730 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8204009d90 tx=0x7f820402a510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2311e3764ac8aa3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:05.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.552+0000 7f820a7fc640 1 -- 172.21.15.39:0/3148528770 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8204035020 con 0x7f820c164320 2024-05-14T14:41:05.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.552+0000 7f820a7fc640 1 -- 172.21.15.39:0/3148528770 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8204007540 con 0x7f820c164320 2024-05-14T14:41:05.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.552+0000 7f820a7fc640 1 -- 172.21.15.39:0/3148528770 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81fc001710 con 0x7f820c164320 2024-05-14T14:41:05.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.553+0000 7f8211ae0640 1 -- 172.21.15.39:0/3148528770 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f820c164320 msgr2=0x7f820c164730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:05.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.553+0000 7f8211ae0640 1 --2- 172.21.15.39:0/3148528770 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f820c164320 0x7f820c164730 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8204009d90 tx=0x7f820402a510 comp rx=0 tx=0).stop 2024-05-14T14:41:05.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.553+0000 7f8211ae0640 1 -- 172.21.15.39:0/3148528770 shutdown_connections 2024-05-14T14:41:05.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.553+0000 7f8211ae0640 1 --2- 172.21.15.39:0/3148528770 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f820c164320 0x7f820c164730 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:05.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.553+0000 7f8211ae0640 1 -- 172.21.15.39:0/3148528770 >> 172.21.15.39:0/3148528770 conn(0x7f820c0d3b00 msgr2=0x7f820c0d3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:05.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.553+0000 7f8211ae0640 1 -- 172.21.15.39:0/3148528770 shutdown_connections 2024-05-14T14:41:05.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.553+0000 7f8211ae0640 1 -- 172.21.15.39:0/3148528770 wait complete. 2024-05-14T14:41:05.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.555+0000 7f8211ae0640 1 Processor -- start 2024-05-14T14:41:05.539 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.555+0000 7f8211ae0640 1 -- start start 2024-05-14T14:41:05.542 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.556+0000 7f8211ae0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f820c072fd0 0x7f820c0ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:05.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.556+0000 7f8211ae0640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f820c0cfb20 0x7f820c0aea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:05.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.556+0000 7f8211ae0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f820c164320 0x7f820c0aef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:05.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.556+0000 7f8211ae0640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f820c0b6ad0 con 0x7f820c072fd0 2024-05-14T14:41:05.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.556+0000 7f8211ae0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f820c0b6950 con 0x7f820c164320 2024-05-14T14:41:05.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.556+0000 7f8211ae0640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f820c0b94a0 con 0x7f820c0cfb20 2024-05-14T14:41:05.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.556+0000 7f820b7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f820c072fd0 0x7f820c0ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:05.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.556+0000 7f820b7fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f820c072fd0 0x7f820c0ce8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48624/0 (socket says 172.21.15.39:48624) 2024-05-14T14:41:05.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.556+0000 7f820b7fe640 1 -- 172.21.15.39:0/2544705908 learned_addr learned my addr 172.21.15.39:0/2544705908 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:41:05.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.556+0000 7f820bfff640 1 --2- 172.21.15.39:0/2544705908 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f820c164320 0x7f820c0aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:05.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.556+0000 7f820affd640 1 --2- 172.21.15.39:0/2544705908 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f820c0cfb20 0x7f820c0aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:05.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.557+0000 7f820b7fe640 1 -- 172.21.15.39:0/2544705908 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f820c0cfb20 msgr2=0x7f820c0aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:05.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.557+0000 7f820b7fe640 1 --2- 172.21.15.39:0/2544705908 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f820c0cfb20 0x7f820c0aea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:05.543 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.557+0000 7f820b7fe640 1 -- 172.21.15.39:0/2544705908 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f820c164320 msgr2=0x7f820c0aef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:05.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.557+0000 7f820b7fe640 1 --2- 172.21.15.39:0/2544705908 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f820c164320 0x7f820c0aef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:05.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.557+0000 7f820b7fe640 1 -- 172.21.15.39:0/2544705908 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f820c0af720 con 0x7f820c072fd0 2024-05-14T14:41:05.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.557+0000 7f820b7fe640 1 --2- 172.21.15.39:0/2544705908 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f820c072fd0 0x7f820c0ce8c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f81fc00c4b0 tx=0x7f81fc00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:05.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.557+0000 7f81f3fff640 1 -- 172.21.15.39:0/2544705908 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81fc018070 con 0x7f820c072fd0 2024-05-14T14:41:05.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.557+0000 7f81f3fff640 1 -- 172.21.15.39:0/2544705908 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81fc0074e0 con 0x7f820c072fd0 2024-05-14T14:41:05.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.557+0000 7f8211ae0640 1 -- 172.21.15.39:0/2544705908 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f820c0b0400 con 0x7f820c072fd0 2024-05-14T14:41:05.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.557+0000 7f81f3fff640 1 -- 172.21.15.39:0/2544705908 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81fc004a20 con 0x7f820c072fd0 2024-05-14T14:41:05.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.557+0000 7f8211ae0640 1 -- 172.21.15.39:0/2544705908 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f820c0b09c0 con 0x7f820c072fd0 2024-05-14T14:41:05.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.558+0000 7f8211ae0640 1 -- 172.21.15.39:0/2544705908 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f820c076aa0 con 0x7f820c072fd0 2024-05-14T14:41:05.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.559+0000 7f81f3fff640 1 -- 172.21.15.39:0/2544705908 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f81fc01b070 con 0x7f820c072fd0 2024-05-14T14:41:05.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.559+0000 7f81f3fff640 1 --2- 172.21.15.39:0/2544705908 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f81f80762d0 0x7f81f80787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:05.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.559+0000 7f81f3fff640 1 -- 172.21.15.39:0/2544705908 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6101+0+0 (secure 0 0 0) 0x7f81fc096a60 con 0x7f820c072fd0 2024-05-14T14:41:05.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.559+0000 7f820affd640 1 --2- 172.21.15.39:0/2544705908 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f81f80762d0 0x7f81f80787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:05.545 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.560+0000 7f820affd640 1 --2- 172.21.15.39:0/2544705908 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f81f80762d0 0x7f81f80787e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f820c070b90 tx=0x7f8200009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:05.548 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.564+0000 7f81f3fff640 1 -- 172.21.15.39:0/2544705908 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f81fc05fbe0 con 0x7f820c072fd0 2024-05-14T14:41:05.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:05.798+0000 7f8211ae0640 1 -- 172.21.15.39:0/2544705908 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f820c0d3160 con 0x7f820c072fd0 2024-05-14T14:41:06.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.729+0000 7f81f3fff640 1 -- 172.21.15.39:0/2544705908 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7f81fc063ee0 con 0x7f820c072fd0 2024-05-14T14:41:06.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.732+0000 7f8211ae0640 1 -- 172.21.15.39:0/2544705908 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f81f80762d0 msgr2=0x7f81f80787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:06.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.732+0000 7f8211ae0640 1 --2- 172.21.15.39:0/2544705908 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f81f80762d0 0x7f81f80787e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f820c070b90 tx=0x7f8200009040 comp rx=0 tx=0).stop 2024-05-14T14:41:06.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.732+0000 7f8211ae0640 1 -- 172.21.15.39:0/2544705908 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f820c072fd0 msgr2=0x7f820c0ce8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:06.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.732+0000 7f8211ae0640 1 --2- 172.21.15.39:0/2544705908 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f820c072fd0 0x7f820c0ce8c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f81fc00c4b0 tx=0x7f81fc00c970 comp rx=0 tx=0).stop 2024-05-14T14:41:06.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.732+0000 7f8211ae0640 1 -- 172.21.15.39:0/2544705908 shutdown_connections 2024-05-14T14:41:06.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.732+0000 7f8211ae0640 1 --2- 172.21.15.39:0/2544705908 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f81f80762d0 0x7f81f80787e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:06.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.732+0000 7f8211ae0640 1 --2- 172.21.15.39:0/2544705908 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f820c164320 0x7f820c0aef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:06.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.732+0000 7f8211ae0640 1 --2- 172.21.15.39:0/2544705908 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f820c0cfb20 0x7f820c0aea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:06.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.732+0000 7f8211ae0640 1 --2- 172.21.15.39:0/2544705908 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f820c072fd0 0x7f820c0ce8c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:06.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.732+0000 7f8211ae0640 1 -- 172.21.15.39:0/2544705908 >> 172.21.15.39:0/2544705908 conn(0x7f820c0d3b00 msgr2=0x7f820c070050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:06.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.732+0000 7f8211ae0640 1 -- 172.21.15.39:0/2544705908 shutdown_connections 2024-05-14T14:41:06.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.732+0000 7f8211ae0640 1 -- 172.21.15.39:0/2544705908 wait complete. 2024-05-14T14:41:06.731 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-05-14T14:41:06.731 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-14T14:41:06.856 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.872+0000 7f2c3c372640 1 Processor -- start 2024-05-14T14:41:06.857 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.872+0000 7f2c3c372640 1 -- start start 2024-05-14T14:41:06.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.873+0000 7f2c3c372640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f2c340d4630 0x7f2c341601c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:06.858 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.873+0000 7f2c3c372640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2c340b98b0 0x7f2c3406dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:06.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.873+0000 7f2c3c372640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c3406c740 con 0x7f2c3406d7e0 2024-05-14T14:41:06.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.873+0000 7f2c3c372640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f2c34160700 con 0x7f2c340d4630 2024-05-14T14:41:06.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.873+0000 7f2c3c372640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f2c3406ca20 con 0x7f2c340b98b0 2024-05-14T14:41:06.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.873+0000 7f2c3a10e640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f2c340d4630 0x7f2c341601c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:06.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.873+0000 7f2c3a10e640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f2c340d4630 0x7f2c341601c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48626/0 (socket says 172.21.15.39:48626) 2024-05-14T14:41:06.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.873+0000 7f2c3a10e640 1 -- 172.21.15.39:0/2272580224 learned_addr learned my addr 172.21.15.39:0/2272580224 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:41:06.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.874+0000 7f2c3a90f640 1 --2- 172.21.15.39:0/2272580224 >> v2:172.21.15.62:3300/0 conn(0x7f2c340b98b0 0x7f2c3406dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:06.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.874+0000 7f2c3a10e640 1 -- 172.21.15.39:0/2272580224 >> v2:172.21.15.62:3300/0 conn(0x7f2c340b98b0 msgr2=0x7f2c3406dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:06.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.874+0000 7f2c3a10e640 1 --2- 172.21.15.39:0/2272580224 >> v2:172.21.15.62:3300/0 conn(0x7f2c340b98b0 0x7f2c3406dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:06.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.874+0000 7f2c3a10e640 1 -- 172.21.15.39:0/2272580224 >> v1:172.21.15.62:6789/0 conn(0x7f2c3406d7e0 legacy=0x7f2c340b91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:06.859 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.874+0000 7f2c3a10e640 1 -- 172.21.15.39:0/2272580224 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c3406cd00 con 0x7f2c340d4630 2024-05-14T14:41:06.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.874+0000 7f2c3a10e640 1 --2- 172.21.15.39:0/2272580224 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c340d4630 0x7f2c341601c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2c340d24e0 tx=0x7f2c2402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4cf9b536081153c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:06.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.875+0000 7f2c3910c640 1 -- 172.21.15.39:0/2272580224 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c24036070 con 0x7f2c340d4630 2024-05-14T14:41:06.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.875+0000 7f2c3910c640 1 -- 172.21.15.39:0/2272580224 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c24031600 con 0x7f2c340d4630 2024-05-14T14:41:06.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.875+0000 7f2c3910c640 1 -- 172.21.15.39:0/2272580224 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c240319d0 con 0x7f2c340d4630 2024-05-14T14:41:06.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.875+0000 7f2c3c372640 1 -- 172.21.15.39:0/2272580224 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c340d4630 msgr2=0x7f2c341601c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:06.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.875+0000 7f2c3c372640 1 --2- 172.21.15.39:0/2272580224 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c340d4630 0x7f2c341601c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2c340d24e0 tx=0x7f2c2402a730 comp rx=0 tx=0).stop 2024-05-14T14:41:06.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.875+0000 7f2c3c372640 1 -- 172.21.15.39:0/2272580224 shutdown_connections 2024-05-14T14:41:06.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.875+0000 7f2c3c372640 1 --2- 172.21.15.39:0/2272580224 >> v2:172.21.15.62:3300/0 conn(0x7f2c340b98b0 0x7f2c3406dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:06.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.875+0000 7f2c3c372640 1 --2- 172.21.15.39:0/2272580224 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c340d4630 0x7f2c341601c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:06.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.875+0000 7f2c3c372640 1 -- 172.21.15.39:0/2272580224 >> 172.21.15.39:0/2272580224 conn(0x7f2c340d6610 msgr2=0x7f2c340b7740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:06.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.876+0000 7f2c3c372640 1 -- 172.21.15.39:0/2272580224 shutdown_connections 2024-05-14T14:41:06.861 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.876+0000 7f2c3c372640 1 -- 172.21.15.39:0/2272580224 wait complete. 2024-05-14T14:41:06.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.877+0000 7f2c3c372640 1 Processor -- start 2024-05-14T14:41:06.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.877+0000 7f2c3c372640 1 -- start start 2024-05-14T14:41:06.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.879+0000 7f2c3c372640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c3406d7e0 0x7f2c340c8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:06.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.879+0000 7f2c3c372640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c340b98b0 0x7f2c34156320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:06.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.879+0000 7f2c3c372640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2c340d4630 0x7f2c34162cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:06.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.879+0000 7f2c3c372640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2c340d5510 con 0x7f2c340b98b0 2024-05-14T14:41:06.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.879+0000 7f2c3c372640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3406d2c0 con 0x7f2c3406d7e0 2024-05-14T14:41:06.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.879+0000 7f2c3c372640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f2c340d5690 con 0x7f2c340d4630 2024-05-14T14:41:06.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.879+0000 7f2c3990d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c340b98b0 0x7f2c34156320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:06.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.879+0000 7f2c3990d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c340b98b0 0x7f2c34156320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48630/0 (socket says 172.21.15.39:48630) 2024-05-14T14:41:06.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.879+0000 7f2c3990d640 1 -- 172.21.15.39:0/1698887785 learned_addr learned my addr 172.21.15.39:0/1698887785 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:41:06.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.879+0000 7f2c3a10e640 1 --2- 172.21.15.39:0/1698887785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c3406d7e0 0x7f2c340c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:06.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.879+0000 7f2c3a90f640 1 --2- 172.21.15.39:0/1698887785 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2c340d4630 0x7f2c34162cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:06.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.879+0000 7f2c3990d640 1 -- 172.21.15.39:0/1698887785 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2c340d4630 msgr2=0x7f2c34162cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:06.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.879+0000 7f2c3990d640 1 --2- 172.21.15.39:0/1698887785 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2c340d4630 0x7f2c34162cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:06.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.879+0000 7f2c3990d640 1 -- 172.21.15.39:0/1698887785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c3406d7e0 msgr2=0x7f2c340c8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:06.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.879+0000 7f2c3990d640 1 --2- 172.21.15.39:0/1698887785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c3406d7e0 0x7f2c340c8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:06.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.879+0000 7f2c3990d640 1 -- 172.21.15.39:0/1698887785 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c34158780 con 0x7f2c340b98b0 2024-05-14T14:41:06.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.879+0000 7f2c3990d640 1 --2- 172.21.15.39:0/1698887785 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c340b98b0 0x7f2c34156320 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2c2800c340 tx=0x7f2c2800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:06.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.879+0000 7f2c32ffd640 1 -- 172.21.15.39:0/1698887785 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c28017070 con 0x7f2c340b98b0 2024-05-14T14:41:06.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.879+0000 7f2c32ffd640 1 -- 172.21.15.39:0/1698887785 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c280052d0 con 0x7f2c340b98b0 2024-05-14T14:41:06.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.879+0000 7f2c3c372640 1 -- 172.21.15.39:0/1698887785 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c34158a60 con 0x7f2c340b98b0 2024-05-14T14:41:06.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.879+0000 7f2c32ffd640 1 -- 172.21.15.39:0/1698887785 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c28003810 con 0x7f2c340b98b0 2024-05-14T14:41:06.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.880+0000 7f2c3c372640 1 -- 172.21.15.39:0/1698887785 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c34159020 con 0x7f2c340b98b0 2024-05-14T14:41:06.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.880+0000 7f2c3c372640 1 -- 172.21.15.39:0/1698887785 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c34076aa0 con 0x7f2c340b98b0 2024-05-14T14:41:06.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.881+0000 7f2c32ffd640 1 -- 172.21.15.39:0/1698887785 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2c2801a070 con 0x7f2c340b98b0 2024-05-14T14:41:06.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.882+0000 7f2c32ffd640 1 --2- 172.21.15.39:0/1698887785 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f2c200762d0 0x7f2c200787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:06.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.882+0000 7f2c32ffd640 1 -- 172.21.15.39:0/1698887785 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7f2c28096b20 con 0x7f2c340b98b0 2024-05-14T14:41:06.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.882+0000 7f2c3a10e640 1 --2- 172.21.15.39:0/1698887785 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f2c200762d0 0x7f2c200787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:06.867 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.882+0000 7f2c3a10e640 1 --2- 172.21.15.39:0/1698887785 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f2c200762d0 0x7f2c200787e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2c24033000 tx=0x7f2c24009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:06.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:06.886+0000 7f2c32ffd640 1 -- 172.21.15.39:0/1698887785 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f2c28060260 con 0x7f2c340b98b0 2024-05-14T14:41:07.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.115+0000 7f2c3c372640 1 -- 172.21.15.39:0/1698887785 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f2c340d40c0 con 0x7f2c340b98b0 2024-05-14T14:41:07.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.738+0000 7f2c32ffd640 1 -- 172.21.15.39:0/1698887785 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7f2c280682e0 con 0x7f2c340b98b0 2024-05-14T14:41:07.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.741+0000 7f2c3c372640 1 -- 172.21.15.39:0/1698887785 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f2c200762d0 msgr2=0x7f2c200787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:07.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.741+0000 7f2c3c372640 1 --2- 172.21.15.39:0/1698887785 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f2c200762d0 0x7f2c200787e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2c24033000 tx=0x7f2c24009000 comp rx=0 tx=0).stop 2024-05-14T14:41:07.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.741+0000 7f2c3c372640 1 -- 172.21.15.39:0/1698887785 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c340b98b0 msgr2=0x7f2c34156320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:07.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.741+0000 7f2c3c372640 1 --2- 172.21.15.39:0/1698887785 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c340b98b0 0x7f2c34156320 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2c2800c340 tx=0x7f2c2800c800 comp rx=0 tx=0).stop 2024-05-14T14:41:07.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.741+0000 7f2c3c372640 1 -- 172.21.15.39:0/1698887785 shutdown_connections 2024-05-14T14:41:07.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.741+0000 7f2c3c372640 1 --2- 172.21.15.39:0/1698887785 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f2c200762d0 0x7f2c200787e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:07.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.741+0000 7f2c3c372640 1 --2- 172.21.15.39:0/1698887785 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2c340d4630 0x7f2c34162cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:07.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.741+0000 7f2c3c372640 1 --2- 172.21.15.39:0/1698887785 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2c340b98b0 0x7f2c34156320 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:07.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.741+0000 7f2c3c372640 1 --2- 172.21.15.39:0/1698887785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2c3406d7e0 0x7f2c340c8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:07.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.741+0000 7f2c3c372640 1 -- 172.21.15.39:0/1698887785 >> 172.21.15.39:0/1698887785 conn(0x7f2c340d6610 msgr2=0x7f2c3415de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:07.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.741+0000 7f2c3c372640 1 -- 172.21.15.39:0/1698887785 shutdown_connections 2024-05-14T14:41:07.727 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.741+0000 7f2c3c372640 1 -- 172.21.15.39:0/1698887785 wait complete. 2024-05-14T14:41:07.739 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-14T14:41:07.739 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T14:41:07.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.875+0000 7f70941c0640 1 Processor -- start 2024-05-14T14:41:07.860 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.876+0000 7f70941c0640 1 -- start start 2024-05-14T14:41:07.862 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.877+0000 7f70941c0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f708c164000 0x7f708c0ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:07.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.877+0000 7f70941c0640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f708c0b6930 0x7f708c160490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:07.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.877+0000 7f70941c0640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f708c072fd0 0x7f708c0733e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:07.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.877+0000 7f70941c0640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f708c073920 con 0x7f708c0b6930 2024-05-14T14:41:07.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.877+0000 7f70941c0640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f708c164550 con 0x7f708c164000 2024-05-14T14:41:07.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.877+0000 7f70941c0640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f708c164830 con 0x7f708c072fd0 2024-05-14T14:41:07.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.877+0000 7f709175b640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f708c0b6930 0x7f708c160490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:07.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.877+0000 7f709175b640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f708c0b6930 0x7f708c160490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48642/0 (socket says 172.21.15.39:48642) 2024-05-14T14:41:07.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.877+0000 7f709175b640 1 -- 172.21.15.39:0/3332023063 learned_addr learned my addr 172.21.15.39:0/3332023063 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:41:07.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.877+0000 7f7091f5c640 1 --2- 172.21.15.39:0/3332023063 >> v2:172.21.15.62:3300/0 conn(0x7f708c164000 0x7f708c0ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:07.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.877+0000 7f709275d640 1 --2- 172.21.15.39:0/3332023063 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f708c072fd0 0x7f708c0733e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:07.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.877+0000 7f709175b640 1 -- 172.21.15.39:0/3332023063 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f708c072fd0 msgr2=0x7f708c0733e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:07.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.877+0000 7f709175b640 1 --2- 172.21.15.39:0/3332023063 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f708c072fd0 0x7f708c0733e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:07.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.877+0000 7f709175b640 1 -- 172.21.15.39:0/3332023063 >> v2:172.21.15.62:3300/0 conn(0x7f708c164000 msgr2=0x7f708c0ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:07.863 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.877+0000 7f709175b640 1 --2- 172.21.15.39:0/3332023063 >> v2:172.21.15.62:3300/0 conn(0x7f708c164000 0x7f708c0ce130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:07.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.877+0000 7f709175b640 1 -- 172.21.15.39:0/3332023063 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f708c164b10 con 0x7f708c0b6930 2024-05-14T14:41:07.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.877+0000 7f7091f5c640 1 --2- 172.21.15.39:0/3332023063 >> v2:172.21.15.62:3300/0 conn(0x7f708c164000 0x7f708c0ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:41:07.864 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.878+0000 7f709175b640 1 --2- 172.21.15.39:0/3332023063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f708c0b6930 0x7f708c160490 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f708c074dc0 tx=0x7f708002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=767241e734c24529 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:07.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.878+0000 7f7090f5a640 1 -- 172.21.15.39:0/3332023063 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7080037070 con 0x7f708c0b6930 2024-05-14T14:41:07.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.878+0000 7f7090f5a640 1 -- 172.21.15.39:0/3332023063 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7080032440 con 0x7f708c0b6930 2024-05-14T14:41:07.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.878+0000 7f7090f5a640 1 -- 172.21.15.39:0/3332023063 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7080032810 con 0x7f708c0b6930 2024-05-14T14:41:07.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.879+0000 7f70941c0640 1 -- 172.21.15.39:0/3332023063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f708c0b6930 msgr2=0x7f708c160490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:07.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.879+0000 7f70941c0640 1 --2- 172.21.15.39:0/3332023063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f708c0b6930 0x7f708c160490 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f708c074dc0 tx=0x7f708002a1e0 comp rx=0 tx=0).stop 2024-05-14T14:41:07.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.879+0000 7f70941c0640 1 -- 172.21.15.39:0/3332023063 shutdown_connections 2024-05-14T14:41:07.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.879+0000 7f70941c0640 1 --2- 172.21.15.39:0/3332023063 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f708c0b6930 0x7f708c160490 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:07.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.879+0000 7f70941c0640 1 --2- 172.21.15.39:0/3332023063 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f708c072fd0 0x7f708c0733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:07.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.879+0000 7f70941c0640 1 --2- 172.21.15.39:0/3332023063 >> v2:172.21.15.62:3300/0 conn(0x7f708c164000 0x7f708c0ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:07.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.879+0000 7f70941c0640 1 -- 172.21.15.39:0/3332023063 >> 172.21.15.39:0/3332023063 conn(0x7f708c0d3ae0 msgr2=0x7f708c0d3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:07.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.879+0000 7f70941c0640 1 -- 172.21.15.39:0/3332023063 shutdown_connections 2024-05-14T14:41:07.865 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.879+0000 7f70941c0640 1 -- 172.21.15.39:0/3332023063 wait complete. 2024-05-14T14:41:07.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.881+0000 7f70941c0640 1 Processor -- start 2024-05-14T14:41:07.866 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.881+0000 7f70941c0640 1 -- start start 2024-05-14T14:41:07.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.882+0000 7f70941c0640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f708c072fd0 0x7f708c1e9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:07.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.882+0000 7f70941c0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f708c0b6930 0x7f708c1f63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:07.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.882+0000 7f70941c0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f708c164000 0x7f708c1f9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:07.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.882+0000 7f70941c0640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f708c0b8390 con 0x7f708c164000 2024-05-14T14:41:07.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.882+0000 7f70941c0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f708c0b8210 con 0x7f708c0b6930 2024-05-14T14:41:07.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.882+0000 7f70941c0640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f708c0d3490 con 0x7f708c072fd0 2024-05-14T14:41:07.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.883+0000 7f709275d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f708c164000 0x7f708c1f9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:07.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.883+0000 7f709275d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f708c164000 0x7f708c1f9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48652/0 (socket says 172.21.15.39:48652) 2024-05-14T14:41:07.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.883+0000 7f709275d640 1 -- 172.21.15.39:0/3844337704 learned_addr learned my addr 172.21.15.39:0/3844337704 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:41:07.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.883+0000 7f7091f5c640 1 --2- 172.21.15.39:0/3844337704 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f708c072fd0 0x7f708c1e9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:07.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.883+0000 7f709175b640 1 --2- 172.21.15.39:0/3844337704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f708c0b6930 0x7f708c1f63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:07.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.883+0000 7f709275d640 1 -- 172.21.15.39:0/3844337704 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f708c072fd0 msgr2=0x7f708c1e9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:07.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.883+0000 7f709275d640 1 --2- 172.21.15.39:0/3844337704 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f708c072fd0 0x7f708c1e9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:07.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.883+0000 7f709275d640 1 -- 172.21.15.39:0/3844337704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f708c0b6930 msgr2=0x7f708c1f63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:07.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.883+0000 7f709275d640 1 --2- 172.21.15.39:0/3844337704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f708c0b6930 0x7f708c1f63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:07.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.883+0000 7f709275d640 1 -- 172.21.15.39:0/3844337704 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f708c06eac0 con 0x7f708c164000 2024-05-14T14:41:07.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.883+0000 7f709175b640 1 --2- 172.21.15.39:0/3844337704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f708c0b6930 0x7f708c1f63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:41:07.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.883+0000 7f709275d640 1 --2- 172.21.15.39:0/3844337704 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f708c164000 0x7f708c1f9f70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f708400d500 tx=0x7f708400d9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:07.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.883+0000 7f708a7fc640 1 -- 172.21.15.39:0/3844337704 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7084018020 con 0x7f708c164000 2024-05-14T14:41:07.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.883+0000 7f708a7fc640 1 -- 172.21.15.39:0/3844337704 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7084014620 con 0x7f708c164000 2024-05-14T14:41:07.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.883+0000 7f70941c0640 1 -- 172.21.15.39:0/3844337704 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f708c06eda0 con 0x7f708c164000 2024-05-14T14:41:07.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.883+0000 7f708a7fc640 1 -- 172.21.15.39:0/3844337704 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7084014a10 con 0x7f708c164000 2024-05-14T14:41:07.869 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.883+0000 7f70941c0640 1 -- 172.21.15.39:0/3844337704 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f708c06f360 con 0x7f708c164000 2024-05-14T14:41:07.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.884+0000 7f70941c0640 1 -- 172.21.15.39:0/3844337704 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f708c06e830 con 0x7f708c164000 2024-05-14T14:41:07.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.885+0000 7f708a7fc640 1 -- 172.21.15.39:0/3844337704 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f708401b020 con 0x7f708c164000 2024-05-14T14:41:07.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.886+0000 7f708a7fc640 1 --2- 172.21.15.39:0/3844337704 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f7078076300 0x7f7078078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:07.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.886+0000 7f708a7fc640 1 -- 172.21.15.39:0/3844337704 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7f7084097a90 con 0x7f708c164000 2024-05-14T14:41:07.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.886+0000 7f7091f5c640 1 --2- 172.21.15.39:0/3844337704 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f7078076300 0x7f7078078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:07.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.886+0000 7f7091f5c640 1 --2- 172.21.15.39:0/3844337704 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f7078076300 0x7f7078078810 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f707c009fd0 tx=0x7f707c0097f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:07.875 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:07.890+0000 7f708a7fc640 1 -- 172.21.15.39:0/3844337704 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f7084022020 con 0x7f708c164000 2024-05-14T14:41:08.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.122+0000 7f70941c0640 1 -- 172.21.15.39:0/3844337704 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f708c076aa0 con 0x7f708c164000 2024-05-14T14:41:08.107 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.123+0000 7f708a7fc640 1 -- 172.21.15.39:0/3844337704 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5178 (secure 0 0 0) 0x7f7084061270 con 0x7f708c164000 2024-05-14T14:41:08.108 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:41:08.108 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4804,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/811834490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6835","nonce":811834490},{"type":"v1","addr":"172.21.15.39:6837","nonce":811834490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4807,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/3956392973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3956392973},{"type":"v1","addr":"172.21.15.62:6834","nonce":3956392973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4896,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6836/1104312337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":1104312337},{"type":"v1","addr":"172.21.15.39:6836","nonce":1104312337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T14:41:04.091088+0000","modified":"2024-05-14T14:41:07.117999+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4905},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4905":{"gid":4905,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/2640607791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":2640607791},{"type":"v1","addr":"172.21.15.62:6835","nonce":2640607791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4905,"qdb_cluster":[4905]},"id":2}]} 2024-05-14T14:41:08.108 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 18 2024-05-14T14:41:08.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.125+0000 7f70941c0640 1 -- 172.21.15.39:0/3844337704 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f7078076300 msgr2=0x7f7078078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:08.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.125+0000 7f70941c0640 1 --2- 172.21.15.39:0/3844337704 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f7078076300 0x7f7078078810 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f707c009fd0 tx=0x7f707c0097f0 comp rx=0 tx=0).stop 2024-05-14T14:41:08.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.125+0000 7f70941c0640 1 -- 172.21.15.39:0/3844337704 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f708c164000 msgr2=0x7f708c1f9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:08.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.125+0000 7f70941c0640 1 --2- 172.21.15.39:0/3844337704 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f708c164000 0x7f708c1f9f70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f708400d500 tx=0x7f708400d9c0 comp rx=0 tx=0).stop 2024-05-14T14:41:08.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.125+0000 7f70941c0640 1 -- 172.21.15.39:0/3844337704 shutdown_connections 2024-05-14T14:41:08.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.125+0000 7f70941c0640 1 --2- 172.21.15.39:0/3844337704 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f7078076300 0x7f7078078810 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:08.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.125+0000 7f70941c0640 1 --2- 172.21.15.39:0/3844337704 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f708c164000 0x7f708c1f9f70 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:08.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.125+0000 7f70941c0640 1 --2- 172.21.15.39:0/3844337704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f708c0b6930 0x7f708c1f63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:08.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.125+0000 7f70941c0640 1 --2- 172.21.15.39:0/3844337704 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f708c072fd0 0x7f708c1e9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:08.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.125+0000 7f70941c0640 1 -- 172.21.15.39:0/3844337704 >> 172.21.15.39:0/3844337704 conn(0x7f708c0d3ae0 msgr2=0x7f708c15acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:08.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.125+0000 7f70941c0640 1 -- 172.21.15.39:0/3844337704 shutdown_connections 2024-05-14T14:41:08.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.125+0000 7f70941c0640 1 -- 172.21.15.39:0/3844337704 wait complete. 2024-05-14T14:41:08.121 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T14:41:08.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.251+0000 7fb84db34640 1 Processor -- start 2024-05-14T14:41:08.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.251+0000 7fb84db34640 1 -- start start 2024-05-14T14:41:08.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.253+0000 7fb84db34640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb848164000 0x7fb8480ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:08.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.253+0000 7fb84db34640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8480736e0 0x7fb848160490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:08.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.253+0000 7fb84db34640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb848164550 con 0x7fb8480b6930 2024-05-14T14:41:08.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.253+0000 7fb84db34640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fb848164830 con 0x7fb848164000 2024-05-14T14:41:08.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.253+0000 7fb84db34640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fb848164b10 con 0x7fb8480736e0 2024-05-14T14:41:08.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.253+0000 7fb8477fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb848164000 0x7fb8480ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:08.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.253+0000 7fb847fff640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8480736e0 0x7fb848160490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:08.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.253+0000 7fb8477fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb848164000 0x7fb8480ce130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.39:36866/0 (socket says 172.21.15.39:36866) 2024-05-14T14:41:08.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.253+0000 7fb8477fe640 1 -- 172.21.15.39:0/652117343 learned_addr learned my addr 172.21.15.39:0/652117343 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:41:08.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.253+0000 7fb846ffd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb8480b6930 0x7fb848072fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.39:53546/0 (socket says 172.21.15.39:53546) 2024-05-14T14:41:08.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.254+0000 7fb847fff640 1 -- 172.21.15.39:0/652117343 >> v2:172.21.15.62:3300/0 conn(0x7fb848164000 msgr2=0x7fb8480ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:08.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.254+0000 7fb847fff640 1 --2- 172.21.15.39:0/652117343 >> v2:172.21.15.62:3300/0 conn(0x7fb848164000 0x7fb8480ce130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:08.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.254+0000 7fb847fff640 1 -- 172.21.15.39:0/652117343 >> v1:172.21.15.62:6789/0 conn(0x7fb8480b6930 legacy=0x7fb848072fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:08.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.254+0000 7fb8467fc640 1 -- 172.21.15.39:0/652117343 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 556744216 0 0) 0x7fb848164550 con 0x7fb8480b6930 2024-05-14T14:41:08.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.254+0000 7fb847fff640 1 -- 172.21.15.39:0/652117343 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb848164df0 con 0x7fb8480736e0 2024-05-14T14:41:08.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.254+0000 7fb8477fe640 1 --2- 172.21.15.39:0/652117343 >> v2:172.21.15.62:3300/0 conn(0x7fb848164000 0x7fb8480ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T14:41:08.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.254+0000 7fb847fff640 1 --2- 172.21.15.39:0/652117343 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8480736e0 0x7fb848160490 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb840009d90 tx=0x7fb84002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7c041dddf4b2261 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:08.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.255+0000 7fb8467fc640 1 -- 172.21.15.39:0/652117343 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb840007740 con 0x7fb8480736e0 2024-05-14T14:41:08.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.255+0000 7fb8467fc640 1 -- 172.21.15.39:0/652117343 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8400078e0 con 0x7fb8480736e0 2024-05-14T14:41:08.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.255+0000 7fb8467fc640 1 -- 172.21.15.39:0/652117343 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb840007cb0 con 0x7fb8480736e0 2024-05-14T14:41:08.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.255+0000 7fb84db34640 1 -- 172.21.15.39:0/652117343 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8480736e0 msgr2=0x7fb848160490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:08.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.255+0000 7fb84db34640 1 --2- 172.21.15.39:0/652117343 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8480736e0 0x7fb848160490 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb840009d90 tx=0x7fb84002a660 comp rx=0 tx=0).stop 2024-05-14T14:41:08.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.255+0000 7fb84db34640 1 -- 172.21.15.39:0/652117343 shutdown_connections 2024-05-14T14:41:08.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.255+0000 7fb84db34640 1 --2- 172.21.15.39:0/652117343 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8480736e0 0x7fb848160490 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:08.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.255+0000 7fb84db34640 1 --2- 172.21.15.39:0/652117343 >> v2:172.21.15.62:3300/0 conn(0x7fb848164000 0x7fb8480ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:08.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.255+0000 7fb84db34640 1 -- 172.21.15.39:0/652117343 >> 172.21.15.39:0/652117343 conn(0x7fb8480d3ae0 msgr2=0x7fb8480d3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:08.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.255+0000 7fb84db34640 1 -- 172.21.15.39:0/652117343 shutdown_connections 2024-05-14T14:41:08.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.255+0000 7fb84db34640 1 -- 172.21.15.39:0/652117343 wait complete. 2024-05-14T14:41:08.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.257+0000 7fb84db34640 1 Processor -- start 2024-05-14T14:41:08.242 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.257+0000 7fb84db34640 1 -- start start 2024-05-14T14:41:08.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.259+0000 7fb84db34640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8480b6930 0x7fb848159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:08.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.259+0000 7fb84db34640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb848164000 0x7fb848070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:08.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.259+0000 7fb84db34640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb84815f1b0 0x7fb84815f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:08.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.259+0000 7fb84db34640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb8480d3610 con 0x7fb848164000 2024-05-14T14:41:08.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.259+0000 7fb84db34640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb8480d3490 con 0x7fb84815f1b0 2024-05-14T14:41:08.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.259+0000 7fb84db34640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fb8480b8810 con 0x7fb8480b6930 2024-05-14T14:41:08.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.259+0000 7fb846ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb848164000 0x7fb848070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:08.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.259+0000 7fb846ffd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb848164000 0x7fb848070770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48656/0 (socket says 172.21.15.39:48656) 2024-05-14T14:41:08.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.259+0000 7fb846ffd640 1 -- 172.21.15.39:0/3243625398 learned_addr learned my addr 172.21.15.39:0/3243625398 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:41:08.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.259+0000 7fb8477fe640 1 --2- 172.21.15.39:0/3243625398 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8480b6930 0x7fb848159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:08.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.259+0000 7fb847fff640 1 --2- 172.21.15.39:0/3243625398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb84815f1b0 0x7fb84815f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:08.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.259+0000 7fb846ffd640 1 -- 172.21.15.39:0/3243625398 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8480b6930 msgr2=0x7fb848159f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:08.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.259+0000 7fb846ffd640 1 --2- 172.21.15.39:0/3243625398 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8480b6930 0x7fb848159f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:08.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.259+0000 7fb846ffd640 1 -- 172.21.15.39:0/3243625398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb84815f1b0 msgr2=0x7fb84815f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:08.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.259+0000 7fb846ffd640 1 --2- 172.21.15.39:0/3243625398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb84815f1b0 0x7fb84815f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:08.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.259+0000 7fb846ffd640 1 -- 172.21.15.39:0/3243625398 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb84815fb00 con 0x7fb848164000 2024-05-14T14:41:08.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.259+0000 7fb8477fe640 1 --2- 172.21.15.39:0/3243625398 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8480b6930 0x7fb848159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:41:08.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.259+0000 7fb847fff640 1 --2- 172.21.15.39:0/3243625398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb84815f1b0 0x7fb84815f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:41:08.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.259+0000 7fb846ffd640 1 --2- 172.21.15.39:0/3243625398 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb848164000 0x7fb848070770 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb83000c410 tx=0x7fb83000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:08.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.260+0000 7fb83ffff640 1 -- 172.21.15.39:0/3243625398 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8300074e0 con 0x7fb848164000 2024-05-14T14:41:08.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.260+0000 7fb83ffff640 1 -- 172.21.15.39:0/3243625398 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8300047e0 con 0x7fb848164000 2024-05-14T14:41:08.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.260+0000 7fb84db34640 1 -- 172.21.15.39:0/3243625398 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb84806eb80 con 0x7fb848164000 2024-05-14T14:41:08.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.260+0000 7fb83ffff640 1 -- 172.21.15.39:0/3243625398 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb830004bd0 con 0x7fb848164000 2024-05-14T14:41:08.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.260+0000 7fb84db34640 1 -- 172.21.15.39:0/3243625398 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb84806f140 con 0x7fb848164000 2024-05-14T14:41:08.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.260+0000 7fb84db34640 1 -- 172.21.15.39:0/3243625398 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb848076aa0 con 0x7fb848164000 2024-05-14T14:41:08.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.261+0000 7fb83ffff640 1 -- 172.21.15.39:0/3243625398 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb830011070 con 0x7fb848164000 2024-05-14T14:41:08.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.262+0000 7fb83ffff640 1 --2- 172.21.15.39:0/3243625398 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fb8280762d0 0x7fb8280787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:08.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.262+0000 7fb83ffff640 1 -- 172.21.15.39:0/3243625398 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7fb830097370 con 0x7fb848164000 2024-05-14T14:41:08.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.262+0000 7fb8477fe640 1 --2- 172.21.15.39:0/3243625398 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fb8280762d0 0x7fb8280787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:08.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.262+0000 7fb8477fe640 1 --2- 172.21.15.39:0/3243625398 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fb8280762d0 0x7fb8280787e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb838009b80 tx=0x7fb838008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:08.251 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.267+0000 7fb83ffff640 1 -- 172.21.15.39:0/3243625398 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb84815fb00 con 0x7fb848164000 2024-05-14T14:41:08.443 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.459+0000 7fb84db34640 1 -- 172.21.15.39:0/3243625398 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb848070550 con 0x7fb848164000 2024-05-14T14:41:08.444 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.460+0000 7fb83ffff640 1 -- 172.21.15.39:0/3243625398 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+16882 (secure 0 0 0) 0x7fb830060b40 con 0x7fb848164000 2024-05-14T14:41:08.445 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:41:08.445 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":36,"fsid":"d7983fec-79c7-4991-b19c-1aecead64611","created":"2024-05-14T14:39:52.157167+0000","modified":"2024-05-14T14:41:05.703398+0000","last_up_change":"2024-05-14T14:40:03.848608+0000","last_in_change":"2024-05-14T14:39:54.591920+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T14:40:04.692846+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-05-14T14:41:02.189579+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-05-14T14:41:03.042095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c4ec4534-6301-4dd7-b4d6-d560b096d442","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6800","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6801","nonce":4023478848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6802","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6803","nonce":4023478848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6806","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6807","nonce":4023478848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6804","nonce":4023478848},{"type":"v1","addr":"172.21.15.39:6805","nonce":4023478848}]},"public_addr":"172.21.15.39:6801/4023478848","cluster_addr":"172.21.15.39:6803/4023478848","heartbeat_back_addr":"172.21.15.39:6807/4023478848","heartbeat_front_addr":"172.21.15.39:6805/4023478848","state":["exists","up"]},{"osd":1,"uuid":"93f91b0e-096e-4bdf-aed0-d1136f73f136","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6816","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6817","nonce":926357398}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6818","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6819","nonce":926357398}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6822","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6823","nonce":926357398}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6820","nonce":926357398},{"type":"v1","addr":"172.21.15.39:6821","nonce":926357398}]},"public_addr":"172.21.15.39:6817/926357398","cluster_addr":"172.21.15.39:6819/926357398","heartbeat_back_addr":"172.21.15.39:6823/926357398","heartbeat_front_addr":"172.21.15.39:6821/926357398","state":["exists","up"]},{"osd":2,"uuid":"c590b1e0-67eb-452e-8e80-d2208da17d09","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6808","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6809","nonce":610616754}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6810","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6811","nonce":610616754}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6814","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6815","nonce":610616754}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6812","nonce":610616754},{"type":"v1","addr":"172.21.15.39:6813","nonce":610616754}]},"public_addr":"172.21.15.39:6809/610616754","cluster_addr":"172.21.15.39:6811/610616754","heartbeat_back_addr":"172.21.15.39:6815/610616754","heartbeat_front_addr":"172.21.15.39:6813/610616754","state":["exists","up"]},{"osd":3,"uuid":"d57661b0-44f6-4355-9115-83eceb9b8f71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6824","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6825","nonce":1469314579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6826","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6827","nonce":1469314579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6830","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6831","nonce":1469314579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6828","nonce":1469314579},{"type":"v1","addr":"172.21.15.39:6829","nonce":1469314579}]},"public_addr":"172.21.15.39:6825/1469314579","cluster_addr":"172.21.15.39:6827/1469314579","heartbeat_back_addr":"172.21.15.39:6831/1469314579","heartbeat_front_addr":"172.21.15.39:6829/1469314579","state":["exists","up"]},{"osd":4,"uuid":"b131436f-f6e1-4d72-a86e-de200afdcebb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6825","nonce":3481507129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6827","nonce":3481507129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6831","nonce":3481507129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":3481507129},{"type":"v1","addr":"172.21.15.62:6829","nonce":3481507129}]},"public_addr":"172.21.15.62:6825/3481507129","cluster_addr":"172.21.15.62:6827/3481507129","heartbeat_back_addr":"172.21.15.62:6831/3481507129","heartbeat_front_addr":"172.21.15.62:6829/3481507129","state":["exists","up"]},{"osd":5,"uuid":"12e10b40-28b1-410f-9ce0-7b427daa111e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6801","nonce":3291934116}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6803","nonce":3291934116}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6807","nonce":3291934116}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3291934116},{"type":"v1","addr":"172.21.15.62:6805","nonce":3291934116}]},"public_addr":"172.21.15.62:6801/3291934116","cluster_addr":"172.21.15.62:6803/3291934116","heartbeat_back_addr":"172.21.15.62:6807/3291934116","heartbeat_front_addr":"172.21.15.62:6805/3291934116","state":["exists","up"]},{"osd":6,"uuid":"ad8950a5-70bd-488c-8f29-010515cc4a04","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6817","nonce":3005996101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6819","nonce":3005996101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6823","nonce":3005996101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3005996101},{"type":"v1","addr":"172.21.15.62:6821","nonce":3005996101}]},"public_addr":"172.21.15.62:6817/3005996101","cluster_addr":"172.21.15.62:6819/3005996101","heartbeat_back_addr":"172.21.15.62:6823/3005996101","heartbeat_front_addr":"172.21.15.62:6821/3005996101","state":["exists","up"]},{"osd":7,"uuid":"e0d4b8b7-3c80-4760-a342-1d508cdecc37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6809","nonce":2800379225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6811","nonce":2800379225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6815","nonce":2800379225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":2800379225},{"type":"v1","addr":"172.21.15.62:6813","nonce":2800379225}]},"public_addr":"172.21.15.62:6809/2800379225","cluster_addr":"172.21.15.62:6811/2800379225","heartbeat_back_addr":"172.21.15.62:6815/2800379225","heartbeat_front_addr":"172.21.15.62:6813/2800379225","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.773714+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.760037+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.811225+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.752810+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.745165+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.700634+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.768477+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T14:39:59.747301+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T14:41:08.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.462+0000 7fb84db34640 1 -- 172.21.15.39:0/3243625398 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fb8280762d0 msgr2=0x7fb8280787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:08.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.462+0000 7fb84db34640 1 --2- 172.21.15.39:0/3243625398 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fb8280762d0 0x7fb8280787e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb838009b80 tx=0x7fb838008040 comp rx=0 tx=0).stop 2024-05-14T14:41:08.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.462+0000 7fb84db34640 1 -- 172.21.15.39:0/3243625398 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb848164000 msgr2=0x7fb848070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:08.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.462+0000 7fb84db34640 1 --2- 172.21.15.39:0/3243625398 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb848164000 0x7fb848070770 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb83000c410 tx=0x7fb83000c8d0 comp rx=0 tx=0).stop 2024-05-14T14:41:08.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.462+0000 7fb84db34640 1 -- 172.21.15.39:0/3243625398 shutdown_connections 2024-05-14T14:41:08.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.462+0000 7fb84db34640 1 --2- 172.21.15.39:0/3243625398 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fb8280762d0 0x7fb8280787e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:08.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.462+0000 7fb84db34640 1 --2- 172.21.15.39:0/3243625398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb84815f1b0 0x7fb84815f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:08.447 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.462+0000 7fb84db34640 1 --2- 172.21.15.39:0/3243625398 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb848164000 0x7fb848070770 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:08.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.462+0000 7fb84db34640 1 --2- 172.21.15.39:0/3243625398 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb8480b6930 0x7fb848159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:08.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.462+0000 7fb84db34640 1 -- 172.21.15.39:0/3243625398 >> 172.21.15.39:0/3243625398 conn(0x7fb8480d3ae0 msgr2=0x7fb8480ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:08.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.462+0000 7fb84db34640 1 -- 172.21.15.39:0/3243625398 shutdown_connections 2024-05-14T14:41:08.448 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.462+0000 7fb84db34640 1 -- 172.21.15.39:0/3243625398 wait complete. 2024-05-14T14:41:08.459 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-14T14:41:08.459 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T14:41:08.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.588+0000 7fb124c61640 1 Processor -- start 2024-05-14T14:41:08.573 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.589+0000 7fb124c61640 1 -- start start 2024-05-14T14:41:08.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.590+0000 7fb124c61640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb1200b4a20 0x7fb12006dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:08.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.590+0000 7fb124c61640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb12006e190 0x7fb120167ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:08.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.590+0000 7fb124c61640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1200d3840 con 0x7fb1200d2720 2024-05-14T14:41:08.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.590+0000 7fb124c61640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fb1200d2fa0 con 0x7fb1200b4a20 2024-05-14T14:41:08.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.590+0000 7fb124c61640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fb1200d3280 con 0x7fb12006e190 2024-05-14T14:41:08.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.590+0000 7fb11e59c640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fb1200d2720 0x7fb12006d540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:54164/0 (socket says 172.21.15.39:54164) 2024-05-14T14:41:08.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.590+0000 7fb11e59c640 1 -- 172.21.15.39:0/1003502095 learned_addr learned my addr 172.21.15.39:0/1003502095 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:41:08.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.590+0000 7fb11ed9d640 1 --2- 172.21.15.39:0/1003502095 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb12006e190 0x7fb120167ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:08.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.590+0000 7fb11dd9b640 1 --2- 172.21.15.39:0/1003502095 >> v2:172.21.15.62:3300/0 conn(0x7fb1200b4a20 0x7fb12006dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:08.577 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.591+0000 7fb11d59a640 1 -- 172.21.15.39:0/1003502095 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3999159741 0 0) 0x7fb1200d3840 con 0x7fb1200d2720 2024-05-14T14:41:08.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.591+0000 7fb11d59a640 1 -- 172.21.15.39:0/1003502095 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb108003520 con 0x7fb1200d2720 2024-05-14T14:41:08.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.591+0000 7fb11d59a640 1 -- 172.21.15.39:0/1003502095 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3099907906 0 0) 0x7fb108003520 con 0x7fb1200d2720 2024-05-14T14:41:08.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.591+0000 7fb11d59a640 1 -- 172.21.15.39:0/1003502095 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb12006e190 msgr2=0x7fb120167ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:08.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.591+0000 7fb11d59a640 1 --2- 172.21.15.39:0/1003502095 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb12006e190 0x7fb120167ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:08.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.591+0000 7fb11d59a640 1 -- 172.21.15.39:0/1003502095 >> v2:172.21.15.62:3300/0 conn(0x7fb1200b4a20 msgr2=0x7fb12006dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:08.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.591+0000 7fb11d59a640 1 --2- 172.21.15.39:0/1003502095 >> v2:172.21.15.62:3300/0 conn(0x7fb1200b4a20 0x7fb12006dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:08.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.591+0000 7fb11d59a640 1 -- 172.21.15.39:0/1003502095 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1200d3560 con 0x7fb1200d2720 2024-05-14T14:41:08.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.591+0000 7fb11d59a640 1 -- 172.21.15.39:0/1003502095 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1803005051 0 0) 0x7fb1100016f0 con 0x7fb1200d2720 2024-05-14T14:41:08.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.591+0000 7fb11dd9b640 1 --2- 172.21.15.39:0/1003502095 >> v2:172.21.15.62:3300/0 conn(0x7fb1200b4a20 0x7fb12006dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T14:41:08.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.591+0000 7fb11d59a640 1 -- 172.21.15.39:0/1003502095 >> v1:172.21.15.39:6789/0 conn(0x7fb1200d2720 legacy=0x7fb12006d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:08.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.591+0000 7fb11d59a640 1 --2- 172.21.15.39:0/1003502095 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb108003a00 0x7fb108003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:08.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.591+0000 7fb11d59a640 1 --2- 172.21.15.39:0/1003502095 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb12006e190 0x7fb108004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:08.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.591+0000 7fb11d59a640 1 --2- 172.21.15.39:0/1003502095 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb108004d40 0x7fb108005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:08.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.591+0000 7fb11d59a640 1 -- 172.21.15.39:0/1003502095 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb1200d2fa0 con 0x7fb108003a00 2024-05-14T14:41:08.578 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.591+0000 7fb11d59a640 1 -- 172.21.15.39:0/1003502095 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb1200d3280 con 0x7fb108004d40 2024-05-14T14:41:08.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.591+0000 7fb11d59a640 1 -- 172.21.15.39:0/1003502095 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fb10800baf0 con 0x7fb12006e190 2024-05-14T14:41:08.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.591+0000 7fb11e59c640 1 --2- 172.21.15.39:0/1003502095 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb108003a00 0x7fb108003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:08.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.591+0000 7fb11dd9b640 1 --2- 172.21.15.39:0/1003502095 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb12006e190 0x7fb108004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:08.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.591+0000 7fb11ed9d640 1 --2- 172.21.15.39:0/1003502095 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb108004d40 0x7fb108005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:08.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.591+0000 7fb11e59c640 1 -- 172.21.15.39:0/1003502095 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb12006e190 msgr2=0x7fb108004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:08.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.591+0000 7fb11e59c640 1 --2- 172.21.15.39:0/1003502095 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb12006e190 0x7fb108004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:08.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.591+0000 7fb11e59c640 1 -- 172.21.15.39:0/1003502095 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb108004d40 msgr2=0x7fb108005150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:08.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.591+0000 7fb11e59c640 1 --2- 172.21.15.39:0/1003502095 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb108004d40 0x7fb108005150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:08.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.591+0000 7fb11e59c640 1 -- 172.21.15.39:0/1003502095 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb108003520 con 0x7fb108003a00 2024-05-14T14:41:08.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.592+0000 7fb11e59c640 1 --2- 172.21.15.39:0/1003502095 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb108003a00 0x7fb108003e70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb11000c290 tx=0x7fb108005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4eed94bc6401ee0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:08.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.592+0000 7fb11d59a640 1 -- 172.21.15.39:0/1003502095 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb110007d50 con 0x7fb108003a00 2024-05-14T14:41:08.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.592+0000 7fb11d59a640 1 -- 172.21.15.39:0/1003502095 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb110005af0 con 0x7fb108003a00 2024-05-14T14:41:08.579 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.592+0000 7fb11d59a640 1 -- 172.21.15.39:0/1003502095 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb110007070 con 0x7fb108003a00 2024-05-14T14:41:08.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.593+0000 7fb124c61640 1 -- 172.21.15.39:0/1003502095 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb108003a00 msgr2=0x7fb108003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:08.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.593+0000 7fb124c61640 1 --2- 172.21.15.39:0/1003502095 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb108003a00 0x7fb108003e70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb11000c290 tx=0x7fb108005830 comp rx=0 tx=0).stop 2024-05-14T14:41:08.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.593+0000 7fb11ed9d640 1 -- 172.21.15.39:0/1003502095 reap_dead start 2024-05-14T14:41:08.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.593+0000 7fb124c61640 1 -- 172.21.15.39:0/1003502095 shutdown_connections 2024-05-14T14:41:08.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.593+0000 7fb124c61640 1 -- 172.21.15.39:0/1003502095 >> 172.21.15.39:0/1003502095 conn(0x7fb12009b5f0 msgr2=0x7fb12009ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:08.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.593+0000 7fb124c61640 1 -- 172.21.15.39:0/1003502095 shutdown_connections 2024-05-14T14:41:08.580 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.593+0000 7fb124c61640 1 -- 172.21.15.39:0/1003502095 wait complete. 2024-05-14T14:41:08.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.595+0000 7fb124c61640 1 Processor -- start 2024-05-14T14:41:08.581 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.595+0000 7fb124c61640 1 -- start start 2024-05-14T14:41:08.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.596+0000 7fb124c61640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb108003a00 0x7fb120157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:08.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.596+0000 7fb124c61640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb120155820 0x7fb120155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:08.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.596+0000 7fb124c61640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb120146240 0x7fb120146650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:08.582 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.596+0000 7fb124c61640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb12006e5a0 con 0x7fb108003a00 2024-05-14T14:41:08.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.596+0000 7fb124c61640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb1200d2d40 con 0x7fb120146240 2024-05-14T14:41:08.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.596+0000 7fb124c61640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fb12006e720 con 0x7fb120155820 2024-05-14T14:41:08.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.596+0000 7fb11e59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb108003a00 0x7fb120157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:08.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.597+0000 7fb11e59c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb108003a00 0x7fb120157890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:48682/0 (socket says 172.21.15.39:48682) 2024-05-14T14:41:08.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.597+0000 7fb11e59c640 1 -- 172.21.15.39:0/3230260578 learned_addr learned my addr 172.21.15.39:0/3230260578 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:41:08.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.597+0000 7fb11dd9b640 1 --2- 172.21.15.39:0/3230260578 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb120155820 0x7fb120155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:08.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.597+0000 7fb11ed9d640 1 --2- 172.21.15.39:0/3230260578 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb120146240 0x7fb120146650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:08.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.597+0000 7fb11e59c640 1 -- 172.21.15.39:0/3230260578 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb120155820 msgr2=0x7fb120155c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:08.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.597+0000 7fb11e59c640 1 --2- 172.21.15.39:0/3230260578 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb120155820 0x7fb120155c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:08.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.597+0000 7fb11e59c640 1 -- 172.21.15.39:0/3230260578 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb120146240 msgr2=0x7fb120146650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:08.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.597+0000 7fb11e59c640 1 --2- 172.21.15.39:0/3230260578 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb120146240 0x7fb120146650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:08.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.597+0000 7fb11e59c640 1 -- 172.21.15.39:0/3230260578 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb120156170 con 0x7fb108003a00 2024-05-14T14:41:08.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.597+0000 7fb11e59c640 1 --2- 172.21.15.39:0/3230260578 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb108003a00 0x7fb120157890 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb11000c380 tx=0x7fb12006d060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:08.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.598+0000 7fb10effd640 1 -- 172.21.15.39:0/3230260578 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb110043070 con 0x7fb108003a00 2024-05-14T14:41:08.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.598+0000 7fb10effd640 1 -- 172.21.15.39:0/3230260578 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb110038040 con 0x7fb108003a00 2024-05-14T14:41:08.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.598+0000 7fb124c61640 1 -- 172.21.15.39:0/3230260578 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1201580c0 con 0x7fb108003a00 2024-05-14T14:41:08.583 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.598+0000 7fb10effd640 1 -- 172.21.15.39:0/3230260578 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb110007270 con 0x7fb108003a00 2024-05-14T14:41:08.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.598+0000 7fb124c61640 1 -- 172.21.15.39:0/3230260578 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb120158680 con 0x7fb108003a00 2024-05-14T14:41:08.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.599+0000 7fb124c61640 1 -- 172.21.15.39:0/3230260578 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb120076aa0 con 0x7fb108003a00 2024-05-14T14:41:08.584 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.600+0000 7fb10effd640 1 -- 172.21.15.39:0/3230260578 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb110007410 con 0x7fb108003a00 2024-05-14T14:41:08.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.600+0000 7fb10effd640 1 --2- 172.21.15.39:0/3230260578 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fb100076300 0x7fb100078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:08.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.600+0000 7fb10effd640 1 -- 172.21.15.39:0/3230260578 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7fb1100b73f0 con 0x7fb108003a00 2024-05-14T14:41:08.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.600+0000 7fb11dd9b640 1 --2- 172.21.15.39:0/3230260578 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fb100076300 0x7fb100078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:08.585 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.601+0000 7fb11dd9b640 1 --2- 172.21.15.39:0/3230260578 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fb100076300 0x7fb100078810 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb1200cf200 tx=0x7fb114009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:08.589 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.605+0000 7fb10effd640 1 -- 172.21.15.39:0/3230260578 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb120156170 con 0x7fb108003a00 2024-05-14T14:41:08.782 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.797+0000 7fb124c61640 1 -- 172.21.15.39:0/3230260578 --> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb12006f290 con 0x7fb100076300 2024-05-14T14:41:08.788 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.804+0000 7fb10effd640 1 -- 172.21.15.39:0/3230260578 <== mgr.4105 v2:172.21.15.39:6832/498853008 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247226 (secure 0 0 0) 0x7fb12006f290 con 0x7fb100076300 2024-05-14T14:41:08.791 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:41:08.792 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-05-14T14:41:08.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.807+0000 7fb124c61640 1 -- 172.21.15.39:0/3230260578 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fb100076300 msgr2=0x7fb100078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:08.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.807+0000 7fb124c61640 1 --2- 172.21.15.39:0/3230260578 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fb100076300 0x7fb100078810 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb1200cf200 tx=0x7fb114009190 comp rx=0 tx=0).stop 2024-05-14T14:41:08.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.807+0000 7fb124c61640 1 -- 172.21.15.39:0/3230260578 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb108003a00 msgr2=0x7fb120157890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:08.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.807+0000 7fb124c61640 1 --2- 172.21.15.39:0/3230260578 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb108003a00 0x7fb120157890 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb11000c380 tx=0x7fb12006d060 comp rx=0 tx=0).stop 2024-05-14T14:41:08.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.807+0000 7fb124c61640 1 -- 172.21.15.39:0/3230260578 shutdown_connections 2024-05-14T14:41:08.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.807+0000 7fb124c61640 1 --2- 172.21.15.39:0/3230260578 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fb100076300 0x7fb100078810 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:08.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.807+0000 7fb124c61640 1 --2- 172.21.15.39:0/3230260578 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb120146240 0x7fb120146650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:08.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.807+0000 7fb124c61640 1 --2- 172.21.15.39:0/3230260578 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb120155820 0x7fb120155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:08.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.807+0000 7fb124c61640 1 --2- 172.21.15.39:0/3230260578 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb108003a00 0x7fb120157890 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:08.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.807+0000 7fb124c61640 1 -- 172.21.15.39:0/3230260578 >> 172.21.15.39:0/3230260578 conn(0x7fb12009b5f0 msgr2=0x7fb12009ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:08.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.807+0000 7fb124c61640 1 -- 172.21.15.39:0/3230260578 shutdown_connections 2024-05-14T14:41:08.794 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.807+0000 7fb124c61640 1 -- 172.21.15.39:0/3230260578 wait complete. 2024-05-14T14:41:08.803 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-05-14T14:41:08.688202+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":68,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232872,"kb_used_data":4200,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754741848,"statfs":{"total":773094113280,"available":772855652352,"internally_reserved":0,"allocated":4300800,"data_stored":2472352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":234016308},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.994927"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.710751+0000","last_change":"2024-05-14T14:41:03.710751+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.710751+0000","last_undegraded":"2024-05-14T14:41:03.710751+0000","last_fullsized":"2024-05-14T14:41:03.710751+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.711273+0000","last_change":"2024-05-14T14:41:03.711273+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.711273+0000","last_undegraded":"2024-05-14T14:41:03.711273+0000","last_fullsized":"2024-05-14T14:41:03.711273+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.712600+0000","last_change":"2024-05-14T14:41:03.712600+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.712600+0000","last_undegraded":"2024-05-14T14:41:03.712600+0000","last_fullsized":"2024-05-14T14:41:03.712600+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.710582+0000","last_change":"2024-05-14T14:41:03.710582+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.710582+0000","last_undegraded":"2024-05-14T14:41:03.710582+0000","last_fullsized":"2024-05-14T14:41:03.710582+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.710541+0000","last_change":"2024-05-14T14:41:03.710541+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.710541+0000","last_undegraded":"2024-05-14T14:41:03.710541+0000","last_fullsized":"2024-05-14T14:41:03.710541+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.711520+0000","last_change":"2024-05-14T14:41:04.711520+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.711520+0000","last_undegraded":"2024-05-14T14:41:04.711520+0000","last_fullsized":"2024-05-14T14:41:04.711520+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.707430+0000","last_change":"2024-05-14T14:41:04.707430+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.707430+0000","last_undegraded":"2024-05-14T14:41:04.707430+0000","last_fullsized":"2024-05-14T14:41:04.707430+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.712079+0000","last_change":"2024-05-14T14:41:03.712079+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.712079+0000","last_undegraded":"2024-05-14T14:41:03.712079+0000","last_fullsized":"2024-05-14T14:41:03.712079+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.712021+0000","last_change":"2024-05-14T14:41:03.712021+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.712021+0000","last_undegraded":"2024-05-14T14:41:03.712021+0000","last_fullsized":"2024-05-14T14:41:03.712021+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.709089+0000","last_change":"2024-05-14T14:41:04.709089+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.709089+0000","last_undegraded":"2024-05-14T14:41:04.709089+0000","last_fullsized":"2024-05-14T14:41:04.709089+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.711683+0000","last_change":"2024-05-14T14:41:04.711683+0000","last_active":"2024-05-14T14:41:04.711683+0000","last_peered":"2024-05-14T14:41:04.711683+0000","last_clean":"2024-05-14T14:41:04.711683+0000","last_became_active":"2024-05-14T14:41:04.711190+0000","last_became_peered":"2024-05-14T14:41:04.711190+0000","last_unstale":"2024-05-14T14:41:04.711683+0000","last_undegraded":"2024-05-14T14:41:04.711683+0000","last_fullsized":"2024-05-14T14:41:04.711683+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:15:39.767392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.712853+0000","last_change":"2024-05-14T14:41:03.712853+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.712853+0000","last_undegraded":"2024-05-14T14:41:03.712853+0000","last_fullsized":"2024-05-14T14:41:03.712853+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.707023+0000","last_change":"2024-05-14T14:41:04.707023+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.707023+0000","last_undegraded":"2024-05-14T14:41:04.707023+0000","last_fullsized":"2024-05-14T14:41:04.707023+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.707681+0000","last_change":"2024-05-14T14:41:04.707681+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.707681+0000","last_undegraded":"2024-05-14T14:41:04.707681+0000","last_fullsized":"2024-05-14T14:41:04.707681+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.707342+0000","last_change":"2024-05-14T14:41:04.707342+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.707342+0000","last_undegraded":"2024-05-14T14:41:04.707342+0000","last_fullsized":"2024-05-14T14:41:04.707342+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":["5","2"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.709076+0000","last_change":"2024-05-14T14:41:03.709076+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.709076+0000","last_undegraded":"2024-05-14T14:41:03.709076+0000","last_fullsized":"2024-05-14T14:41:03.709076+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.708302+0000","last_change":"2024-05-14T14:41:03.708302+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.708302+0000","last_undegraded":"2024-05-14T14:41:03.708302+0000","last_fullsized":"2024-05-14T14:41:03.708302+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.706987+0000","last_change":"2024-05-14T14:41:03.706987+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.706987+0000","last_undegraded":"2024-05-14T14:41:03.706987+0000","last_fullsized":"2024-05-14T14:41:03.706987+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.711391+0000","last_change":"2024-05-14T14:41:03.711391+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.711391+0000","last_undegraded":"2024-05-14T14:41:03.711391+0000","last_fullsized":"2024-05-14T14:41:03.711391+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.706446+0000","last_change":"2024-05-14T14:41:03.706446+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.706446+0000","last_undegraded":"2024-05-14T14:41:03.706446+0000","last_fullsized":"2024-05-14T14:41:03.706446+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.707459+0000","last_change":"2024-05-14T14:41:04.707459+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.707459+0000","last_undegraded":"2024-05-14T14:41:04.707459+0000","last_fullsized":"2024-05-14T14:41:04.707459+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.706820+0000","last_change":"2024-05-14T14:41:04.706820+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.706820+0000","last_undegraded":"2024-05-14T14:41:04.706820+0000","last_fullsized":"2024-05-14T14:41:04.706820+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":["4","2"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.708608+0000","last_change":"2024-05-14T14:41:03.708608+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.708608+0000","last_undegraded":"2024-05-14T14:41:03.708608+0000","last_fullsized":"2024-05-14T14:41:03.708608+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.709136+0000","last_change":"2024-05-14T14:41:03.709136+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.709136+0000","last_undegraded":"2024-05-14T14:41:03.709136+0000","last_fullsized":"2024-05-14T14:41:03.709136+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.707415+0000","last_change":"2024-05-14T14:41:03.707415+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.707415+0000","last_undegraded":"2024-05-14T14:41:03.707415+0000","last_fullsized":"2024-05-14T14:41:03.707415+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.720570+0000","last_change":"2024-05-14T14:41:04.719868+0000","last_active":"2024-05-14T14:41:04.720570+0000","last_peered":"2024-05-14T14:41:04.720570+0000","last_clean":"2024-05-14T14:41:04.720570+0000","last_became_active":"2024-05-14T14:41:04.719499+0000","last_became_peered":"2024-05-14T14:41:04.719499+0000","last_unstale":"2024-05-14T14:41:04.720570+0000","last_undegraded":"2024-05-14T14:41:04.720570+0000","last_fullsized":"2024-05-14T14:41:04.720570+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:58:50.938093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.705867+0000","last_change":"2024-05-14T14:41:03.705867+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.705867+0000","last_undegraded":"2024-05-14T14:41:03.705867+0000","last_fullsized":"2024-05-14T14:41:03.705867+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.708320+0000","last_change":"2024-05-14T14:41:04.708320+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.708320+0000","last_undegraded":"2024-05-14T14:41:04.708320+0000","last_fullsized":"2024-05-14T14:41:04.708320+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.706862+0000","last_change":"2024-05-14T14:41:03.706862+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.706862+0000","last_undegraded":"2024-05-14T14:41:03.706862+0000","last_fullsized":"2024-05-14T14:41:03.706862+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.706355+0000","last_change":"2024-05-14T14:41:03.706355+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.706355+0000","last_undegraded":"2024-05-14T14:41:03.706355+0000","last_fullsized":"2024-05-14T14:41:03.706355+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.706245+0000","last_change":"2024-05-14T14:41:03.706245+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.706245+0000","last_undegraded":"2024-05-14T14:41:03.706245+0000","last_fullsized":"2024-05-14T14:41:03.706245+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.711669+0000","last_change":"2024-05-14T14:41:04.711669+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.711669+0000","last_undegraded":"2024-05-14T14:41:04.711669+0000","last_fullsized":"2024-05-14T14:41:04.711669+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.707141+0000","last_change":"2024-05-14T14:41:03.707141+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.707141+0000","last_undegraded":"2024-05-14T14:41:03.707141+0000","last_fullsized":"2024-05-14T14:41:03.707141+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.727025+0000","last_change":"2024-05-14T14:41:03.722090+0000","last_active":"2024-05-14T14:41:03.727025+0000","last_peered":"2024-05-14T14:41:03.727025+0000","last_clean":"2024-05-14T14:41:03.727025+0000","last_became_active":"2024-05-14T14:41:03.721399+0000","last_became_peered":"2024-05-14T14:41:03.721399+0000","last_unstale":"2024-05-14T14:41:03.727025+0000","last_undegraded":"2024-05-14T14:41:03.727025+0000","last_fullsized":"2024-05-14T14:41:03.727025+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:58:48.310740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.720632+0000","last_change":"2024-05-14T14:41:04.719693+0000","last_active":"2024-05-14T14:41:04.720632+0000","last_peered":"2024-05-14T14:41:04.720632+0000","last_clean":"2024-05-14T14:41:04.720632+0000","last_became_active":"2024-05-14T14:41:04.719354+0000","last_became_peered":"2024-05-14T14:41:04.719354+0000","last_unstale":"2024-05-14T14:41:04.720632+0000","last_undegraded":"2024-05-14T14:41:04.720632+0000","last_fullsized":"2024-05-14T14:41:04.720632+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:22:38.020883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.728723+0000","last_change":"2024-05-14T14:41:03.724616+0000","last_active":"2024-05-14T14:41:03.728723+0000","last_peered":"2024-05-14T14:41:03.728723+0000","last_clean":"2024-05-14T14:41:03.728723+0000","last_became_active":"2024-05-14T14:41:03.724230+0000","last_became_peered":"2024-05-14T14:41:03.724230+0000","last_unstale":"2024-05-14T14:41:03.728723+0000","last_undegraded":"2024-05-14T14:41:03.728723+0000","last_fullsized":"2024-05-14T14:41:03.728723+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:03:30.890353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.707153+0000","last_change":"2024-05-14T14:41:04.707153+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.707153+0000","last_undegraded":"2024-05-14T14:41:04.707153+0000","last_fullsized":"2024-05-14T14:41:04.707153+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.711815+0000","last_change":"2024-05-14T14:41:03.719275+0000","last_active":"2024-05-14T14:41:04.711815+0000","last_peered":"2024-05-14T14:41:04.711815+0000","last_clean":"2024-05-14T14:41:04.711815+0000","last_became_active":"2024-05-14T14:41:03.718969+0000","last_became_peered":"2024-05-14T14:41:03.718969+0000","last_unstale":"2024-05-14T14:41:04.711815+0000","last_undegraded":"2024-05-14T14:41:04.711815+0000","last_fullsized":"2024-05-14T14:41:04.711815+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:24:12.482756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.710318+0000","last_change":"2024-05-14T14:41:03.710318+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.710318+0000","last_undegraded":"2024-05-14T14:41:03.710318+0000","last_fullsized":"2024-05-14T14:41:03.710318+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.709241+0000","last_change":"2024-05-14T14:41:03.725959+0000","last_active":"2024-05-14T14:41:04.709241+0000","last_peered":"2024-05-14T14:41:04.709241+0000","last_clean":"2024-05-14T14:41:04.709241+0000","last_became_active":"2024-05-14T14:41:03.725575+0000","last_became_peered":"2024-05-14T14:41:03.725575+0000","last_unstale":"2024-05-14T14:41:04.709241+0000","last_undegraded":"2024-05-14T14:41:04.709241+0000","last_fullsized":"2024-05-14T14:41:04.709241+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:19:36.739344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.713211+0000","last_change":"2024-05-14T14:41:03.713211+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.713211+0000","last_undegraded":"2024-05-14T14:41:03.713211+0000","last_fullsized":"2024-05-14T14:41:03.713211+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.708792+0000","last_change":"2024-05-14T14:41:03.721697+0000","last_active":"2024-05-14T14:41:04.708792+0000","last_peered":"2024-05-14T14:41:04.708792+0000","last_clean":"2024-05-14T14:41:04.708792+0000","last_became_active":"2024-05-14T14:41:03.721285+0000","last_became_peered":"2024-05-14T14:41:03.721285+0000","last_unstale":"2024-05-14T14:41:04.708792+0000","last_undegraded":"2024-05-14T14:41:04.708792+0000","last_fullsized":"2024-05-14T14:41:04.708792+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:19:32.801434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.706964+0000","last_change":"2024-05-14T14:41:04.706964+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.706964+0000","last_undegraded":"2024-05-14T14:41:04.706964+0000","last_fullsized":"2024-05-14T14:41:04.706964+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.723070+0000","last_change":"2024-05-14T14:41:03.717009+0000","last_active":"2024-05-14T14:41:03.723070+0000","last_peered":"2024-05-14T14:41:03.723070+0000","last_clean":"2024-05-14T14:41:03.723070+0000","last_became_active":"2024-05-14T14:41:03.716607+0000","last_became_peered":"2024-05-14T14:41:03.716607+0000","last_unstale":"2024-05-14T14:41:03.723070+0000","last_undegraded":"2024-05-14T14:41:03.723070+0000","last_fullsized":"2024-05-14T14:41:03.723070+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:35:33.172311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.711646+0000","last_change":"2024-05-14T14:41:04.711646+0000","last_active":"2024-05-14T14:41:04.711646+0000","last_peered":"2024-05-14T14:41:04.711646+0000","last_clean":"2024-05-14T14:41:04.711646+0000","last_became_active":"2024-05-14T14:41:04.711301+0000","last_became_peered":"2024-05-14T14:41:04.711301+0000","last_unstale":"2024-05-14T14:41:04.711646+0000","last_undegraded":"2024-05-14T14:41:04.711646+0000","last_fullsized":"2024-05-14T14:41:04.711646+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:06:44.239186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.711438+0000","last_change":"2024-05-14T14:41:03.725105+0000","last_active":"2024-05-14T14:41:04.711438+0000","last_peered":"2024-05-14T14:41:04.711438+0000","last_clean":"2024-05-14T14:41:04.711438+0000","last_became_active":"2024-05-14T14:41:03.724805+0000","last_became_peered":"2024-05-14T14:41:03.724805+0000","last_unstale":"2024-05-14T14:41:04.711438+0000","last_undegraded":"2024-05-14T14:41:04.711438+0000","last_fullsized":"2024-05-14T14:41:04.711438+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:44:06.562919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.710142+0000","last_change":"2024-05-14T14:41:03.710142+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.710142+0000","last_undegraded":"2024-05-14T14:41:03.710142+0000","last_fullsized":"2024-05-14T14:41:03.710142+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.707229+0000","last_change":"2024-05-14T14:41:03.725816+0000","last_active":"2024-05-14T14:41:04.707229+0000","last_peered":"2024-05-14T14:41:04.707229+0000","last_clean":"2024-05-14T14:41:04.707229+0000","last_became_active":"2024-05-14T14:41:03.725330+0000","last_became_peered":"2024-05-14T14:41:03.725330+0000","last_unstale":"2024-05-14T14:41:04.707229+0000","last_undegraded":"2024-05-14T14:41:04.707229+0000","last_fullsized":"2024-05-14T14:41:04.707229+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:48:09.099466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.710161+0000","last_change":"2024-05-14T14:41:03.710161+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.710161+0000","last_undegraded":"2024-05-14T14:41:03.710161+0000","last_fullsized":"2024-05-14T14:41:03.710161+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.728824+0000","last_change":"2024-05-14T14:41:03.723514+0000","last_active":"2024-05-14T14:41:03.728824+0000","last_peered":"2024-05-14T14:41:03.728824+0000","last_clean":"2024-05-14T14:41:03.728824+0000","last_became_active":"2024-05-14T14:41:03.723194+0000","last_became_peered":"2024-05-14T14:41:03.723194+0000","last_unstale":"2024-05-14T14:41:03.728824+0000","last_undegraded":"2024-05-14T14:41:03.728824+0000","last_fullsized":"2024-05-14T14:41:03.728824+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:58:49.925408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.707881+0000","last_change":"2024-05-14T14:41:03.707881+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.707881+0000","last_undegraded":"2024-05-14T14:41:03.707881+0000","last_fullsized":"2024-05-14T14:41:03.707881+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.709687+0000","last_change":"2024-05-14T14:41:03.728813+0000","last_active":"2024-05-14T14:41:04.709687+0000","last_peered":"2024-05-14T14:41:04.709687+0000","last_clean":"2024-05-14T14:41:04.709687+0000","last_became_active":"2024-05-14T14:41:03.728446+0000","last_became_peered":"2024-05-14T14:41:03.728446+0000","last_unstale":"2024-05-14T14:41:04.709687+0000","last_undegraded":"2024-05-14T14:41:04.709687+0000","last_fullsized":"2024-05-14T14:41:04.709687+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:25:38.605834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.713459+0000","last_change":"2024-05-14T14:41:03.713459+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.713459+0000","last_undegraded":"2024-05-14T14:41:03.713459+0000","last_fullsized":"2024-05-14T14:41:03.713459+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.710361+0000","last_change":"2024-05-14T14:41:03.725010+0000","last_active":"2024-05-14T14:41:04.710361+0000","last_peered":"2024-05-14T14:41:04.710361+0000","last_clean":"2024-05-14T14:41:04.710361+0000","last_became_active":"2024-05-14T14:41:03.724614+0000","last_became_peered":"2024-05-14T14:41:03.724614+0000","last_unstale":"2024-05-14T14:41:04.710361+0000","last_undegraded":"2024-05-14T14:41:04.710361+0000","last_fullsized":"2024-05-14T14:41:04.710361+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:15:55.345619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.708166+0000","last_change":"2024-05-14T14:41:04.708166+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.708166+0000","last_undegraded":"2024-05-14T14:41:04.708166+0000","last_fullsized":"2024-05-14T14:41:04.708166+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":["4","2"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.728043+0000","last_change":"2024-05-14T14:41:03.717651+0000","last_active":"2024-05-14T14:41:03.728043+0000","last_peered":"2024-05-14T14:41:03.728043+0000","last_clean":"2024-05-14T14:41:03.728043+0000","last_became_active":"2024-05-14T14:41:03.717304+0000","last_became_peered":"2024-05-14T14:41:03.717304+0000","last_unstale":"2024-05-14T14:41:03.728043+0000","last_undegraded":"2024-05-14T14:41:03.728043+0000","last_fullsized":"2024-05-14T14:41:03.728043+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:24:12.482756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.712543+0000","last_change":"2024-05-14T14:41:03.712543+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.712543+0000","last_undegraded":"2024-05-14T14:41:03.712543+0000","last_fullsized":"2024-05-14T14:41:03.712543+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.728113+0000","last_change":"2024-05-14T14:41:03.718433+0000","last_active":"2024-05-14T14:41:03.728113+0000","last_peered":"2024-05-14T14:41:03.728113+0000","last_clean":"2024-05-14T14:41:03.728113+0000","last_became_active":"2024-05-14T14:41:03.718116+0000","last_became_peered":"2024-05-14T14:41:03.718116+0000","last_unstale":"2024-05-14T14:41:03.728113+0000","last_undegraded":"2024-05-14T14:41:03.728113+0000","last_fullsized":"2024-05-14T14:41:03.728113+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:22:37.008198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.709531+0000","last_change":"2024-05-14T14:41:03.709531+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.709531+0000","last_undegraded":"2024-05-14T14:41:03.709531+0000","last_fullsized":"2024-05-14T14:41:03.709531+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.711603+0000","last_change":"2024-05-14T14:41:03.720545+0000","last_active":"2024-05-14T14:41:04.711603+0000","last_peered":"2024-05-14T14:41:04.711603+0000","last_clean":"2024-05-14T14:41:04.711603+0000","last_became_active":"2024-05-14T14:41:03.720240+0000","last_became_peered":"2024-05-14T14:41:03.720240+0000","last_unstale":"2024-05-14T14:41:04.711603+0000","last_undegraded":"2024-05-14T14:41:04.711603+0000","last_fullsized":"2024-05-14T14:41:04.711603+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:19:36.739344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.705770+0000","last_change":"2024-05-14T14:41:03.705770+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.705770+0000","last_undegraded":"2024-05-14T14:41:03.705770+0000","last_fullsized":"2024-05-14T14:41:03.705770+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.726984+0000","last_change":"2024-05-14T14:41:03.720418+0000","last_active":"2024-05-14T14:41:03.726984+0000","last_peered":"2024-05-14T14:41:03.726984+0000","last_clean":"2024-05-14T14:41:03.726984+0000","last_became_active":"2024-05-14T14:41:03.720036+0000","last_became_peered":"2024-05-14T14:41:03.720036+0000","last_unstale":"2024-05-14T14:41:03.726984+0000","last_undegraded":"2024-05-14T14:41:03.726984+0000","last_fullsized":"2024-05-14T14:41:03.726984+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:10:37.215267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.709721+0000","last_change":"2024-05-14T14:41:03.709721+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.709721+0000","last_undegraded":"2024-05-14T14:41:03.709721+0000","last_fullsized":"2024-05-14T14:41:03.709721+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.724580+0000","last_change":"2024-05-14T14:41:03.722530+0000","last_active":"2024-05-14T14:41:03.724580+0000","last_peered":"2024-05-14T14:41:03.724580+0000","last_clean":"2024-05-14T14:41:03.724580+0000","last_became_active":"2024-05-14T14:41:03.722183+0000","last_became_peered":"2024-05-14T14:41:03.722183+0000","last_unstale":"2024-05-14T14:41:03.724580+0000","last_undegraded":"2024-05-14T14:41:03.724580+0000","last_fullsized":"2024-05-14T14:41:03.724580+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:44:06.562919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.709005+0000","last_change":"2024-05-14T14:41:03.709005+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.709005+0000","last_undegraded":"2024-05-14T14:41:03.709005+0000","last_fullsized":"2024-05-14T14:41:03.709005+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.708785+0000","last_change":"2024-05-14T14:41:03.722508+0000","last_active":"2024-05-14T14:41:04.708785+0000","last_peered":"2024-05-14T14:41:04.708785+0000","last_clean":"2024-05-14T14:41:04.708785+0000","last_became_active":"2024-05-14T14:41:03.722177+0000","last_became_peered":"2024-05-14T14:41:03.722177+0000","last_unstale":"2024-05-14T14:41:04.708785+0000","last_undegraded":"2024-05-14T14:41:04.708785+0000","last_fullsized":"2024-05-14T14:41:04.708785+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:10:56.869516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.710078+0000","last_change":"2024-05-14T14:41:04.710078+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.710078+0000","last_undegraded":"2024-05-14T14:41:04.710078+0000","last_fullsized":"2024-05-14T14:41:04.710078+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.707629+0000","last_change":"2024-05-14T14:41:03.726623+0000","last_active":"2024-05-14T14:41:04.707629+0000","last_peered":"2024-05-14T14:41:04.707629+0000","last_clean":"2024-05-14T14:41:04.707629+0000","last_became_active":"2024-05-14T14:41:03.726240+0000","last_became_peered":"2024-05-14T14:41:03.726240+0000","last_unstale":"2024-05-14T14:41:04.707629+0000","last_undegraded":"2024-05-14T14:41:04.707629+0000","last_fullsized":"2024-05-14T14:41:04.707629+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:44:06.562919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.707064+0000","last_change":"2024-05-14T14:41:04.707064+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.707064+0000","last_undegraded":"2024-05-14T14:41:04.707064+0000","last_fullsized":"2024-05-14T14:41:04.707064+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":["4","1"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.728974+0000","last_change":"2024-05-14T14:41:03.723637+0000","last_active":"2024-05-14T14:41:03.728974+0000","last_peered":"2024-05-14T14:41:03.728974+0000","last_clean":"2024-05-14T14:41:03.728974+0000","last_became_active":"2024-05-14T14:41:03.723309+0000","last_became_peered":"2024-05-14T14:41:03.723309+0000","last_unstale":"2024-05-14T14:41:03.728974+0000","last_undegraded":"2024-05-14T14:41:03.728974+0000","last_fullsized":"2024-05-14T14:41:03.728974+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:01:46.708136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.710449+0000","last_change":"2024-05-14T14:41:03.710449+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.710449+0000","last_undegraded":"2024-05-14T14:41:03.710449+0000","last_fullsized":"2024-05-14T14:41:03.710449+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.711808+0000","last_change":"2024-05-14T14:41:03.718155+0000","last_active":"2024-05-14T14:41:04.711808+0000","last_peered":"2024-05-14T14:41:04.711808+0000","last_clean":"2024-05-14T14:41:04.711808+0000","last_became_active":"2024-05-14T14:41:03.717826+0000","last_became_peered":"2024-05-14T14:41:03.717826+0000","last_unstale":"2024-05-14T14:41:04.711808+0000","last_undegraded":"2024-05-14T14:41:04.711808+0000","last_fullsized":"2024-05-14T14:41:04.711808+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:06:43.226500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.708355+0000","last_change":"2024-05-14T14:41:03.708355+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.708355+0000","last_undegraded":"2024-05-14T14:41:03.708355+0000","last_fullsized":"2024-05-14T14:41:03.708355+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.724108+0000","last_change":"2024-05-14T14:41:03.719237+0000","last_active":"2024-05-14T14:41:03.724108+0000","last_peered":"2024-05-14T14:41:03.724108+0000","last_clean":"2024-05-14T14:41:03.724108+0000","last_became_active":"2024-05-14T14:41:03.718944+0000","last_became_peered":"2024-05-14T14:41:03.718944+0000","last_unstale":"2024-05-14T14:41:03.724108+0000","last_undegraded":"2024-05-14T14:41:03.724108+0000","last_fullsized":"2024-05-14T14:41:03.724108+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:01:45.552050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.712524+0000","last_change":"2024-05-14T14:41:03.712524+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.712524+0000","last_undegraded":"2024-05-14T14:41:03.712524+0000","last_fullsized":"2024-05-14T14:41:03.712524+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.723995+0000","last_change":"2024-05-14T14:41:03.718362+0000","last_active":"2024-05-14T14:41:03.723995+0000","last_peered":"2024-05-14T14:41:03.723995+0000","last_clean":"2024-05-14T14:41:03.723995+0000","last_became_active":"2024-05-14T14:41:03.718041+0000","last_became_peered":"2024-05-14T14:41:03.718041+0000","last_unstale":"2024-05-14T14:41:03.723995+0000","last_undegraded":"2024-05-14T14:41:03.723995+0000","last_fullsized":"2024-05-14T14:41:03.723995+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:42:29.851541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.707794+0000","last_change":"2024-05-14T14:41:04.707794+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.707794+0000","last_undegraded":"2024-05-14T14:41:04.707794+0000","last_fullsized":"2024-05-14T14:41:04.707794+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":["5","6"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.724462+0000","last_change":"2024-05-14T14:41:03.722600+0000","last_active":"2024-05-14T14:41:03.724462+0000","last_peered":"2024-05-14T14:41:03.724462+0000","last_clean":"2024-05-14T14:41:03.724462+0000","last_became_active":"2024-05-14T14:41:03.722240+0000","last_became_peered":"2024-05-14T14:41:03.722240+0000","last_unstale":"2024-05-14T14:41:03.724462+0000","last_undegraded":"2024-05-14T14:41:03.724462+0000","last_fullsized":"2024-05-14T14:41:03.724462+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:19:36.739344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.708432+0000","last_change":"2024-05-14T14:41:03.708432+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.708432+0000","last_undegraded":"2024-05-14T14:41:03.708432+0000","last_fullsized":"2024-05-14T14:41:03.708432+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.723944+0000","last_change":"2024-05-14T14:41:03.719224+0000","last_active":"2024-05-14T14:41:03.723944+0000","last_peered":"2024-05-14T14:41:03.723944+0000","last_clean":"2024-05-14T14:41:03.723944+0000","last_became_active":"2024-05-14T14:41:03.718916+0000","last_became_peered":"2024-05-14T14:41:03.718916+0000","last_unstale":"2024-05-14T14:41:03.723944+0000","last_undegraded":"2024-05-14T14:41:03.723944+0000","last_fullsized":"2024-05-14T14:41:03.723944+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:29:22.537342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.720623+0000","last_change":"2024-05-14T14:41:04.719892+0000","last_active":"2024-05-14T14:41:04.720623+0000","last_peered":"2024-05-14T14:41:04.720623+0000","last_clean":"2024-05-14T14:41:04.720623+0000","last_became_active":"2024-05-14T14:41:04.719326+0000","last_became_peered":"2024-05-14T14:41:04.719326+0000","last_unstale":"2024-05-14T14:41:04.720623+0000","last_undegraded":"2024-05-14T14:41:04.720623+0000","last_fullsized":"2024-05-14T14:41:04.720623+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:25:40.670957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.709178+0000","last_change":"2024-05-14T14:41:03.723786+0000","last_active":"2024-05-14T14:41:04.709178+0000","last_peered":"2024-05-14T14:41:04.709178+0000","last_clean":"2024-05-14T14:41:04.709178+0000","last_became_active":"2024-05-14T14:41:03.723431+0000","last_became_peered":"2024-05-14T14:41:03.723431+0000","last_unstale":"2024-05-14T14:41:04.709178+0000","last_undegraded":"2024-05-14T14:41:04.709178+0000","last_fullsized":"2024-05-14T14:41:04.709178+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:46:23.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.706704+0000","last_change":"2024-05-14T14:41:03.706704+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.706704+0000","last_undegraded":"2024-05-14T14:41:03.706704+0000","last_fullsized":"2024-05-14T14:41:03.706704+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.728966+0000","last_change":"2024-05-14T14:41:03.724813+0000","last_active":"2024-05-14T14:41:03.728966+0000","last_peered":"2024-05-14T14:41:03.728966+0000","last_clean":"2024-05-14T14:41:03.728966+0000","last_became_active":"2024-05-14T14:41:03.724505+0000","last_became_peered":"2024-05-14T14:41:03.724505+0000","last_unstale":"2024-05-14T14:41:03.728966+0000","last_undegraded":"2024-05-14T14:41:03.728966+0000","last_fullsized":"2024-05-14T14:41:03.728966+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:55:44.412342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.707599+0000","last_change":"2024-05-14T14:41:03.707599+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.707599+0000","last_undegraded":"2024-05-14T14:41:03.707599+0000","last_fullsized":"2024-05-14T14:41:03.707599+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.728739+0000","last_change":"2024-05-14T14:41:03.724743+0000","last_active":"2024-05-14T14:41:03.728739+0000","last_peered":"2024-05-14T14:41:03.728739+0000","last_clean":"2024-05-14T14:41:03.728739+0000","last_became_active":"2024-05-14T14:41:03.724406+0000","last_became_peered":"2024-05-14T14:41:03.724406+0000","last_unstale":"2024-05-14T14:41:03.728739+0000","last_undegraded":"2024-05-14T14:41:03.728739+0000","last_fullsized":"2024-05-14T14:41:03.728739+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:35:33.172311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.712018+0000","last_change":"2024-05-14T14:41:03.712018+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.712018+0000","last_undegraded":"2024-05-14T14:41:03.712018+0000","last_fullsized":"2024-05-14T14:41:03.712018+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.728768+0000","last_change":"2024-05-14T14:41:03.724699+0000","last_active":"2024-05-14T14:41:03.728768+0000","last_peered":"2024-05-14T14:41:03.728768+0000","last_clean":"2024-05-14T14:41:03.728768+0000","last_became_active":"2024-05-14T14:41:03.724321+0000","last_became_peered":"2024-05-14T14:41:03.724321+0000","last_unstale":"2024-05-14T14:41:03.728768+0000","last_undegraded":"2024-05-14T14:41:03.728768+0000","last_fullsized":"2024-05-14T14:41:03.728768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:24:26.460528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.711202+0000","last_change":"2024-05-14T14:41:04.711202+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.711202+0000","last_undegraded":"2024-05-14T14:41:04.711202+0000","last_fullsized":"2024-05-14T14:41:04.711202+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.726325+0000","last_change":"2024-05-14T14:41:03.719362+0000","last_active":"2024-05-14T14:41:03.726325+0000","last_peered":"2024-05-14T14:41:03.726325+0000","last_clean":"2024-05-14T14:41:03.726325+0000","last_became_active":"2024-05-14T14:41:03.719038+0000","last_became_peered":"2024-05-14T14:41:03.719038+0000","last_unstale":"2024-05-14T14:41:03.726325+0000","last_undegraded":"2024-05-14T14:41:03.726325+0000","last_fullsized":"2024-05-14T14:41:03.726325+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:20:11.233493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.707282+0000","last_change":"2024-05-14T14:41:04.707282+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.707282+0000","last_undegraded":"2024-05-14T14:41:04.707282+0000","last_fullsized":"2024-05-14T14:41:04.707282+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.707074+0000","last_change":"2024-05-14T14:41:03.726792+0000","last_active":"2024-05-14T14:41:04.707074+0000","last_peered":"2024-05-14T14:41:04.707074+0000","last_clean":"2024-05-14T14:41:04.707074+0000","last_became_active":"2024-05-14T14:41:03.726248+0000","last_became_peered":"2024-05-14T14:41:03.726248+0000","last_unstale":"2024-05-14T14:41:04.707074+0000","last_undegraded":"2024-05-14T14:41:04.707074+0000","last_fullsized":"2024-05-14T14:41:04.707074+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:35:33.172311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.706448+0000","last_change":"2024-05-14T14:41:03.706448+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.706448+0000","last_undegraded":"2024-05-14T14:41:03.706448+0000","last_fullsized":"2024-05-14T14:41:03.706448+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.728711+0000","last_change":"2024-05-14T14:41:03.723567+0000","last_active":"2024-05-14T14:41:03.728711+0000","last_peered":"2024-05-14T14:41:03.728711+0000","last_clean":"2024-05-14T14:41:03.728711+0000","last_became_active":"2024-05-14T14:41:03.723265+0000","last_became_peered":"2024-05-14T14:41:03.723265+0000","last_unstale":"2024-05-14T14:41:03.728711+0000","last_undegraded":"2024-05-14T14:41:03.728711+0000","last_fullsized":"2024-05-14T14:41:03.728711+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:25:39.658272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.708386+0000","last_change":"2024-05-14T14:41:04.708386+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.708386+0000","last_undegraded":"2024-05-14T14:41:04.708386+0000","last_fullsized":"2024-05-14T14:41:04.708386+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.723197+0000","last_change":"2024-05-14T14:41:03.718095+0000","last_active":"2024-05-14T14:41:03.723197+0000","last_peered":"2024-05-14T14:41:03.723197+0000","last_clean":"2024-05-14T14:41:03.723197+0000","last_became_active":"2024-05-14T14:41:03.717721+0000","last_became_peered":"2024-05-14T14:41:03.717721+0000","last_unstale":"2024-05-14T14:41:03.723197+0000","last_undegraded":"2024-05-14T14:41:03.723197+0000","last_fullsized":"2024-05-14T14:41:03.723197+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:48:09.099466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":134,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.709908+0000","last_change":"2024-05-14T14:40:06.302050+0000","last_active":"2024-05-14T14:41:03.709908+0000","last_peered":"2024-05-14T14:41:03.709908+0000","last_clean":"2024-05-14T14:41:03.709908+0000","last_became_active":"2024-05-14T14:40:06.300956+0000","last_became_peered":"2024-05-14T14:40:06.300956+0000","last_unstale":"2024-05-14T14:41:03.709908+0000","last_undegraded":"2024-05-14T14:41:03.709908+0000","last_fullsized":"2024-05-14T14:41:03.709908+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:04.850996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:04.850996+0000","last_clean_scrub_stamp":"2024-05-14T14:40:04.850996+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:08:41.028114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":983040,"data_stored":751820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":161452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":161452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":161452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":389120,"data_stored":161452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":161452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":389120,"data_stored":161452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":983040,"data_stored":751820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T14:41:08.808 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T14:41:08.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.975+0000 7fca0bf84640 1 Processor -- start 2024-05-14T14:41:08.962 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.975+0000 7fca0bf84640 1 -- start start 2024-05-14T14:41:08.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.975+0000 7fca0bf84640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fca040b4ec0 0x7fca041602d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:08.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.975+0000 7fca0bf84640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fca040d0ad0 0x7fca040d0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:08.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.975+0000 7fca0bf84640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca040d5840 con 0x7fca040d1420 2024-05-14T14:41:08.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.975+0000 7fca0bf84640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fca040d4d50 con 0x7fca040b4ec0 2024-05-14T14:41:08.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.975+0000 7fca0bf84640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fca0406c840 con 0x7fca040d0ad0 2024-05-14T14:41:08.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.976+0000 7fca0951f640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fca040d0ad0 0x7fca040d0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:08.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.976+0000 7fca09d20640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fca040b4ec0 0x7fca041602d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:08.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.976+0000 7fca0951f640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fca040d0ad0 0x7fca040d0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.39:44540/0 (socket says 172.21.15.39:44540) 2024-05-14T14:41:08.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.976+0000 7fca09d20640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fca040b4ec0 0x7fca041602d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.39:50954/0 (socket says 172.21.15.39:50954) 2024-05-14T14:41:08.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.976+0000 7fca0951f640 1 -- 172.21.15.39:0/4000011723 learned_addr learned my addr 172.21.15.39:0/4000011723 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:41:08.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.976+0000 7fca0a521640 1 --1- 172.21.15.39:0/4000011723 >> v1:172.21.15.62:6789/0 conn(0x7fca040d1420 0x7fca04163e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.39:47760/0 (socket says 172.21.15.39:47760) 2024-05-14T14:41:08.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.976+0000 7fca0951f640 1 -- 172.21.15.39:0/4000011723 >> v2:172.21.15.62:3300/0 conn(0x7fca040b4ec0 msgr2=0x7fca041602d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:08.964 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.976+0000 7fca0951f640 1 --2- 172.21.15.39:0/4000011723 >> v2:172.21.15.62:3300/0 conn(0x7fca040b4ec0 0x7fca041602d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:08.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.976+0000 7fca0951f640 1 -- 172.21.15.39:0/4000011723 >> v1:172.21.15.62:6789/0 conn(0x7fca040d1420 legacy=0x7fca04163e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:08.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.976+0000 7fca0951f640 1 -- 172.21.15.39:0/4000011723 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca040d1830 con 0x7fca040d0ad0 2024-05-14T14:41:08.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.976+0000 7fca09d20640 1 --2- 172.21.15.39:0/4000011723 >> v2:172.21.15.62:3300/0 conn(0x7fca040b4ec0 0x7fca041602d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T14:41:08.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.977+0000 7fca0951f640 1 --2- 172.21.15.39:0/4000011723 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fca040d0ad0 0x7fca040d0ee0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc9f80098a0 tx=0x7fc9f802a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22973de56465c0a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:08.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.977+0000 7fca08d1e640 1 -- 172.21.15.39:0/4000011723 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f8037070 con 0x7fca040d0ad0 2024-05-14T14:41:08.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.977+0000 7fca08d1e640 1 -- 172.21.15.39:0/4000011723 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9f8032440 con 0x7fca040d0ad0 2024-05-14T14:41:08.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.977+0000 7fca08d1e640 1 -- 172.21.15.39:0/4000011723 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f8032810 con 0x7fca040d0ad0 2024-05-14T14:41:08.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.978+0000 7fca0bf84640 1 -- 172.21.15.39:0/4000011723 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fca040d0ad0 msgr2=0x7fca040d0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:08.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.978+0000 7fca0bf84640 1 --2- 172.21.15.39:0/4000011723 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fca040d0ad0 0x7fca040d0ee0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc9f80098a0 tx=0x7fc9f802a290 comp rx=0 tx=0).stop 2024-05-14T14:41:08.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.978+0000 7fca0bf84640 1 -- 172.21.15.39:0/4000011723 shutdown_connections 2024-05-14T14:41:08.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.978+0000 7fca0bf84640 1 --2- 172.21.15.39:0/4000011723 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fca040d0ad0 0x7fca040d0ee0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:08.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.978+0000 7fca0bf84640 1 --2- 172.21.15.39:0/4000011723 >> v2:172.21.15.62:3300/0 conn(0x7fca040b4ec0 0x7fca041602d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:08.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.978+0000 7fca0bf84640 1 -- 172.21.15.39:0/4000011723 >> 172.21.15.39:0/4000011723 conn(0x7fca0406f270 msgr2=0x7fca040d5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:08.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.978+0000 7fca0bf84640 1 -- 172.21.15.39:0/4000011723 shutdown_connections 2024-05-14T14:41:08.965 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.978+0000 7fca0bf84640 1 -- 172.21.15.39:0/4000011723 wait complete. 2024-05-14T14:41:08.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.980+0000 7fca0bf84640 1 Processor -- start 2024-05-14T14:41:08.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.980+0000 7fca0bf84640 1 -- start start 2024-05-14T14:41:08.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.981+0000 7fca0bf84640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca040b4ec0 0x7fca040ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:08.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.981+0000 7fca0bf84640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fca040d0ad0 0x7fca041521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:08.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.981+0000 7fca0bf84640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fca040d1420 0x7fca041624a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:08.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.981+0000 7fca0bf84640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fca040d5560 con 0x7fca040d1420 2024-05-14T14:41:08.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.981+0000 7fca0bf84640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fca040d5280 con 0x7fca040b4ec0 2024-05-14T14:41:08.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.981+0000 7fca0bf84640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fca040b5480 con 0x7fca040d0ad0 2024-05-14T14:41:08.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.981+0000 7fca0a521640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fca040d1420 0x7fca041624a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:08.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.981+0000 7fca0a521640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fca040d1420 0x7fca041624a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41314/0 (socket says 172.21.15.39:41314) 2024-05-14T14:41:08.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.981+0000 7fca0a521640 1 -- 172.21.15.39:0/3070185344 learned_addr learned my addr 172.21.15.39:0/3070185344 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:41:08.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.981+0000 7fca09d20640 1 --2- 172.21.15.39:0/3070185344 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca040b4ec0 0x7fca040ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:08.968 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.981+0000 7fca0951f640 1 --2- 172.21.15.39:0/3070185344 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fca040d0ad0 0x7fca041521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:08.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.981+0000 7fca0a521640 1 -- 172.21.15.39:0/3070185344 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fca040d0ad0 msgr2=0x7fca041521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:08.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.981+0000 7fca0a521640 1 --2- 172.21.15.39:0/3070185344 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fca040d0ad0 0x7fca041521f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:08.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.981+0000 7fca0a521640 1 -- 172.21.15.39:0/3070185344 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca040b4ec0 msgr2=0x7fca040ad8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:08.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.981+0000 7fca0a521640 1 --2- 172.21.15.39:0/3070185344 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca040b4ec0 0x7fca040ad8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:08.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.981+0000 7fca0a521640 1 -- 172.21.15.39:0/3070185344 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca040adde0 con 0x7fca040d1420 2024-05-14T14:41:08.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.982+0000 7fca0a521640 1 --2- 172.21.15.39:0/3070185344 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fca040d1420 0x7fca041624a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc9f400c3c0 tx=0x7fc9f400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:08.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.982+0000 7fca027fc640 1 -- 172.21.15.39:0/3070185344 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f40074e0 con 0x7fca040d1420 2024-05-14T14:41:08.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.982+0000 7fca027fc640 1 -- 172.21.15.39:0/3070185344 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9f4007680 con 0x7fca040d1420 2024-05-14T14:41:08.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.982+0000 7fca027fc640 1 -- 172.21.15.39:0/3070185344 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f40049e0 con 0x7fca040d1420 2024-05-14T14:41:08.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.982+0000 7fca0bf84640 1 -- 172.21.15.39:0/3070185344 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca041f9e60 con 0x7fca040d1420 2024-05-14T14:41:08.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.982+0000 7fca0bf84640 1 -- 172.21.15.39:0/3070185344 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca041fa420 con 0x7fca040d1420 2024-05-14T14:41:08.969 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.983+0000 7fca0bf84640 1 -- 172.21.15.39:0/3070185344 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca04076aa0 con 0x7fca040d1420 2024-05-14T14:41:08.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.984+0000 7fca027fc640 1 -- 172.21.15.39:0/3070185344 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fc9f401a020 con 0x7fca040d1420 2024-05-14T14:41:08.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.984+0000 7fca027fc640 1 --2- 172.21.15.39:0/3070185344 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fc9f0076300 0x7fc9f0078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:08.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.984+0000 7fca027fc640 1 -- 172.21.15.39:0/3070185344 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7fc9f4096d10 con 0x7fca040d1420 2024-05-14T14:41:08.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.984+0000 7fca09d20640 1 --2- 172.21.15.39:0/3070185344 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fc9f0076300 0x7fc9f0078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:08.970 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.985+0000 7fca09d20640 1 --2- 172.21.15.39:0/3070185344 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fc9f0076300 0x7fc9f0078810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009bd0 tx=0x7fc9fc00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:08.973 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:08.989+0000 7fca027fc640 1 -- 172.21.15.39:0/3070185344 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fc9f405fe90 con 0x7fca040d1420 2024-05-14T14:41:09.160 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.176+0000 7fca0bf84640 1 -- 172.21.15.39:0/3070185344 --> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fca040adfb0 con 0x7fc9f0076300 2024-05-14T14:41:09.167 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.182+0000 7fca027fc640 1 -- 172.21.15.39:0/3070185344 <== mgr.4105 v2:172.21.15.39:6832/498853008 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247226 (secure 0 0 0) 0x7fca040adfb0 con 0x7fc9f0076300 2024-05-14T14:41:09.169 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:41:09.170 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-05-14T14:41:09.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.185+0000 7fca0bf84640 1 -- 172.21.15.39:0/3070185344 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fc9f0076300 msgr2=0x7fc9f0078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:09.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.185+0000 7fca0bf84640 1 --2- 172.21.15.39:0/3070185344 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fc9f0076300 0x7fc9f0078810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc009bd0 tx=0x7fc9fc00b040 comp rx=0 tx=0).stop 2024-05-14T14:41:09.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.185+0000 7fca0bf84640 1 -- 172.21.15.39:0/3070185344 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fca040d1420 msgr2=0x7fca041624a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:09.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.185+0000 7fca0bf84640 1 --2- 172.21.15.39:0/3070185344 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fca040d1420 0x7fca041624a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc9f400c3c0 tx=0x7fc9f400c880 comp rx=0 tx=0).stop 2024-05-14T14:41:09.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.185+0000 7fca0bf84640 1 -- 172.21.15.39:0/3070185344 shutdown_connections 2024-05-14T14:41:09.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.185+0000 7fca0bf84640 1 --2- 172.21.15.39:0/3070185344 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fc9f0076300 0x7fc9f0078810 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:09.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.185+0000 7fca0bf84640 1 --2- 172.21.15.39:0/3070185344 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fca040d1420 0x7fca041624a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:09.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.185+0000 7fca0bf84640 1 --2- 172.21.15.39:0/3070185344 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fca040d0ad0 0x7fca041521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:09.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.185+0000 7fca0bf84640 1 --2- 172.21.15.39:0/3070185344 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fca040b4ec0 0x7fca040ad8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:09.172 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.185+0000 7fca0bf84640 1 -- 172.21.15.39:0/3070185344 >> 172.21.15.39:0/3070185344 conn(0x7fca0406f270 msgr2=0x7fca040d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:09.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.185+0000 7fca0bf84640 1 -- 172.21.15.39:0/3070185344 shutdown_connections 2024-05-14T14:41:09.173 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.185+0000 7fca0bf84640 1 -- 172.21.15.39:0/3070185344 wait complete. 2024-05-14T14:41:09.181 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-05-14T14:41:08.688202+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":68,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232872,"kb_used_data":4200,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754741848,"statfs":{"total":773094113280,"available":772855652352,"internally_reserved":0,"allocated":4300800,"data_stored":2472352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":234016308},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.994927"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.710751+0000","last_change":"2024-05-14T14:41:03.710751+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.710751+0000","last_undegraded":"2024-05-14T14:41:03.710751+0000","last_fullsized":"2024-05-14T14:41:03.710751+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.711273+0000","last_change":"2024-05-14T14:41:03.711273+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.711273+0000","last_undegraded":"2024-05-14T14:41:03.711273+0000","last_fullsized":"2024-05-14T14:41:03.711273+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.712600+0000","last_change":"2024-05-14T14:41:03.712600+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.712600+0000","last_undegraded":"2024-05-14T14:41:03.712600+0000","last_fullsized":"2024-05-14T14:41:03.712600+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.710582+0000","last_change":"2024-05-14T14:41:03.710582+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.710582+0000","last_undegraded":"2024-05-14T14:41:03.710582+0000","last_fullsized":"2024-05-14T14:41:03.710582+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.710541+0000","last_change":"2024-05-14T14:41:03.710541+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.710541+0000","last_undegraded":"2024-05-14T14:41:03.710541+0000","last_fullsized":"2024-05-14T14:41:03.710541+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.711520+0000","last_change":"2024-05-14T14:41:04.711520+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.711520+0000","last_undegraded":"2024-05-14T14:41:04.711520+0000","last_fullsized":"2024-05-14T14:41:04.711520+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.707430+0000","last_change":"2024-05-14T14:41:04.707430+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.707430+0000","last_undegraded":"2024-05-14T14:41:04.707430+0000","last_fullsized":"2024-05-14T14:41:04.707430+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.712079+0000","last_change":"2024-05-14T14:41:03.712079+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.712079+0000","last_undegraded":"2024-05-14T14:41:03.712079+0000","last_fullsized":"2024-05-14T14:41:03.712079+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.712021+0000","last_change":"2024-05-14T14:41:03.712021+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.712021+0000","last_undegraded":"2024-05-14T14:41:03.712021+0000","last_fullsized":"2024-05-14T14:41:03.712021+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.709089+0000","last_change":"2024-05-14T14:41:04.709089+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.709089+0000","last_undegraded":"2024-05-14T14:41:04.709089+0000","last_fullsized":"2024-05-14T14:41:04.709089+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.711683+0000","last_change":"2024-05-14T14:41:04.711683+0000","last_active":"2024-05-14T14:41:04.711683+0000","last_peered":"2024-05-14T14:41:04.711683+0000","last_clean":"2024-05-14T14:41:04.711683+0000","last_became_active":"2024-05-14T14:41:04.711190+0000","last_became_peered":"2024-05-14T14:41:04.711190+0000","last_unstale":"2024-05-14T14:41:04.711683+0000","last_undegraded":"2024-05-14T14:41:04.711683+0000","last_fullsized":"2024-05-14T14:41:04.711683+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:15:39.767392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.712853+0000","last_change":"2024-05-14T14:41:03.712853+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.712853+0000","last_undegraded":"2024-05-14T14:41:03.712853+0000","last_fullsized":"2024-05-14T14:41:03.712853+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.707023+0000","last_change":"2024-05-14T14:41:04.707023+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.707023+0000","last_undegraded":"2024-05-14T14:41:04.707023+0000","last_fullsized":"2024-05-14T14:41:04.707023+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.707681+0000","last_change":"2024-05-14T14:41:04.707681+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.707681+0000","last_undegraded":"2024-05-14T14:41:04.707681+0000","last_fullsized":"2024-05-14T14:41:04.707681+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.707342+0000","last_change":"2024-05-14T14:41:04.707342+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.707342+0000","last_undegraded":"2024-05-14T14:41:04.707342+0000","last_fullsized":"2024-05-14T14:41:04.707342+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":["5","2"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.709076+0000","last_change":"2024-05-14T14:41:03.709076+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.709076+0000","last_undegraded":"2024-05-14T14:41:03.709076+0000","last_fullsized":"2024-05-14T14:41:03.709076+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.708302+0000","last_change":"2024-05-14T14:41:03.708302+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.708302+0000","last_undegraded":"2024-05-14T14:41:03.708302+0000","last_fullsized":"2024-05-14T14:41:03.708302+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.706987+0000","last_change":"2024-05-14T14:41:03.706987+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.706987+0000","last_undegraded":"2024-05-14T14:41:03.706987+0000","last_fullsized":"2024-05-14T14:41:03.706987+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.711391+0000","last_change":"2024-05-14T14:41:03.711391+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.711391+0000","last_undegraded":"2024-05-14T14:41:03.711391+0000","last_fullsized":"2024-05-14T14:41:03.711391+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.706446+0000","last_change":"2024-05-14T14:41:03.706446+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.706446+0000","last_undegraded":"2024-05-14T14:41:03.706446+0000","last_fullsized":"2024-05-14T14:41:03.706446+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.707459+0000","last_change":"2024-05-14T14:41:04.707459+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.707459+0000","last_undegraded":"2024-05-14T14:41:04.707459+0000","last_fullsized":"2024-05-14T14:41:04.707459+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.706820+0000","last_change":"2024-05-14T14:41:04.706820+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.706820+0000","last_undegraded":"2024-05-14T14:41:04.706820+0000","last_fullsized":"2024-05-14T14:41:04.706820+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":["4","2"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.708608+0000","last_change":"2024-05-14T14:41:03.708608+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.708608+0000","last_undegraded":"2024-05-14T14:41:03.708608+0000","last_fullsized":"2024-05-14T14:41:03.708608+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.709136+0000","last_change":"2024-05-14T14:41:03.709136+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.709136+0000","last_undegraded":"2024-05-14T14:41:03.709136+0000","last_fullsized":"2024-05-14T14:41:03.709136+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.707415+0000","last_change":"2024-05-14T14:41:03.707415+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.707415+0000","last_undegraded":"2024-05-14T14:41:03.707415+0000","last_fullsized":"2024-05-14T14:41:03.707415+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.720570+0000","last_change":"2024-05-14T14:41:04.719868+0000","last_active":"2024-05-14T14:41:04.720570+0000","last_peered":"2024-05-14T14:41:04.720570+0000","last_clean":"2024-05-14T14:41:04.720570+0000","last_became_active":"2024-05-14T14:41:04.719499+0000","last_became_peered":"2024-05-14T14:41:04.719499+0000","last_unstale":"2024-05-14T14:41:04.720570+0000","last_undegraded":"2024-05-14T14:41:04.720570+0000","last_fullsized":"2024-05-14T14:41:04.720570+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:58:50.938093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.705867+0000","last_change":"2024-05-14T14:41:03.705867+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.705867+0000","last_undegraded":"2024-05-14T14:41:03.705867+0000","last_fullsized":"2024-05-14T14:41:03.705867+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.708320+0000","last_change":"2024-05-14T14:41:04.708320+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.708320+0000","last_undegraded":"2024-05-14T14:41:04.708320+0000","last_fullsized":"2024-05-14T14:41:04.708320+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.706862+0000","last_change":"2024-05-14T14:41:03.706862+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.706862+0000","last_undegraded":"2024-05-14T14:41:03.706862+0000","last_fullsized":"2024-05-14T14:41:03.706862+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.706355+0000","last_change":"2024-05-14T14:41:03.706355+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.706355+0000","last_undegraded":"2024-05-14T14:41:03.706355+0000","last_fullsized":"2024-05-14T14:41:03.706355+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.706245+0000","last_change":"2024-05-14T14:41:03.706245+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.706245+0000","last_undegraded":"2024-05-14T14:41:03.706245+0000","last_fullsized":"2024-05-14T14:41:03.706245+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.711669+0000","last_change":"2024-05-14T14:41:04.711669+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.711669+0000","last_undegraded":"2024-05-14T14:41:04.711669+0000","last_fullsized":"2024-05-14T14:41:04.711669+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.707141+0000","last_change":"2024-05-14T14:41:03.707141+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.707141+0000","last_undegraded":"2024-05-14T14:41:03.707141+0000","last_fullsized":"2024-05-14T14:41:03.707141+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.727025+0000","last_change":"2024-05-14T14:41:03.722090+0000","last_active":"2024-05-14T14:41:03.727025+0000","last_peered":"2024-05-14T14:41:03.727025+0000","last_clean":"2024-05-14T14:41:03.727025+0000","last_became_active":"2024-05-14T14:41:03.721399+0000","last_became_peered":"2024-05-14T14:41:03.721399+0000","last_unstale":"2024-05-14T14:41:03.727025+0000","last_undegraded":"2024-05-14T14:41:03.727025+0000","last_fullsized":"2024-05-14T14:41:03.727025+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:58:48.310740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.720632+0000","last_change":"2024-05-14T14:41:04.719693+0000","last_active":"2024-05-14T14:41:04.720632+0000","last_peered":"2024-05-14T14:41:04.720632+0000","last_clean":"2024-05-14T14:41:04.720632+0000","last_became_active":"2024-05-14T14:41:04.719354+0000","last_became_peered":"2024-05-14T14:41:04.719354+0000","last_unstale":"2024-05-14T14:41:04.720632+0000","last_undegraded":"2024-05-14T14:41:04.720632+0000","last_fullsized":"2024-05-14T14:41:04.720632+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:22:38.020883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.728723+0000","last_change":"2024-05-14T14:41:03.724616+0000","last_active":"2024-05-14T14:41:03.728723+0000","last_peered":"2024-05-14T14:41:03.728723+0000","last_clean":"2024-05-14T14:41:03.728723+0000","last_became_active":"2024-05-14T14:41:03.724230+0000","last_became_peered":"2024-05-14T14:41:03.724230+0000","last_unstale":"2024-05-14T14:41:03.728723+0000","last_undegraded":"2024-05-14T14:41:03.728723+0000","last_fullsized":"2024-05-14T14:41:03.728723+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:03:30.890353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.707153+0000","last_change":"2024-05-14T14:41:04.707153+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.707153+0000","last_undegraded":"2024-05-14T14:41:04.707153+0000","last_fullsized":"2024-05-14T14:41:04.707153+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.711815+0000","last_change":"2024-05-14T14:41:03.719275+0000","last_active":"2024-05-14T14:41:04.711815+0000","last_peered":"2024-05-14T14:41:04.711815+0000","last_clean":"2024-05-14T14:41:04.711815+0000","last_became_active":"2024-05-14T14:41:03.718969+0000","last_became_peered":"2024-05-14T14:41:03.718969+0000","last_unstale":"2024-05-14T14:41:04.711815+0000","last_undegraded":"2024-05-14T14:41:04.711815+0000","last_fullsized":"2024-05-14T14:41:04.711815+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:24:12.482756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.710318+0000","last_change":"2024-05-14T14:41:03.710318+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.710318+0000","last_undegraded":"2024-05-14T14:41:03.710318+0000","last_fullsized":"2024-05-14T14:41:03.710318+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.709241+0000","last_change":"2024-05-14T14:41:03.725959+0000","last_active":"2024-05-14T14:41:04.709241+0000","last_peered":"2024-05-14T14:41:04.709241+0000","last_clean":"2024-05-14T14:41:04.709241+0000","last_became_active":"2024-05-14T14:41:03.725575+0000","last_became_peered":"2024-05-14T14:41:03.725575+0000","last_unstale":"2024-05-14T14:41:04.709241+0000","last_undegraded":"2024-05-14T14:41:04.709241+0000","last_fullsized":"2024-05-14T14:41:04.709241+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:19:36.739344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.713211+0000","last_change":"2024-05-14T14:41:03.713211+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.713211+0000","last_undegraded":"2024-05-14T14:41:03.713211+0000","last_fullsized":"2024-05-14T14:41:03.713211+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.708792+0000","last_change":"2024-05-14T14:41:03.721697+0000","last_active":"2024-05-14T14:41:04.708792+0000","last_peered":"2024-05-14T14:41:04.708792+0000","last_clean":"2024-05-14T14:41:04.708792+0000","last_became_active":"2024-05-14T14:41:03.721285+0000","last_became_peered":"2024-05-14T14:41:03.721285+0000","last_unstale":"2024-05-14T14:41:04.708792+0000","last_undegraded":"2024-05-14T14:41:04.708792+0000","last_fullsized":"2024-05-14T14:41:04.708792+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:19:32.801434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.706964+0000","last_change":"2024-05-14T14:41:04.706964+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.706964+0000","last_undegraded":"2024-05-14T14:41:04.706964+0000","last_fullsized":"2024-05-14T14:41:04.706964+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.723070+0000","last_change":"2024-05-14T14:41:03.717009+0000","last_active":"2024-05-14T14:41:03.723070+0000","last_peered":"2024-05-14T14:41:03.723070+0000","last_clean":"2024-05-14T14:41:03.723070+0000","last_became_active":"2024-05-14T14:41:03.716607+0000","last_became_peered":"2024-05-14T14:41:03.716607+0000","last_unstale":"2024-05-14T14:41:03.723070+0000","last_undegraded":"2024-05-14T14:41:03.723070+0000","last_fullsized":"2024-05-14T14:41:03.723070+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:35:33.172311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.711646+0000","last_change":"2024-05-14T14:41:04.711646+0000","last_active":"2024-05-14T14:41:04.711646+0000","last_peered":"2024-05-14T14:41:04.711646+0000","last_clean":"2024-05-14T14:41:04.711646+0000","last_became_active":"2024-05-14T14:41:04.711301+0000","last_became_peered":"2024-05-14T14:41:04.711301+0000","last_unstale":"2024-05-14T14:41:04.711646+0000","last_undegraded":"2024-05-14T14:41:04.711646+0000","last_fullsized":"2024-05-14T14:41:04.711646+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:06:44.239186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.711438+0000","last_change":"2024-05-14T14:41:03.725105+0000","last_active":"2024-05-14T14:41:04.711438+0000","last_peered":"2024-05-14T14:41:04.711438+0000","last_clean":"2024-05-14T14:41:04.711438+0000","last_became_active":"2024-05-14T14:41:03.724805+0000","last_became_peered":"2024-05-14T14:41:03.724805+0000","last_unstale":"2024-05-14T14:41:04.711438+0000","last_undegraded":"2024-05-14T14:41:04.711438+0000","last_fullsized":"2024-05-14T14:41:04.711438+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:44:06.562919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.710142+0000","last_change":"2024-05-14T14:41:03.710142+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.710142+0000","last_undegraded":"2024-05-14T14:41:03.710142+0000","last_fullsized":"2024-05-14T14:41:03.710142+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.707229+0000","last_change":"2024-05-14T14:41:03.725816+0000","last_active":"2024-05-14T14:41:04.707229+0000","last_peered":"2024-05-14T14:41:04.707229+0000","last_clean":"2024-05-14T14:41:04.707229+0000","last_became_active":"2024-05-14T14:41:03.725330+0000","last_became_peered":"2024-05-14T14:41:03.725330+0000","last_unstale":"2024-05-14T14:41:04.707229+0000","last_undegraded":"2024-05-14T14:41:04.707229+0000","last_fullsized":"2024-05-14T14:41:04.707229+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:48:09.099466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.710161+0000","last_change":"2024-05-14T14:41:03.710161+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.710161+0000","last_undegraded":"2024-05-14T14:41:03.710161+0000","last_fullsized":"2024-05-14T14:41:03.710161+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.728824+0000","last_change":"2024-05-14T14:41:03.723514+0000","last_active":"2024-05-14T14:41:03.728824+0000","last_peered":"2024-05-14T14:41:03.728824+0000","last_clean":"2024-05-14T14:41:03.728824+0000","last_became_active":"2024-05-14T14:41:03.723194+0000","last_became_peered":"2024-05-14T14:41:03.723194+0000","last_unstale":"2024-05-14T14:41:03.728824+0000","last_undegraded":"2024-05-14T14:41:03.728824+0000","last_fullsized":"2024-05-14T14:41:03.728824+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:58:49.925408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.707881+0000","last_change":"2024-05-14T14:41:03.707881+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.707881+0000","last_undegraded":"2024-05-14T14:41:03.707881+0000","last_fullsized":"2024-05-14T14:41:03.707881+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.709687+0000","last_change":"2024-05-14T14:41:03.728813+0000","last_active":"2024-05-14T14:41:04.709687+0000","last_peered":"2024-05-14T14:41:04.709687+0000","last_clean":"2024-05-14T14:41:04.709687+0000","last_became_active":"2024-05-14T14:41:03.728446+0000","last_became_peered":"2024-05-14T14:41:03.728446+0000","last_unstale":"2024-05-14T14:41:04.709687+0000","last_undegraded":"2024-05-14T14:41:04.709687+0000","last_fullsized":"2024-05-14T14:41:04.709687+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:25:38.605834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.713459+0000","last_change":"2024-05-14T14:41:03.713459+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.713459+0000","last_undegraded":"2024-05-14T14:41:03.713459+0000","last_fullsized":"2024-05-14T14:41:03.713459+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.710361+0000","last_change":"2024-05-14T14:41:03.725010+0000","last_active":"2024-05-14T14:41:04.710361+0000","last_peered":"2024-05-14T14:41:04.710361+0000","last_clean":"2024-05-14T14:41:04.710361+0000","last_became_active":"2024-05-14T14:41:03.724614+0000","last_became_peered":"2024-05-14T14:41:03.724614+0000","last_unstale":"2024-05-14T14:41:04.710361+0000","last_undegraded":"2024-05-14T14:41:04.710361+0000","last_fullsized":"2024-05-14T14:41:04.710361+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:15:55.345619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.708166+0000","last_change":"2024-05-14T14:41:04.708166+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.708166+0000","last_undegraded":"2024-05-14T14:41:04.708166+0000","last_fullsized":"2024-05-14T14:41:04.708166+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":["4","2"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.728043+0000","last_change":"2024-05-14T14:41:03.717651+0000","last_active":"2024-05-14T14:41:03.728043+0000","last_peered":"2024-05-14T14:41:03.728043+0000","last_clean":"2024-05-14T14:41:03.728043+0000","last_became_active":"2024-05-14T14:41:03.717304+0000","last_became_peered":"2024-05-14T14:41:03.717304+0000","last_unstale":"2024-05-14T14:41:03.728043+0000","last_undegraded":"2024-05-14T14:41:03.728043+0000","last_fullsized":"2024-05-14T14:41:03.728043+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:24:12.482756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.712543+0000","last_change":"2024-05-14T14:41:03.712543+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.712543+0000","last_undegraded":"2024-05-14T14:41:03.712543+0000","last_fullsized":"2024-05-14T14:41:03.712543+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.728113+0000","last_change":"2024-05-14T14:41:03.718433+0000","last_active":"2024-05-14T14:41:03.728113+0000","last_peered":"2024-05-14T14:41:03.728113+0000","last_clean":"2024-05-14T14:41:03.728113+0000","last_became_active":"2024-05-14T14:41:03.718116+0000","last_became_peered":"2024-05-14T14:41:03.718116+0000","last_unstale":"2024-05-14T14:41:03.728113+0000","last_undegraded":"2024-05-14T14:41:03.728113+0000","last_fullsized":"2024-05-14T14:41:03.728113+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:22:37.008198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.709531+0000","last_change":"2024-05-14T14:41:03.709531+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.709531+0000","last_undegraded":"2024-05-14T14:41:03.709531+0000","last_fullsized":"2024-05-14T14:41:03.709531+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.711603+0000","last_change":"2024-05-14T14:41:03.720545+0000","last_active":"2024-05-14T14:41:04.711603+0000","last_peered":"2024-05-14T14:41:04.711603+0000","last_clean":"2024-05-14T14:41:04.711603+0000","last_became_active":"2024-05-14T14:41:03.720240+0000","last_became_peered":"2024-05-14T14:41:03.720240+0000","last_unstale":"2024-05-14T14:41:04.711603+0000","last_undegraded":"2024-05-14T14:41:04.711603+0000","last_fullsized":"2024-05-14T14:41:04.711603+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:19:36.739344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.705770+0000","last_change":"2024-05-14T14:41:03.705770+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.705770+0000","last_undegraded":"2024-05-14T14:41:03.705770+0000","last_fullsized":"2024-05-14T14:41:03.705770+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.726984+0000","last_change":"2024-05-14T14:41:03.720418+0000","last_active":"2024-05-14T14:41:03.726984+0000","last_peered":"2024-05-14T14:41:03.726984+0000","last_clean":"2024-05-14T14:41:03.726984+0000","last_became_active":"2024-05-14T14:41:03.720036+0000","last_became_peered":"2024-05-14T14:41:03.720036+0000","last_unstale":"2024-05-14T14:41:03.726984+0000","last_undegraded":"2024-05-14T14:41:03.726984+0000","last_fullsized":"2024-05-14T14:41:03.726984+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:10:37.215267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.709721+0000","last_change":"2024-05-14T14:41:03.709721+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.709721+0000","last_undegraded":"2024-05-14T14:41:03.709721+0000","last_fullsized":"2024-05-14T14:41:03.709721+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.724580+0000","last_change":"2024-05-14T14:41:03.722530+0000","last_active":"2024-05-14T14:41:03.724580+0000","last_peered":"2024-05-14T14:41:03.724580+0000","last_clean":"2024-05-14T14:41:03.724580+0000","last_became_active":"2024-05-14T14:41:03.722183+0000","last_became_peered":"2024-05-14T14:41:03.722183+0000","last_unstale":"2024-05-14T14:41:03.724580+0000","last_undegraded":"2024-05-14T14:41:03.724580+0000","last_fullsized":"2024-05-14T14:41:03.724580+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:44:06.562919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.709005+0000","last_change":"2024-05-14T14:41:03.709005+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.709005+0000","last_undegraded":"2024-05-14T14:41:03.709005+0000","last_fullsized":"2024-05-14T14:41:03.709005+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.708785+0000","last_change":"2024-05-14T14:41:03.722508+0000","last_active":"2024-05-14T14:41:04.708785+0000","last_peered":"2024-05-14T14:41:04.708785+0000","last_clean":"2024-05-14T14:41:04.708785+0000","last_became_active":"2024-05-14T14:41:03.722177+0000","last_became_peered":"2024-05-14T14:41:03.722177+0000","last_unstale":"2024-05-14T14:41:04.708785+0000","last_undegraded":"2024-05-14T14:41:04.708785+0000","last_fullsized":"2024-05-14T14:41:04.708785+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:10:56.869516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.710078+0000","last_change":"2024-05-14T14:41:04.710078+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.710078+0000","last_undegraded":"2024-05-14T14:41:04.710078+0000","last_fullsized":"2024-05-14T14:41:04.710078+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.707629+0000","last_change":"2024-05-14T14:41:03.726623+0000","last_active":"2024-05-14T14:41:04.707629+0000","last_peered":"2024-05-14T14:41:04.707629+0000","last_clean":"2024-05-14T14:41:04.707629+0000","last_became_active":"2024-05-14T14:41:03.726240+0000","last_became_peered":"2024-05-14T14:41:03.726240+0000","last_unstale":"2024-05-14T14:41:04.707629+0000","last_undegraded":"2024-05-14T14:41:04.707629+0000","last_fullsized":"2024-05-14T14:41:04.707629+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:44:06.562919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.707064+0000","last_change":"2024-05-14T14:41:04.707064+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.707064+0000","last_undegraded":"2024-05-14T14:41:04.707064+0000","last_fullsized":"2024-05-14T14:41:04.707064+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":["4","1"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.728974+0000","last_change":"2024-05-14T14:41:03.723637+0000","last_active":"2024-05-14T14:41:03.728974+0000","last_peered":"2024-05-14T14:41:03.728974+0000","last_clean":"2024-05-14T14:41:03.728974+0000","last_became_active":"2024-05-14T14:41:03.723309+0000","last_became_peered":"2024-05-14T14:41:03.723309+0000","last_unstale":"2024-05-14T14:41:03.728974+0000","last_undegraded":"2024-05-14T14:41:03.728974+0000","last_fullsized":"2024-05-14T14:41:03.728974+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:01:46.708136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.710449+0000","last_change":"2024-05-14T14:41:03.710449+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.710449+0000","last_undegraded":"2024-05-14T14:41:03.710449+0000","last_fullsized":"2024-05-14T14:41:03.710449+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.711808+0000","last_change":"2024-05-14T14:41:03.718155+0000","last_active":"2024-05-14T14:41:04.711808+0000","last_peered":"2024-05-14T14:41:04.711808+0000","last_clean":"2024-05-14T14:41:04.711808+0000","last_became_active":"2024-05-14T14:41:03.717826+0000","last_became_peered":"2024-05-14T14:41:03.717826+0000","last_unstale":"2024-05-14T14:41:04.711808+0000","last_undegraded":"2024-05-14T14:41:04.711808+0000","last_fullsized":"2024-05-14T14:41:04.711808+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:06:43.226500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.708355+0000","last_change":"2024-05-14T14:41:03.708355+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.708355+0000","last_undegraded":"2024-05-14T14:41:03.708355+0000","last_fullsized":"2024-05-14T14:41:03.708355+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.724108+0000","last_change":"2024-05-14T14:41:03.719237+0000","last_active":"2024-05-14T14:41:03.724108+0000","last_peered":"2024-05-14T14:41:03.724108+0000","last_clean":"2024-05-14T14:41:03.724108+0000","last_became_active":"2024-05-14T14:41:03.718944+0000","last_became_peered":"2024-05-14T14:41:03.718944+0000","last_unstale":"2024-05-14T14:41:03.724108+0000","last_undegraded":"2024-05-14T14:41:03.724108+0000","last_fullsized":"2024-05-14T14:41:03.724108+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:01:45.552050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.712524+0000","last_change":"2024-05-14T14:41:03.712524+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.712524+0000","last_undegraded":"2024-05-14T14:41:03.712524+0000","last_fullsized":"2024-05-14T14:41:03.712524+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.723995+0000","last_change":"2024-05-14T14:41:03.718362+0000","last_active":"2024-05-14T14:41:03.723995+0000","last_peered":"2024-05-14T14:41:03.723995+0000","last_clean":"2024-05-14T14:41:03.723995+0000","last_became_active":"2024-05-14T14:41:03.718041+0000","last_became_peered":"2024-05-14T14:41:03.718041+0000","last_unstale":"2024-05-14T14:41:03.723995+0000","last_undegraded":"2024-05-14T14:41:03.723995+0000","last_fullsized":"2024-05-14T14:41:03.723995+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:42:29.851541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.707794+0000","last_change":"2024-05-14T14:41:04.707794+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.707794+0000","last_undegraded":"2024-05-14T14:41:04.707794+0000","last_fullsized":"2024-05-14T14:41:04.707794+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":["5","6"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.724462+0000","last_change":"2024-05-14T14:41:03.722600+0000","last_active":"2024-05-14T14:41:03.724462+0000","last_peered":"2024-05-14T14:41:03.724462+0000","last_clean":"2024-05-14T14:41:03.724462+0000","last_became_active":"2024-05-14T14:41:03.722240+0000","last_became_peered":"2024-05-14T14:41:03.722240+0000","last_unstale":"2024-05-14T14:41:03.724462+0000","last_undegraded":"2024-05-14T14:41:03.724462+0000","last_fullsized":"2024-05-14T14:41:03.724462+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:19:36.739344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.708432+0000","last_change":"2024-05-14T14:41:03.708432+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.708432+0000","last_undegraded":"2024-05-14T14:41:03.708432+0000","last_fullsized":"2024-05-14T14:41:03.708432+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.723944+0000","last_change":"2024-05-14T14:41:03.719224+0000","last_active":"2024-05-14T14:41:03.723944+0000","last_peered":"2024-05-14T14:41:03.723944+0000","last_clean":"2024-05-14T14:41:03.723944+0000","last_became_active":"2024-05-14T14:41:03.718916+0000","last_became_peered":"2024-05-14T14:41:03.718916+0000","last_unstale":"2024-05-14T14:41:03.723944+0000","last_undegraded":"2024-05-14T14:41:03.723944+0000","last_fullsized":"2024-05-14T14:41:03.723944+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:29:22.537342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.720623+0000","last_change":"2024-05-14T14:41:04.719892+0000","last_active":"2024-05-14T14:41:04.720623+0000","last_peered":"2024-05-14T14:41:04.720623+0000","last_clean":"2024-05-14T14:41:04.720623+0000","last_became_active":"2024-05-14T14:41:04.719326+0000","last_became_peered":"2024-05-14T14:41:04.719326+0000","last_unstale":"2024-05-14T14:41:04.720623+0000","last_undegraded":"2024-05-14T14:41:04.720623+0000","last_fullsized":"2024-05-14T14:41:04.720623+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:25:40.670957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.709178+0000","last_change":"2024-05-14T14:41:03.723786+0000","last_active":"2024-05-14T14:41:04.709178+0000","last_peered":"2024-05-14T14:41:04.709178+0000","last_clean":"2024-05-14T14:41:04.709178+0000","last_became_active":"2024-05-14T14:41:03.723431+0000","last_became_peered":"2024-05-14T14:41:03.723431+0000","last_unstale":"2024-05-14T14:41:04.709178+0000","last_undegraded":"2024-05-14T14:41:04.709178+0000","last_fullsized":"2024-05-14T14:41:04.709178+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:46:23.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.706704+0000","last_change":"2024-05-14T14:41:03.706704+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.706704+0000","last_undegraded":"2024-05-14T14:41:03.706704+0000","last_fullsized":"2024-05-14T14:41:03.706704+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.728966+0000","last_change":"2024-05-14T14:41:03.724813+0000","last_active":"2024-05-14T14:41:03.728966+0000","last_peered":"2024-05-14T14:41:03.728966+0000","last_clean":"2024-05-14T14:41:03.728966+0000","last_became_active":"2024-05-14T14:41:03.724505+0000","last_became_peered":"2024-05-14T14:41:03.724505+0000","last_unstale":"2024-05-14T14:41:03.728966+0000","last_undegraded":"2024-05-14T14:41:03.728966+0000","last_fullsized":"2024-05-14T14:41:03.728966+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:55:44.412342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.707599+0000","last_change":"2024-05-14T14:41:03.707599+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.707599+0000","last_undegraded":"2024-05-14T14:41:03.707599+0000","last_fullsized":"2024-05-14T14:41:03.707599+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.728739+0000","last_change":"2024-05-14T14:41:03.724743+0000","last_active":"2024-05-14T14:41:03.728739+0000","last_peered":"2024-05-14T14:41:03.728739+0000","last_clean":"2024-05-14T14:41:03.728739+0000","last_became_active":"2024-05-14T14:41:03.724406+0000","last_became_peered":"2024-05-14T14:41:03.724406+0000","last_unstale":"2024-05-14T14:41:03.728739+0000","last_undegraded":"2024-05-14T14:41:03.728739+0000","last_fullsized":"2024-05-14T14:41:03.728739+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:35:33.172311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.712018+0000","last_change":"2024-05-14T14:41:03.712018+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.712018+0000","last_undegraded":"2024-05-14T14:41:03.712018+0000","last_fullsized":"2024-05-14T14:41:03.712018+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.728768+0000","last_change":"2024-05-14T14:41:03.724699+0000","last_active":"2024-05-14T14:41:03.728768+0000","last_peered":"2024-05-14T14:41:03.728768+0000","last_clean":"2024-05-14T14:41:03.728768+0000","last_became_active":"2024-05-14T14:41:03.724321+0000","last_became_peered":"2024-05-14T14:41:03.724321+0000","last_unstale":"2024-05-14T14:41:03.728768+0000","last_undegraded":"2024-05-14T14:41:03.728768+0000","last_fullsized":"2024-05-14T14:41:03.728768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:24:26.460528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.711202+0000","last_change":"2024-05-14T14:41:04.711202+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.711202+0000","last_undegraded":"2024-05-14T14:41:04.711202+0000","last_fullsized":"2024-05-14T14:41:04.711202+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.726325+0000","last_change":"2024-05-14T14:41:03.719362+0000","last_active":"2024-05-14T14:41:03.726325+0000","last_peered":"2024-05-14T14:41:03.726325+0000","last_clean":"2024-05-14T14:41:03.726325+0000","last_became_active":"2024-05-14T14:41:03.719038+0000","last_became_peered":"2024-05-14T14:41:03.719038+0000","last_unstale":"2024-05-14T14:41:03.726325+0000","last_undegraded":"2024-05-14T14:41:03.726325+0000","last_fullsized":"2024-05-14T14:41:03.726325+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:20:11.233493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.707282+0000","last_change":"2024-05-14T14:41:04.707282+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.707282+0000","last_undegraded":"2024-05-14T14:41:04.707282+0000","last_fullsized":"2024-05-14T14:41:04.707282+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.707074+0000","last_change":"2024-05-14T14:41:03.726792+0000","last_active":"2024-05-14T14:41:04.707074+0000","last_peered":"2024-05-14T14:41:04.707074+0000","last_clean":"2024-05-14T14:41:04.707074+0000","last_became_active":"2024-05-14T14:41:03.726248+0000","last_became_peered":"2024-05-14T14:41:03.726248+0000","last_unstale":"2024-05-14T14:41:04.707074+0000","last_undegraded":"2024-05-14T14:41:04.707074+0000","last_fullsized":"2024-05-14T14:41:04.707074+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:35:33.172311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.706448+0000","last_change":"2024-05-14T14:41:03.706448+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.706448+0000","last_undegraded":"2024-05-14T14:41:03.706448+0000","last_fullsized":"2024-05-14T14:41:03.706448+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.728711+0000","last_change":"2024-05-14T14:41:03.723567+0000","last_active":"2024-05-14T14:41:03.728711+0000","last_peered":"2024-05-14T14:41:03.728711+0000","last_clean":"2024-05-14T14:41:03.728711+0000","last_became_active":"2024-05-14T14:41:03.723265+0000","last_became_peered":"2024-05-14T14:41:03.723265+0000","last_unstale":"2024-05-14T14:41:03.728711+0000","last_undegraded":"2024-05-14T14:41:03.728711+0000","last_fullsized":"2024-05-14T14:41:03.728711+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:25:39.658272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.708386+0000","last_change":"2024-05-14T14:41:04.708386+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.708386+0000","last_undegraded":"2024-05-14T14:41:04.708386+0000","last_fullsized":"2024-05-14T14:41:04.708386+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.723197+0000","last_change":"2024-05-14T14:41:03.718095+0000","last_active":"2024-05-14T14:41:03.723197+0000","last_peered":"2024-05-14T14:41:03.723197+0000","last_clean":"2024-05-14T14:41:03.723197+0000","last_became_active":"2024-05-14T14:41:03.717721+0000","last_became_peered":"2024-05-14T14:41:03.717721+0000","last_unstale":"2024-05-14T14:41:03.723197+0000","last_undegraded":"2024-05-14T14:41:03.723197+0000","last_fullsized":"2024-05-14T14:41:03.723197+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:48:09.099466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":134,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.709908+0000","last_change":"2024-05-14T14:40:06.302050+0000","last_active":"2024-05-14T14:41:03.709908+0000","last_peered":"2024-05-14T14:41:03.709908+0000","last_clean":"2024-05-14T14:41:03.709908+0000","last_became_active":"2024-05-14T14:40:06.300956+0000","last_became_peered":"2024-05-14T14:40:06.300956+0000","last_unstale":"2024-05-14T14:41:03.709908+0000","last_undegraded":"2024-05-14T14:41:03.709908+0000","last_fullsized":"2024-05-14T14:41:03.709908+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:04.850996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:04.850996+0000","last_clean_scrub_stamp":"2024-05-14T14:40:04.850996+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:08:41.028114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":983040,"data_stored":751820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":161452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":161452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":161452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":389120,"data_stored":161452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":161452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":389120,"data_stored":161452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":983040,"data_stored":751820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T14:41:09.185 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T14:41:09.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.351+0000 7fdc5f914640 1 Processor -- start 2024-05-14T14:41:09.336 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.351+0000 7fdc5f914640 1 -- start start 2024-05-14T14:41:09.340 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.354+0000 7fdc5f914640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc580cf2a0 0x7fdc581608e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:09.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.354+0000 7fdc5f914640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdc58164600 0x7fdc58164a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:09.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.354+0000 7fdc5f914640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc58161130 con 0x7fdc580ce1b0 2024-05-14T14:41:09.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.354+0000 7fdc5f914640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fdc58164170 con 0x7fdc58164600 2024-05-14T14:41:09.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.354+0000 7fdc5f914640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fdc58161410 con 0x7fdc580cf2a0 2024-05-14T14:41:09.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.354+0000 7fdc5deb1640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fdc580ce1b0 0x7fdc580ce5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:36514/0 (socket says 172.21.15.39:36514) 2024-05-14T14:41:09.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.354+0000 7fdc5deb1640 1 -- 172.21.15.39:0/2723406398 learned_addr learned my addr 172.21.15.39:0/2723406398 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:41:09.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.354+0000 7fdc5ceaf640 1 --2- 172.21.15.39:0/2723406398 >> v2:172.21.15.62:3300/0 conn(0x7fdc58164600 0x7fdc58164a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:09.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.354+0000 7fdc57fff640 1 -- 172.21.15.39:0/2723406398 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1725282918 0 0) 0x7fdc58161130 con 0x7fdc580ce1b0 2024-05-14T14:41:09.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.354+0000 7fdc5d6b0640 1 --2- 172.21.15.39:0/2723406398 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc580cf2a0 0x7fdc581608e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:09.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.354+0000 7fdc57fff640 1 -- 172.21.15.39:0/2723406398 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc40003520 con 0x7fdc580ce1b0 2024-05-14T14:41:09.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.354+0000 7fdc57fff640 1 -- 172.21.15.39:0/2723406398 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3673901714 0 0) 0x7fdc40003520 con 0x7fdc580ce1b0 2024-05-14T14:41:09.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.354+0000 7fdc57fff640 1 -- 172.21.15.39:0/2723406398 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc580cf2a0 msgr2=0x7fdc581608e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:09.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.354+0000 7fdc57fff640 1 --2- 172.21.15.39:0/2723406398 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc580cf2a0 0x7fdc581608e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:09.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.354+0000 7fdc57fff640 1 -- 172.21.15.39:0/2723406398 >> v2:172.21.15.62:3300/0 conn(0x7fdc58164600 msgr2=0x7fdc58164a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:09.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.354+0000 7fdc57fff640 1 --2- 172.21.15.39:0/2723406398 >> v2:172.21.15.62:3300/0 conn(0x7fdc58164600 0x7fdc58164a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:09.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.354+0000 7fdc57fff640 1 -- 172.21.15.39:0/2723406398 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc581616f0 con 0x7fdc580ce1b0 2024-05-14T14:41:09.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.354+0000 7fdc57fff640 1 -- 172.21.15.39:0/2723406398 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1803005051 0 0) 0x7fdc48001a70 con 0x7fdc580ce1b0 2024-05-14T14:41:09.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.354+0000 7fdc57fff640 1 -- 172.21.15.39:0/2723406398 >> v1:172.21.15.39:6789/0 conn(0x7fdc580ce1b0 legacy=0x7fdc580ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:09.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.354+0000 7fdc57fff640 1 --2- 172.21.15.39:0/2723406398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc40003a00 0x7fdc40003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:09.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.354+0000 7fdc57fff640 1 --2- 172.21.15.39:0/2723406398 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc580cf2a0 0x7fdc40004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:09.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.354+0000 7fdc57fff640 1 --2- 172.21.15.39:0/2723406398 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc40004d40 0x7fdc40005150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:09.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.354+0000 7fdc57fff640 1 -- 172.21.15.39:0/2723406398 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fdc58164170 con 0x7fdc40004d40 2024-05-14T14:41:09.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.354+0000 7fdc57fff640 1 -- 172.21.15.39:0/2723406398 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fdc58161410 con 0x7fdc40003a00 2024-05-14T14:41:09.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.354+0000 7fdc57fff640 1 -- 172.21.15.39:0/2723406398 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fdc4000ba70 con 0x7fdc580cf2a0 2024-05-14T14:41:09.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.354+0000 7fdc5deb1640 1 --2- 172.21.15.39:0/2723406398 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc40004d40 0x7fdc40005150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:09.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.354+0000 7fdc5d6b0640 1 --2- 172.21.15.39:0/2723406398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc40003a00 0x7fdc40003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:09.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.354+0000 7fdc5ceaf640 1 --2- 172.21.15.39:0/2723406398 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc580cf2a0 0x7fdc40004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:09.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.354+0000 7fdc5deb1640 1 -- 172.21.15.39:0/2723406398 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc580cf2a0 msgr2=0x7fdc40004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:09.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.354+0000 7fdc5deb1640 1 --2- 172.21.15.39:0/2723406398 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc580cf2a0 0x7fdc40004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:09.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.354+0000 7fdc5deb1640 1 -- 172.21.15.39:0/2723406398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc40003a00 msgr2=0x7fdc40003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:09.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.354+0000 7fdc5deb1640 1 --2- 172.21.15.39:0/2723406398 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc40003a00 0x7fdc40003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:09.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.354+0000 7fdc5deb1640 1 -- 172.21.15.39:0/2723406398 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc40003520 con 0x7fdc40004d40 2024-05-14T14:41:09.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.355+0000 7fdc5deb1640 1 --2- 172.21.15.39:0/2723406398 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc40004d40 0x7fdc40005150 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fdc4800a870 tx=0x7fdc40005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4175713b04e535cc server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:09.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.355+0000 7fdc57fff640 1 -- 172.21.15.39:0/2723406398 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4800a4c0 con 0x7fdc40004d40 2024-05-14T14:41:09.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.355+0000 7fdc57fff640 1 -- 172.21.15.39:0/2723406398 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc4802f070 con 0x7fdc40004d40 2024-05-14T14:41:09.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.355+0000 7fdc57fff640 1 -- 172.21.15.39:0/2723406398 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4802bc50 con 0x7fdc40004d40 2024-05-14T14:41:09.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.356+0000 7fdc5f914640 1 -- 172.21.15.39:0/2723406398 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc40004d40 msgr2=0x7fdc40005150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:09.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.356+0000 7fdc5f914640 1 --2- 172.21.15.39:0/2723406398 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc40004d40 0x7fdc40005150 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fdc4800a870 tx=0x7fdc40005830 comp rx=0 tx=0).stop 2024-05-14T14:41:09.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.356+0000 7fdc5deb1640 1 -- 172.21.15.39:0/2723406398 reap_dead start 2024-05-14T14:41:09.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.356+0000 7fdc5f914640 1 -- 172.21.15.39:0/2723406398 shutdown_connections 2024-05-14T14:41:09.343 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.356+0000 7fdc5f914640 1 -- 172.21.15.39:0/2723406398 >> 172.21.15.39:0/2723406398 conn(0x7fdc58071680 msgr2=0x7fdc58071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:09.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.356+0000 7fdc5f914640 1 -- 172.21.15.39:0/2723406398 shutdown_connections 2024-05-14T14:41:09.344 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.356+0000 7fdc5f914640 1 -- 172.21.15.39:0/2723406398 wait complete. 2024-05-14T14:41:09.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.358+0000 7fdc5f914640 1 Processor -- start 2024-05-14T14:41:09.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.358+0000 7fdc5f914640 1 -- start start 2024-05-14T14:41:09.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.359+0000 7fdc5f914640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc580b80a0 0x7fdc580b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:09.346 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.359+0000 7fdc5f914640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc580cd310 0x7fdc580b5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:09.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.359+0000 7fdc5f914640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc580b5a70 0x7fdc581f99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:09.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.359+0000 7fdc5f914640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fdc581608e0 con 0x7fdc580b80a0 2024-05-14T14:41:09.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.359+0000 7fdc5f914640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fdc580d0e20 con 0x7fdc580cd310 2024-05-14T14:41:09.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.359+0000 7fdc5f914640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fdc58160a60 con 0x7fdc580b5a70 2024-05-14T14:41:09.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.359+0000 7fdc5d6b0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc580b80a0 0x7fdc580b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:09.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.359+0000 7fdc5d6b0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc580b80a0 0x7fdc580b4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41336/0 (socket says 172.21.15.39:41336) 2024-05-14T14:41:09.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.359+0000 7fdc5d6b0640 1 -- 172.21.15.39:0/633879109 learned_addr learned my addr 172.21.15.39:0/633879109 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:41:09.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.359+0000 7fdc5deb1640 1 --2- 172.21.15.39:0/633879109 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc580b5a70 0x7fdc581f99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:09.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.359+0000 7fdc5ceaf640 1 --2- 172.21.15.39:0/633879109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc580cd310 0x7fdc580b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:09.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.360+0000 7fdc5d6b0640 1 -- 172.21.15.39:0/633879109 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc580b5a70 msgr2=0x7fdc581f99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:09.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.360+0000 7fdc5d6b0640 1 --2- 172.21.15.39:0/633879109 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc580b5a70 0x7fdc581f99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:09.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.360+0000 7fdc5d6b0640 1 -- 172.21.15.39:0/633879109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc580cd310 msgr2=0x7fdc580b5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:09.347 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.360+0000 7fdc5d6b0640 1 --2- 172.21.15.39:0/633879109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc580cd310 0x7fdc580b5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:09.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.360+0000 7fdc5d6b0640 1 -- 172.21.15.39:0/633879109 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc580b5e80 con 0x7fdc580b80a0 2024-05-14T14:41:09.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.360+0000 7fdc5ceaf640 1 --2- 172.21.15.39:0/633879109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc580cd310 0x7fdc580b5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:41:09.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.360+0000 7fdc5d6b0640 1 --2- 172.21.15.39:0/633879109 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc580b80a0 0x7fdc580b4ef0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdc50011910 tx=0x7fdc50011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:09.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.360+0000 7fdc55ffb640 1 -- 172.21.15.39:0/633879109 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc5000faf0 con 0x7fdc580b80a0 2024-05-14T14:41:09.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.360+0000 7fdc55ffb640 1 -- 172.21.15.39:0/633879109 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc5000fc90 con 0x7fdc580b80a0 2024-05-14T14:41:09.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.360+0000 7fdc5f914640 1 -- 172.21.15.39:0/633879109 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc580b8570 con 0x7fdc580b80a0 2024-05-14T14:41:09.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.360+0000 7fdc55ffb640 1 -- 172.21.15.39:0/633879109 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc50014440 con 0x7fdc580b80a0 2024-05-14T14:41:09.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.360+0000 7fdc5f914640 1 -- 172.21.15.39:0/633879109 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc580b8b30 con 0x7fdc580b80a0 2024-05-14T14:41:09.348 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.361+0000 7fdc5f914640 1 -- 172.21.15.39:0/633879109 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc580d0220 con 0x7fdc580b80a0 2024-05-14T14:41:09.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.362+0000 7fdc55ffb640 1 -- 172.21.15.39:0/633879109 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fdc50012040 con 0x7fdc580b80a0 2024-05-14T14:41:09.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.363+0000 7fdc55ffb640 1 --2- 172.21.15.39:0/633879109 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fdc44076300 0x7fdc44078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:09.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.363+0000 7fdc55ffb640 1 -- 172.21.15.39:0/633879109 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7fdc50097d70 con 0x7fdc580b80a0 2024-05-14T14:41:09.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.363+0000 7fdc5ceaf640 1 --2- 172.21.15.39:0/633879109 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fdc44076300 0x7fdc44078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:09.349 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.363+0000 7fdc5ceaf640 1 --2- 172.21.15.39:0/633879109 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fdc44076300 0x7fdc44078810 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdc580cddf0 tx=0x7fdc4c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:09.352 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.367+0000 7fdc55ffb640 1 -- 172.21.15.39:0/633879109 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fdc580d0220 con 0x7fdc580b80a0 2024-05-14T14:41:09.538 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.554+0000 7fdc5f914640 1 -- 172.21.15.39:0/633879109 --> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdc58076aa0 con 0x7fdc44076300 2024-05-14T14:41:09.544 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.560+0000 7fdc55ffb640 1 -- 172.21.15.39:0/633879109 <== mgr.4105 v2:172.21.15.39:6832/498853008 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247226 (secure 0 0 0) 0x7fdc58076aa0 con 0x7fdc44076300 2024-05-14T14:41:09.547 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:41:09.548 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-05-14T14:41:09.549 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.563+0000 7fdc5f914640 1 -- 172.21.15.39:0/633879109 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fdc44076300 msgr2=0x7fdc44078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:09.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.563+0000 7fdc5f914640 1 --2- 172.21.15.39:0/633879109 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fdc44076300 0x7fdc44078810 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdc580cddf0 tx=0x7fdc4c008040 comp rx=0 tx=0).stop 2024-05-14T14:41:09.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.563+0000 7fdc5f914640 1 -- 172.21.15.39:0/633879109 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc580b80a0 msgr2=0x7fdc580b4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:09.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.563+0000 7fdc5f914640 1 --2- 172.21.15.39:0/633879109 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc580b80a0 0x7fdc580b4ef0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdc50011910 tx=0x7fdc50011dd0 comp rx=0 tx=0).stop 2024-05-14T14:41:09.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.563+0000 7fdc5f914640 1 -- 172.21.15.39:0/633879109 shutdown_connections 2024-05-14T14:41:09.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.563+0000 7fdc5f914640 1 --2- 172.21.15.39:0/633879109 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fdc44076300 0x7fdc44078810 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:09.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.563+0000 7fdc5f914640 1 --2- 172.21.15.39:0/633879109 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fdc580b5a70 0x7fdc581f99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:09.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.563+0000 7fdc5f914640 1 --2- 172.21.15.39:0/633879109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdc580cd310 0x7fdc580b5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:09.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.563+0000 7fdc5f914640 1 --2- 172.21.15.39:0/633879109 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fdc580b80a0 0x7fdc580b4ef0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:09.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.563+0000 7fdc5f914640 1 -- 172.21.15.39:0/633879109 >> 172.21.15.39:0/633879109 conn(0x7fdc58071680 msgr2=0x7fdc58162c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:09.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.563+0000 7fdc5f914640 1 -- 172.21.15.39:0/633879109 shutdown_connections 2024-05-14T14:41:09.550 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.563+0000 7fdc5f914640 1 -- 172.21.15.39:0/633879109 wait complete. 2024-05-14T14:41:09.559 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-05-14T14:41:08.688202+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":68,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232872,"kb_used_data":4200,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754741848,"statfs":{"total":773094113280,"available":772855652352,"internally_reserved":0,"allocated":4300800,"data_stored":2472352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":234016308},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.994927"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.710751+0000","last_change":"2024-05-14T14:41:03.710751+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.710751+0000","last_undegraded":"2024-05-14T14:41:03.710751+0000","last_fullsized":"2024-05-14T14:41:03.710751+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.711273+0000","last_change":"2024-05-14T14:41:03.711273+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.711273+0000","last_undegraded":"2024-05-14T14:41:03.711273+0000","last_fullsized":"2024-05-14T14:41:03.711273+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.712600+0000","last_change":"2024-05-14T14:41:03.712600+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.712600+0000","last_undegraded":"2024-05-14T14:41:03.712600+0000","last_fullsized":"2024-05-14T14:41:03.712600+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.710582+0000","last_change":"2024-05-14T14:41:03.710582+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.710582+0000","last_undegraded":"2024-05-14T14:41:03.710582+0000","last_fullsized":"2024-05-14T14:41:03.710582+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.710541+0000","last_change":"2024-05-14T14:41:03.710541+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.710541+0000","last_undegraded":"2024-05-14T14:41:03.710541+0000","last_fullsized":"2024-05-14T14:41:03.710541+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.711520+0000","last_change":"2024-05-14T14:41:04.711520+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.711520+0000","last_undegraded":"2024-05-14T14:41:04.711520+0000","last_fullsized":"2024-05-14T14:41:04.711520+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.707430+0000","last_change":"2024-05-14T14:41:04.707430+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.707430+0000","last_undegraded":"2024-05-14T14:41:04.707430+0000","last_fullsized":"2024-05-14T14:41:04.707430+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.712079+0000","last_change":"2024-05-14T14:41:03.712079+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.712079+0000","last_undegraded":"2024-05-14T14:41:03.712079+0000","last_fullsized":"2024-05-14T14:41:03.712079+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.712021+0000","last_change":"2024-05-14T14:41:03.712021+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.712021+0000","last_undegraded":"2024-05-14T14:41:03.712021+0000","last_fullsized":"2024-05-14T14:41:03.712021+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.709089+0000","last_change":"2024-05-14T14:41:04.709089+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.709089+0000","last_undegraded":"2024-05-14T14:41:04.709089+0000","last_fullsized":"2024-05-14T14:41:04.709089+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.711683+0000","last_change":"2024-05-14T14:41:04.711683+0000","last_active":"2024-05-14T14:41:04.711683+0000","last_peered":"2024-05-14T14:41:04.711683+0000","last_clean":"2024-05-14T14:41:04.711683+0000","last_became_active":"2024-05-14T14:41:04.711190+0000","last_became_peered":"2024-05-14T14:41:04.711190+0000","last_unstale":"2024-05-14T14:41:04.711683+0000","last_undegraded":"2024-05-14T14:41:04.711683+0000","last_fullsized":"2024-05-14T14:41:04.711683+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:15:39.767392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.712853+0000","last_change":"2024-05-14T14:41:03.712853+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.712853+0000","last_undegraded":"2024-05-14T14:41:03.712853+0000","last_fullsized":"2024-05-14T14:41:03.712853+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.707023+0000","last_change":"2024-05-14T14:41:04.707023+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.707023+0000","last_undegraded":"2024-05-14T14:41:04.707023+0000","last_fullsized":"2024-05-14T14:41:04.707023+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.707681+0000","last_change":"2024-05-14T14:41:04.707681+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.707681+0000","last_undegraded":"2024-05-14T14:41:04.707681+0000","last_fullsized":"2024-05-14T14:41:04.707681+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.707342+0000","last_change":"2024-05-14T14:41:04.707342+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.707342+0000","last_undegraded":"2024-05-14T14:41:04.707342+0000","last_fullsized":"2024-05-14T14:41:04.707342+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":["5","2"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.709076+0000","last_change":"2024-05-14T14:41:03.709076+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.709076+0000","last_undegraded":"2024-05-14T14:41:03.709076+0000","last_fullsized":"2024-05-14T14:41:03.709076+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.708302+0000","last_change":"2024-05-14T14:41:03.708302+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.708302+0000","last_undegraded":"2024-05-14T14:41:03.708302+0000","last_fullsized":"2024-05-14T14:41:03.708302+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.706987+0000","last_change":"2024-05-14T14:41:03.706987+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.706987+0000","last_undegraded":"2024-05-14T14:41:03.706987+0000","last_fullsized":"2024-05-14T14:41:03.706987+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.711391+0000","last_change":"2024-05-14T14:41:03.711391+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.711391+0000","last_undegraded":"2024-05-14T14:41:03.711391+0000","last_fullsized":"2024-05-14T14:41:03.711391+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.706446+0000","last_change":"2024-05-14T14:41:03.706446+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.706446+0000","last_undegraded":"2024-05-14T14:41:03.706446+0000","last_fullsized":"2024-05-14T14:41:03.706446+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.707459+0000","last_change":"2024-05-14T14:41:04.707459+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.707459+0000","last_undegraded":"2024-05-14T14:41:04.707459+0000","last_fullsized":"2024-05-14T14:41:04.707459+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.706820+0000","last_change":"2024-05-14T14:41:04.706820+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.706820+0000","last_undegraded":"2024-05-14T14:41:04.706820+0000","last_fullsized":"2024-05-14T14:41:04.706820+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":["4","2"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.708608+0000","last_change":"2024-05-14T14:41:03.708608+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.708608+0000","last_undegraded":"2024-05-14T14:41:03.708608+0000","last_fullsized":"2024-05-14T14:41:03.708608+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.709136+0000","last_change":"2024-05-14T14:41:03.709136+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.709136+0000","last_undegraded":"2024-05-14T14:41:03.709136+0000","last_fullsized":"2024-05-14T14:41:03.709136+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.707415+0000","last_change":"2024-05-14T14:41:03.707415+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.707415+0000","last_undegraded":"2024-05-14T14:41:03.707415+0000","last_fullsized":"2024-05-14T14:41:03.707415+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.720570+0000","last_change":"2024-05-14T14:41:04.719868+0000","last_active":"2024-05-14T14:41:04.720570+0000","last_peered":"2024-05-14T14:41:04.720570+0000","last_clean":"2024-05-14T14:41:04.720570+0000","last_became_active":"2024-05-14T14:41:04.719499+0000","last_became_peered":"2024-05-14T14:41:04.719499+0000","last_unstale":"2024-05-14T14:41:04.720570+0000","last_undegraded":"2024-05-14T14:41:04.720570+0000","last_fullsized":"2024-05-14T14:41:04.720570+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:58:50.938093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.705867+0000","last_change":"2024-05-14T14:41:03.705867+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.705867+0000","last_undegraded":"2024-05-14T14:41:03.705867+0000","last_fullsized":"2024-05-14T14:41:03.705867+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.708320+0000","last_change":"2024-05-14T14:41:04.708320+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.708320+0000","last_undegraded":"2024-05-14T14:41:04.708320+0000","last_fullsized":"2024-05-14T14:41:04.708320+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.706862+0000","last_change":"2024-05-14T14:41:03.706862+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.706862+0000","last_undegraded":"2024-05-14T14:41:03.706862+0000","last_fullsized":"2024-05-14T14:41:03.706862+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.706355+0000","last_change":"2024-05-14T14:41:03.706355+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.706355+0000","last_undegraded":"2024-05-14T14:41:03.706355+0000","last_fullsized":"2024-05-14T14:41:03.706355+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.706245+0000","last_change":"2024-05-14T14:41:03.706245+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.706245+0000","last_undegraded":"2024-05-14T14:41:03.706245+0000","last_fullsized":"2024-05-14T14:41:03.706245+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.711669+0000","last_change":"2024-05-14T14:41:04.711669+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.711669+0000","last_undegraded":"2024-05-14T14:41:04.711669+0000","last_fullsized":"2024-05-14T14:41:04.711669+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.707141+0000","last_change":"2024-05-14T14:41:03.707141+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.707141+0000","last_undegraded":"2024-05-14T14:41:03.707141+0000","last_fullsized":"2024-05-14T14:41:03.707141+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.727025+0000","last_change":"2024-05-14T14:41:03.722090+0000","last_active":"2024-05-14T14:41:03.727025+0000","last_peered":"2024-05-14T14:41:03.727025+0000","last_clean":"2024-05-14T14:41:03.727025+0000","last_became_active":"2024-05-14T14:41:03.721399+0000","last_became_peered":"2024-05-14T14:41:03.721399+0000","last_unstale":"2024-05-14T14:41:03.727025+0000","last_undegraded":"2024-05-14T14:41:03.727025+0000","last_fullsized":"2024-05-14T14:41:03.727025+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:58:48.310740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.720632+0000","last_change":"2024-05-14T14:41:04.719693+0000","last_active":"2024-05-14T14:41:04.720632+0000","last_peered":"2024-05-14T14:41:04.720632+0000","last_clean":"2024-05-14T14:41:04.720632+0000","last_became_active":"2024-05-14T14:41:04.719354+0000","last_became_peered":"2024-05-14T14:41:04.719354+0000","last_unstale":"2024-05-14T14:41:04.720632+0000","last_undegraded":"2024-05-14T14:41:04.720632+0000","last_fullsized":"2024-05-14T14:41:04.720632+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:22:38.020883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.728723+0000","last_change":"2024-05-14T14:41:03.724616+0000","last_active":"2024-05-14T14:41:03.728723+0000","last_peered":"2024-05-14T14:41:03.728723+0000","last_clean":"2024-05-14T14:41:03.728723+0000","last_became_active":"2024-05-14T14:41:03.724230+0000","last_became_peered":"2024-05-14T14:41:03.724230+0000","last_unstale":"2024-05-14T14:41:03.728723+0000","last_undegraded":"2024-05-14T14:41:03.728723+0000","last_fullsized":"2024-05-14T14:41:03.728723+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:03:30.890353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.707153+0000","last_change":"2024-05-14T14:41:04.707153+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.707153+0000","last_undegraded":"2024-05-14T14:41:04.707153+0000","last_fullsized":"2024-05-14T14:41:04.707153+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.711815+0000","last_change":"2024-05-14T14:41:03.719275+0000","last_active":"2024-05-14T14:41:04.711815+0000","last_peered":"2024-05-14T14:41:04.711815+0000","last_clean":"2024-05-14T14:41:04.711815+0000","last_became_active":"2024-05-14T14:41:03.718969+0000","last_became_peered":"2024-05-14T14:41:03.718969+0000","last_unstale":"2024-05-14T14:41:04.711815+0000","last_undegraded":"2024-05-14T14:41:04.711815+0000","last_fullsized":"2024-05-14T14:41:04.711815+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:24:12.482756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.710318+0000","last_change":"2024-05-14T14:41:03.710318+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.710318+0000","last_undegraded":"2024-05-14T14:41:03.710318+0000","last_fullsized":"2024-05-14T14:41:03.710318+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.709241+0000","last_change":"2024-05-14T14:41:03.725959+0000","last_active":"2024-05-14T14:41:04.709241+0000","last_peered":"2024-05-14T14:41:04.709241+0000","last_clean":"2024-05-14T14:41:04.709241+0000","last_became_active":"2024-05-14T14:41:03.725575+0000","last_became_peered":"2024-05-14T14:41:03.725575+0000","last_unstale":"2024-05-14T14:41:04.709241+0000","last_undegraded":"2024-05-14T14:41:04.709241+0000","last_fullsized":"2024-05-14T14:41:04.709241+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:19:36.739344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.713211+0000","last_change":"2024-05-14T14:41:03.713211+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.713211+0000","last_undegraded":"2024-05-14T14:41:03.713211+0000","last_fullsized":"2024-05-14T14:41:03.713211+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.708792+0000","last_change":"2024-05-14T14:41:03.721697+0000","last_active":"2024-05-14T14:41:04.708792+0000","last_peered":"2024-05-14T14:41:04.708792+0000","last_clean":"2024-05-14T14:41:04.708792+0000","last_became_active":"2024-05-14T14:41:03.721285+0000","last_became_peered":"2024-05-14T14:41:03.721285+0000","last_unstale":"2024-05-14T14:41:04.708792+0000","last_undegraded":"2024-05-14T14:41:04.708792+0000","last_fullsized":"2024-05-14T14:41:04.708792+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:19:32.801434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.706964+0000","last_change":"2024-05-14T14:41:04.706964+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.706964+0000","last_undegraded":"2024-05-14T14:41:04.706964+0000","last_fullsized":"2024-05-14T14:41:04.706964+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.723070+0000","last_change":"2024-05-14T14:41:03.717009+0000","last_active":"2024-05-14T14:41:03.723070+0000","last_peered":"2024-05-14T14:41:03.723070+0000","last_clean":"2024-05-14T14:41:03.723070+0000","last_became_active":"2024-05-14T14:41:03.716607+0000","last_became_peered":"2024-05-14T14:41:03.716607+0000","last_unstale":"2024-05-14T14:41:03.723070+0000","last_undegraded":"2024-05-14T14:41:03.723070+0000","last_fullsized":"2024-05-14T14:41:03.723070+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:35:33.172311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.711646+0000","last_change":"2024-05-14T14:41:04.711646+0000","last_active":"2024-05-14T14:41:04.711646+0000","last_peered":"2024-05-14T14:41:04.711646+0000","last_clean":"2024-05-14T14:41:04.711646+0000","last_became_active":"2024-05-14T14:41:04.711301+0000","last_became_peered":"2024-05-14T14:41:04.711301+0000","last_unstale":"2024-05-14T14:41:04.711646+0000","last_undegraded":"2024-05-14T14:41:04.711646+0000","last_fullsized":"2024-05-14T14:41:04.711646+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:06:44.239186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.711438+0000","last_change":"2024-05-14T14:41:03.725105+0000","last_active":"2024-05-14T14:41:04.711438+0000","last_peered":"2024-05-14T14:41:04.711438+0000","last_clean":"2024-05-14T14:41:04.711438+0000","last_became_active":"2024-05-14T14:41:03.724805+0000","last_became_peered":"2024-05-14T14:41:03.724805+0000","last_unstale":"2024-05-14T14:41:04.711438+0000","last_undegraded":"2024-05-14T14:41:04.711438+0000","last_fullsized":"2024-05-14T14:41:04.711438+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:44:06.562919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.710142+0000","last_change":"2024-05-14T14:41:03.710142+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.710142+0000","last_undegraded":"2024-05-14T14:41:03.710142+0000","last_fullsized":"2024-05-14T14:41:03.710142+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.707229+0000","last_change":"2024-05-14T14:41:03.725816+0000","last_active":"2024-05-14T14:41:04.707229+0000","last_peered":"2024-05-14T14:41:04.707229+0000","last_clean":"2024-05-14T14:41:04.707229+0000","last_became_active":"2024-05-14T14:41:03.725330+0000","last_became_peered":"2024-05-14T14:41:03.725330+0000","last_unstale":"2024-05-14T14:41:04.707229+0000","last_undegraded":"2024-05-14T14:41:04.707229+0000","last_fullsized":"2024-05-14T14:41:04.707229+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:48:09.099466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.710161+0000","last_change":"2024-05-14T14:41:03.710161+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.710161+0000","last_undegraded":"2024-05-14T14:41:03.710161+0000","last_fullsized":"2024-05-14T14:41:03.710161+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.728824+0000","last_change":"2024-05-14T14:41:03.723514+0000","last_active":"2024-05-14T14:41:03.728824+0000","last_peered":"2024-05-14T14:41:03.728824+0000","last_clean":"2024-05-14T14:41:03.728824+0000","last_became_active":"2024-05-14T14:41:03.723194+0000","last_became_peered":"2024-05-14T14:41:03.723194+0000","last_unstale":"2024-05-14T14:41:03.728824+0000","last_undegraded":"2024-05-14T14:41:03.728824+0000","last_fullsized":"2024-05-14T14:41:03.728824+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:58:49.925408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.707881+0000","last_change":"2024-05-14T14:41:03.707881+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.707881+0000","last_undegraded":"2024-05-14T14:41:03.707881+0000","last_fullsized":"2024-05-14T14:41:03.707881+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.709687+0000","last_change":"2024-05-14T14:41:03.728813+0000","last_active":"2024-05-14T14:41:04.709687+0000","last_peered":"2024-05-14T14:41:04.709687+0000","last_clean":"2024-05-14T14:41:04.709687+0000","last_became_active":"2024-05-14T14:41:03.728446+0000","last_became_peered":"2024-05-14T14:41:03.728446+0000","last_unstale":"2024-05-14T14:41:04.709687+0000","last_undegraded":"2024-05-14T14:41:04.709687+0000","last_fullsized":"2024-05-14T14:41:04.709687+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:25:38.605834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.713459+0000","last_change":"2024-05-14T14:41:03.713459+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.713459+0000","last_undegraded":"2024-05-14T14:41:03.713459+0000","last_fullsized":"2024-05-14T14:41:03.713459+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.710361+0000","last_change":"2024-05-14T14:41:03.725010+0000","last_active":"2024-05-14T14:41:04.710361+0000","last_peered":"2024-05-14T14:41:04.710361+0000","last_clean":"2024-05-14T14:41:04.710361+0000","last_became_active":"2024-05-14T14:41:03.724614+0000","last_became_peered":"2024-05-14T14:41:03.724614+0000","last_unstale":"2024-05-14T14:41:04.710361+0000","last_undegraded":"2024-05-14T14:41:04.710361+0000","last_fullsized":"2024-05-14T14:41:04.710361+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:15:55.345619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.708166+0000","last_change":"2024-05-14T14:41:04.708166+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.708166+0000","last_undegraded":"2024-05-14T14:41:04.708166+0000","last_fullsized":"2024-05-14T14:41:04.708166+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":["4","2"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.728043+0000","last_change":"2024-05-14T14:41:03.717651+0000","last_active":"2024-05-14T14:41:03.728043+0000","last_peered":"2024-05-14T14:41:03.728043+0000","last_clean":"2024-05-14T14:41:03.728043+0000","last_became_active":"2024-05-14T14:41:03.717304+0000","last_became_peered":"2024-05-14T14:41:03.717304+0000","last_unstale":"2024-05-14T14:41:03.728043+0000","last_undegraded":"2024-05-14T14:41:03.728043+0000","last_fullsized":"2024-05-14T14:41:03.728043+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:24:12.482756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.712543+0000","last_change":"2024-05-14T14:41:03.712543+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.712543+0000","last_undegraded":"2024-05-14T14:41:03.712543+0000","last_fullsized":"2024-05-14T14:41:03.712543+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.728113+0000","last_change":"2024-05-14T14:41:03.718433+0000","last_active":"2024-05-14T14:41:03.728113+0000","last_peered":"2024-05-14T14:41:03.728113+0000","last_clean":"2024-05-14T14:41:03.728113+0000","last_became_active":"2024-05-14T14:41:03.718116+0000","last_became_peered":"2024-05-14T14:41:03.718116+0000","last_unstale":"2024-05-14T14:41:03.728113+0000","last_undegraded":"2024-05-14T14:41:03.728113+0000","last_fullsized":"2024-05-14T14:41:03.728113+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:22:37.008198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.709531+0000","last_change":"2024-05-14T14:41:03.709531+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.709531+0000","last_undegraded":"2024-05-14T14:41:03.709531+0000","last_fullsized":"2024-05-14T14:41:03.709531+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.711603+0000","last_change":"2024-05-14T14:41:03.720545+0000","last_active":"2024-05-14T14:41:04.711603+0000","last_peered":"2024-05-14T14:41:04.711603+0000","last_clean":"2024-05-14T14:41:04.711603+0000","last_became_active":"2024-05-14T14:41:03.720240+0000","last_became_peered":"2024-05-14T14:41:03.720240+0000","last_unstale":"2024-05-14T14:41:04.711603+0000","last_undegraded":"2024-05-14T14:41:04.711603+0000","last_fullsized":"2024-05-14T14:41:04.711603+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:19:36.739344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.705770+0000","last_change":"2024-05-14T14:41:03.705770+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.705770+0000","last_undegraded":"2024-05-14T14:41:03.705770+0000","last_fullsized":"2024-05-14T14:41:03.705770+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.726984+0000","last_change":"2024-05-14T14:41:03.720418+0000","last_active":"2024-05-14T14:41:03.726984+0000","last_peered":"2024-05-14T14:41:03.726984+0000","last_clean":"2024-05-14T14:41:03.726984+0000","last_became_active":"2024-05-14T14:41:03.720036+0000","last_became_peered":"2024-05-14T14:41:03.720036+0000","last_unstale":"2024-05-14T14:41:03.726984+0000","last_undegraded":"2024-05-14T14:41:03.726984+0000","last_fullsized":"2024-05-14T14:41:03.726984+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:10:37.215267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.709721+0000","last_change":"2024-05-14T14:41:03.709721+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.709721+0000","last_undegraded":"2024-05-14T14:41:03.709721+0000","last_fullsized":"2024-05-14T14:41:03.709721+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.724580+0000","last_change":"2024-05-14T14:41:03.722530+0000","last_active":"2024-05-14T14:41:03.724580+0000","last_peered":"2024-05-14T14:41:03.724580+0000","last_clean":"2024-05-14T14:41:03.724580+0000","last_became_active":"2024-05-14T14:41:03.722183+0000","last_became_peered":"2024-05-14T14:41:03.722183+0000","last_unstale":"2024-05-14T14:41:03.724580+0000","last_undegraded":"2024-05-14T14:41:03.724580+0000","last_fullsized":"2024-05-14T14:41:03.724580+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:44:06.562919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.709005+0000","last_change":"2024-05-14T14:41:03.709005+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.709005+0000","last_undegraded":"2024-05-14T14:41:03.709005+0000","last_fullsized":"2024-05-14T14:41:03.709005+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.708785+0000","last_change":"2024-05-14T14:41:03.722508+0000","last_active":"2024-05-14T14:41:04.708785+0000","last_peered":"2024-05-14T14:41:04.708785+0000","last_clean":"2024-05-14T14:41:04.708785+0000","last_became_active":"2024-05-14T14:41:03.722177+0000","last_became_peered":"2024-05-14T14:41:03.722177+0000","last_unstale":"2024-05-14T14:41:04.708785+0000","last_undegraded":"2024-05-14T14:41:04.708785+0000","last_fullsized":"2024-05-14T14:41:04.708785+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:10:56.869516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.710078+0000","last_change":"2024-05-14T14:41:04.710078+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.710078+0000","last_undegraded":"2024-05-14T14:41:04.710078+0000","last_fullsized":"2024-05-14T14:41:04.710078+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.707629+0000","last_change":"2024-05-14T14:41:03.726623+0000","last_active":"2024-05-14T14:41:04.707629+0000","last_peered":"2024-05-14T14:41:04.707629+0000","last_clean":"2024-05-14T14:41:04.707629+0000","last_became_active":"2024-05-14T14:41:03.726240+0000","last_became_peered":"2024-05-14T14:41:03.726240+0000","last_unstale":"2024-05-14T14:41:04.707629+0000","last_undegraded":"2024-05-14T14:41:04.707629+0000","last_fullsized":"2024-05-14T14:41:04.707629+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:44:06.562919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.707064+0000","last_change":"2024-05-14T14:41:04.707064+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.707064+0000","last_undegraded":"2024-05-14T14:41:04.707064+0000","last_fullsized":"2024-05-14T14:41:04.707064+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":["4","1"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.728974+0000","last_change":"2024-05-14T14:41:03.723637+0000","last_active":"2024-05-14T14:41:03.728974+0000","last_peered":"2024-05-14T14:41:03.728974+0000","last_clean":"2024-05-14T14:41:03.728974+0000","last_became_active":"2024-05-14T14:41:03.723309+0000","last_became_peered":"2024-05-14T14:41:03.723309+0000","last_unstale":"2024-05-14T14:41:03.728974+0000","last_undegraded":"2024-05-14T14:41:03.728974+0000","last_fullsized":"2024-05-14T14:41:03.728974+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:01:46.708136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.710449+0000","last_change":"2024-05-14T14:41:03.710449+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.710449+0000","last_undegraded":"2024-05-14T14:41:03.710449+0000","last_fullsized":"2024-05-14T14:41:03.710449+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.711808+0000","last_change":"2024-05-14T14:41:03.718155+0000","last_active":"2024-05-14T14:41:04.711808+0000","last_peered":"2024-05-14T14:41:04.711808+0000","last_clean":"2024-05-14T14:41:04.711808+0000","last_became_active":"2024-05-14T14:41:03.717826+0000","last_became_peered":"2024-05-14T14:41:03.717826+0000","last_unstale":"2024-05-14T14:41:04.711808+0000","last_undegraded":"2024-05-14T14:41:04.711808+0000","last_fullsized":"2024-05-14T14:41:04.711808+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:06:43.226500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.708355+0000","last_change":"2024-05-14T14:41:03.708355+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.708355+0000","last_undegraded":"2024-05-14T14:41:03.708355+0000","last_fullsized":"2024-05-14T14:41:03.708355+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.724108+0000","last_change":"2024-05-14T14:41:03.719237+0000","last_active":"2024-05-14T14:41:03.724108+0000","last_peered":"2024-05-14T14:41:03.724108+0000","last_clean":"2024-05-14T14:41:03.724108+0000","last_became_active":"2024-05-14T14:41:03.718944+0000","last_became_peered":"2024-05-14T14:41:03.718944+0000","last_unstale":"2024-05-14T14:41:03.724108+0000","last_undegraded":"2024-05-14T14:41:03.724108+0000","last_fullsized":"2024-05-14T14:41:03.724108+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:01:45.552050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.712524+0000","last_change":"2024-05-14T14:41:03.712524+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.712524+0000","last_undegraded":"2024-05-14T14:41:03.712524+0000","last_fullsized":"2024-05-14T14:41:03.712524+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.723995+0000","last_change":"2024-05-14T14:41:03.718362+0000","last_active":"2024-05-14T14:41:03.723995+0000","last_peered":"2024-05-14T14:41:03.723995+0000","last_clean":"2024-05-14T14:41:03.723995+0000","last_became_active":"2024-05-14T14:41:03.718041+0000","last_became_peered":"2024-05-14T14:41:03.718041+0000","last_unstale":"2024-05-14T14:41:03.723995+0000","last_undegraded":"2024-05-14T14:41:03.723995+0000","last_fullsized":"2024-05-14T14:41:03.723995+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:42:29.851541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.707794+0000","last_change":"2024-05-14T14:41:04.707794+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.707794+0000","last_undegraded":"2024-05-14T14:41:04.707794+0000","last_fullsized":"2024-05-14T14:41:04.707794+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":["5","6"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.724462+0000","last_change":"2024-05-14T14:41:03.722600+0000","last_active":"2024-05-14T14:41:03.724462+0000","last_peered":"2024-05-14T14:41:03.724462+0000","last_clean":"2024-05-14T14:41:03.724462+0000","last_became_active":"2024-05-14T14:41:03.722240+0000","last_became_peered":"2024-05-14T14:41:03.722240+0000","last_unstale":"2024-05-14T14:41:03.724462+0000","last_undegraded":"2024-05-14T14:41:03.724462+0000","last_fullsized":"2024-05-14T14:41:03.724462+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:19:36.739344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.708432+0000","last_change":"2024-05-14T14:41:03.708432+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.708432+0000","last_undegraded":"2024-05-14T14:41:03.708432+0000","last_fullsized":"2024-05-14T14:41:03.708432+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.723944+0000","last_change":"2024-05-14T14:41:03.719224+0000","last_active":"2024-05-14T14:41:03.723944+0000","last_peered":"2024-05-14T14:41:03.723944+0000","last_clean":"2024-05-14T14:41:03.723944+0000","last_became_active":"2024-05-14T14:41:03.718916+0000","last_became_peered":"2024-05-14T14:41:03.718916+0000","last_unstale":"2024-05-14T14:41:03.723944+0000","last_undegraded":"2024-05-14T14:41:03.723944+0000","last_fullsized":"2024-05-14T14:41:03.723944+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:29:22.537342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.720623+0000","last_change":"2024-05-14T14:41:04.719892+0000","last_active":"2024-05-14T14:41:04.720623+0000","last_peered":"2024-05-14T14:41:04.720623+0000","last_clean":"2024-05-14T14:41:04.720623+0000","last_became_active":"2024-05-14T14:41:04.719326+0000","last_became_peered":"2024-05-14T14:41:04.719326+0000","last_unstale":"2024-05-14T14:41:04.720623+0000","last_undegraded":"2024-05-14T14:41:04.720623+0000","last_fullsized":"2024-05-14T14:41:04.720623+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:25:40.670957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.709178+0000","last_change":"2024-05-14T14:41:03.723786+0000","last_active":"2024-05-14T14:41:04.709178+0000","last_peered":"2024-05-14T14:41:04.709178+0000","last_clean":"2024-05-14T14:41:04.709178+0000","last_became_active":"2024-05-14T14:41:03.723431+0000","last_became_peered":"2024-05-14T14:41:03.723431+0000","last_unstale":"2024-05-14T14:41:04.709178+0000","last_undegraded":"2024-05-14T14:41:04.709178+0000","last_fullsized":"2024-05-14T14:41:04.709178+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:46:23.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.706704+0000","last_change":"2024-05-14T14:41:03.706704+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.706704+0000","last_undegraded":"2024-05-14T14:41:03.706704+0000","last_fullsized":"2024-05-14T14:41:03.706704+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.728966+0000","last_change":"2024-05-14T14:41:03.724813+0000","last_active":"2024-05-14T14:41:03.728966+0000","last_peered":"2024-05-14T14:41:03.728966+0000","last_clean":"2024-05-14T14:41:03.728966+0000","last_became_active":"2024-05-14T14:41:03.724505+0000","last_became_peered":"2024-05-14T14:41:03.724505+0000","last_unstale":"2024-05-14T14:41:03.728966+0000","last_undegraded":"2024-05-14T14:41:03.728966+0000","last_fullsized":"2024-05-14T14:41:03.728966+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:55:44.412342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.707599+0000","last_change":"2024-05-14T14:41:03.707599+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.707599+0000","last_undegraded":"2024-05-14T14:41:03.707599+0000","last_fullsized":"2024-05-14T14:41:03.707599+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.728739+0000","last_change":"2024-05-14T14:41:03.724743+0000","last_active":"2024-05-14T14:41:03.728739+0000","last_peered":"2024-05-14T14:41:03.728739+0000","last_clean":"2024-05-14T14:41:03.728739+0000","last_became_active":"2024-05-14T14:41:03.724406+0000","last_became_peered":"2024-05-14T14:41:03.724406+0000","last_unstale":"2024-05-14T14:41:03.728739+0000","last_undegraded":"2024-05-14T14:41:03.728739+0000","last_fullsized":"2024-05-14T14:41:03.728739+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:35:33.172311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.712018+0000","last_change":"2024-05-14T14:41:03.712018+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.712018+0000","last_undegraded":"2024-05-14T14:41:03.712018+0000","last_fullsized":"2024-05-14T14:41:03.712018+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.728768+0000","last_change":"2024-05-14T14:41:03.724699+0000","last_active":"2024-05-14T14:41:03.728768+0000","last_peered":"2024-05-14T14:41:03.728768+0000","last_clean":"2024-05-14T14:41:03.728768+0000","last_became_active":"2024-05-14T14:41:03.724321+0000","last_became_peered":"2024-05-14T14:41:03.724321+0000","last_unstale":"2024-05-14T14:41:03.728768+0000","last_undegraded":"2024-05-14T14:41:03.728768+0000","last_fullsized":"2024-05-14T14:41:03.728768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:24:26.460528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.711202+0000","last_change":"2024-05-14T14:41:04.711202+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.711202+0000","last_undegraded":"2024-05-14T14:41:04.711202+0000","last_fullsized":"2024-05-14T14:41:04.711202+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.726325+0000","last_change":"2024-05-14T14:41:03.719362+0000","last_active":"2024-05-14T14:41:03.726325+0000","last_peered":"2024-05-14T14:41:03.726325+0000","last_clean":"2024-05-14T14:41:03.726325+0000","last_became_active":"2024-05-14T14:41:03.719038+0000","last_became_peered":"2024-05-14T14:41:03.719038+0000","last_unstale":"2024-05-14T14:41:03.726325+0000","last_undegraded":"2024-05-14T14:41:03.726325+0000","last_fullsized":"2024-05-14T14:41:03.726325+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:20:11.233493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.707282+0000","last_change":"2024-05-14T14:41:04.707282+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.707282+0000","last_undegraded":"2024-05-14T14:41:04.707282+0000","last_fullsized":"2024-05-14T14:41:04.707282+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.707074+0000","last_change":"2024-05-14T14:41:03.726792+0000","last_active":"2024-05-14T14:41:04.707074+0000","last_peered":"2024-05-14T14:41:04.707074+0000","last_clean":"2024-05-14T14:41:04.707074+0000","last_became_active":"2024-05-14T14:41:03.726248+0000","last_became_peered":"2024-05-14T14:41:03.726248+0000","last_unstale":"2024-05-14T14:41:04.707074+0000","last_undegraded":"2024-05-14T14:41:04.707074+0000","last_fullsized":"2024-05-14T14:41:04.707074+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:35:33.172311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.706448+0000","last_change":"2024-05-14T14:41:03.706448+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.706448+0000","last_undegraded":"2024-05-14T14:41:03.706448+0000","last_fullsized":"2024-05-14T14:41:03.706448+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.728711+0000","last_change":"2024-05-14T14:41:03.723567+0000","last_active":"2024-05-14T14:41:03.728711+0000","last_peered":"2024-05-14T14:41:03.728711+0000","last_clean":"2024-05-14T14:41:03.728711+0000","last_became_active":"2024-05-14T14:41:03.723265+0000","last_became_peered":"2024-05-14T14:41:03.723265+0000","last_unstale":"2024-05-14T14:41:03.728711+0000","last_undegraded":"2024-05-14T14:41:03.728711+0000","last_fullsized":"2024-05-14T14:41:03.728711+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:25:39.658272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.708386+0000","last_change":"2024-05-14T14:41:04.708386+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.708386+0000","last_undegraded":"2024-05-14T14:41:04.708386+0000","last_fullsized":"2024-05-14T14:41:04.708386+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.723197+0000","last_change":"2024-05-14T14:41:03.718095+0000","last_active":"2024-05-14T14:41:03.723197+0000","last_peered":"2024-05-14T14:41:03.723197+0000","last_clean":"2024-05-14T14:41:03.723197+0000","last_became_active":"2024-05-14T14:41:03.717721+0000","last_became_peered":"2024-05-14T14:41:03.717721+0000","last_unstale":"2024-05-14T14:41:03.723197+0000","last_undegraded":"2024-05-14T14:41:03.723197+0000","last_fullsized":"2024-05-14T14:41:03.723197+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:48:09.099466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":134,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.709908+0000","last_change":"2024-05-14T14:40:06.302050+0000","last_active":"2024-05-14T14:41:03.709908+0000","last_peered":"2024-05-14T14:41:03.709908+0000","last_clean":"2024-05-14T14:41:03.709908+0000","last_became_active":"2024-05-14T14:40:06.300956+0000","last_became_peered":"2024-05-14T14:40:06.300956+0000","last_unstale":"2024-05-14T14:41:03.709908+0000","last_undegraded":"2024-05-14T14:41:03.709908+0000","last_fullsized":"2024-05-14T14:41:03.709908+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:04.850996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:04.850996+0000","last_clean_scrub_stamp":"2024-05-14T14:40:04.850996+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:08:41.028114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":983040,"data_stored":751820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":161452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":161452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":161452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":389120,"data_stored":161452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":161452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":389120,"data_stored":161452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":983040,"data_stored":751820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T14:41:09.563 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3f is not active+clean 2024-05-14T14:41:09.563 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-05-14T14:41:03.710751+0000', 'last_change': '2024-05-14T14:41:03.710751+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:03.710751+0000', 'last_undegraded': '2024-05-14T14:41:03.710751+0000', 'last_fullsized': '2024-05-14T14:41:03.710751+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-14T14:41:09.563 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3e is not active+clean 2024-05-14T14:41:09.563 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-05-14T14:41:03.711273+0000', 'last_change': '2024-05-14T14:41:03.711273+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:03.711273+0000', 'last_undegraded': '2024-05-14T14:41:03.711273+0000', 'last_fullsized': '2024-05-14T14:41:03.711273+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-14T14:41:09.564 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3d is not active+clean 2024-05-14T14:41:09.564 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-05-14T14:41:03.712600+0000', 'last_change': '2024-05-14T14:41:03.712600+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:03.712600+0000', 'last_undegraded': '2024-05-14T14:41:03.712600+0000', 'last_fullsized': '2024-05-14T14:41:03.712600+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-14T14:41:09.564 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3c is not active+clean 2024-05-14T14:41:09.564 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-05-14T14:41:03.710582+0000', 'last_change': '2024-05-14T14:41:03.710582+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:03.710582+0000', 'last_undegraded': '2024-05-14T14:41:03.710582+0000', 'last_fullsized': '2024-05-14T14:41:03.710582+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-14T14:41:09.564 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3b is not active+clean 2024-05-14T14:41:09.564 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-05-14T14:41:03.710541+0000', 'last_change': '2024-05-14T14:41:03.710541+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:03.710541+0000', 'last_undegraded': '2024-05-14T14:41:03.710541+0000', 'last_fullsized': '2024-05-14T14:41:03.710541+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-14T14:41:09.564 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3a is not active+clean 2024-05-14T14:41:09.564 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 35, 'state': 'creating+activating', 'last_fresh': '2024-05-14T14:41:04.711520+0000', 'last_change': '2024-05-14T14:41:04.711520+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:04.711520+0000', 'last_undegraded': '2024-05-14T14:41:04.711520+0000', 'last_fullsized': '2024-05-14T14:41:04.711520+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': ['1', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-14T14:41:09.564 INFO:tasks.ceph.ceph_manager.ceph:PG 6.39 is not active+clean 2024-05-14T14:41:09.564 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 35, 'state': 'creating+activating', 'last_fresh': '2024-05-14T14:41:04.707430+0000', 'last_change': '2024-05-14T14:41:04.707430+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:04.707430+0000', 'last_undegraded': '2024-05-14T14:41:04.707430+0000', 'last_fullsized': '2024-05-14T14:41:04.707430+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': ['5', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-14T14:41:09.565 INFO:tasks.ceph.ceph_manager.ceph:PG 6.38 is not active+clean 2024-05-14T14:41:09.565 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-05-14T14:41:03.712079+0000', 'last_change': '2024-05-14T14:41:03.712079+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:03.712079+0000', 'last_undegraded': '2024-05-14T14:41:03.712079+0000', 'last_fullsized': '2024-05-14T14:41:03.712079+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-14T14:41:09.565 INFO:tasks.ceph.ceph_manager.ceph:PG 6.37 is not active+clean 2024-05-14T14:41:09.565 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-05-14T14:41:03.712021+0000', 'last_change': '2024-05-14T14:41:03.712021+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:03.712021+0000', 'last_undegraded': '2024-05-14T14:41:03.712021+0000', 'last_fullsized': '2024-05-14T14:41:03.712021+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-14T14:41:09.565 INFO:tasks.ceph.ceph_manager.ceph:PG 6.36 is not active+clean 2024-05-14T14:41:09.565 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 35, 'state': 'creating+activating', 'last_fresh': '2024-05-14T14:41:04.709089+0000', 'last_change': '2024-05-14T14:41:04.709089+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:04.709089+0000', 'last_undegraded': '2024-05-14T14:41:04.709089+0000', 'last_fullsized': '2024-05-14T14:41:04.709089+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': ['5', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-14T14:41:09.565 INFO:tasks.ceph.ceph_manager.ceph:PG 6.34 is not active+clean 2024-05-14T14:41:09.565 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-05-14T14:41:03.712853+0000', 'last_change': '2024-05-14T14:41:03.712853+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:03.712853+0000', 'last_undegraded': '2024-05-14T14:41:03.712853+0000', 'last_fullsized': '2024-05-14T14:41:03.712853+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-14T14:41:09.565 INFO:tasks.ceph.ceph_manager.ceph:PG 6.33 is not active+clean 2024-05-14T14:41:09.565 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 35, 'state': 'creating+activating', 'last_fresh': '2024-05-14T14:41:04.707023+0000', 'last_change': '2024-05-14T14:41:04.707023+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:04.707023+0000', 'last_undegraded': '2024-05-14T14:41:04.707023+0000', 'last_fullsized': '2024-05-14T14:41:04.707023+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': ['5', '7'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-14T14:41:09.566 INFO:tasks.ceph.ceph_manager.ceph:PG 6.32 is not active+clean 2024-05-14T14:41:09.566 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 35, 'state': 'creating+activating', 'last_fresh': '2024-05-14T14:41:04.707681+0000', 'last_change': '2024-05-14T14:41:04.707681+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:04.707681+0000', 'last_undegraded': '2024-05-14T14:41:04.707681+0000', 'last_fullsized': '2024-05-14T14:41:04.707681+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': ['4', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-14T14:41:09.566 INFO:tasks.ceph.ceph_manager.ceph:PG 6.31 is not active+clean 2024-05-14T14:41:09.566 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 35, 'state': 'creating+activating', 'last_fresh': '2024-05-14T14:41:04.707342+0000', 'last_change': '2024-05-14T14:41:04.707342+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:04.707342+0000', 'last_undegraded': '2024-05-14T14:41:04.707342+0000', 'last_fullsized': '2024-05-14T14:41:04.707342+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': ['5', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-14T14:41:09.566 INFO:tasks.ceph.ceph_manager.ceph:PG 6.30 is not active+clean 2024-05-14T14:41:09.566 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-05-14T14:41:03.709076+0000', 'last_change': '2024-05-14T14:41:03.709076+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:03.709076+0000', 'last_undegraded': '2024-05-14T14:41:03.709076+0000', 'last_fullsized': '2024-05-14T14:41:03.709076+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-14T14:41:09.566 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2f is not active+clean 2024-05-14T14:41:09.566 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-05-14T14:41:03.708302+0000', 'last_change': '2024-05-14T14:41:03.708302+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:03.708302+0000', 'last_undegraded': '2024-05-14T14:41:03.708302+0000', 'last_fullsized': '2024-05-14T14:41:03.708302+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-14T14:41:09.566 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2e is not active+clean 2024-05-14T14:41:09.566 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-05-14T14:41:03.706987+0000', 'last_change': '2024-05-14T14:41:03.706987+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:03.706987+0000', 'last_undegraded': '2024-05-14T14:41:03.706987+0000', 'last_fullsized': '2024-05-14T14:41:03.706987+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-14T14:41:09.566 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2d is not active+clean 2024-05-14T14:41:09.567 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-05-14T14:41:03.711391+0000', 'last_change': '2024-05-14T14:41:03.711391+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:03.711391+0000', 'last_undegraded': '2024-05-14T14:41:03.711391+0000', 'last_fullsized': '2024-05-14T14:41:03.711391+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-14T14:41:09.567 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2c is not active+clean 2024-05-14T14:41:09.567 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-05-14T14:41:03.706446+0000', 'last_change': '2024-05-14T14:41:03.706446+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:03.706446+0000', 'last_undegraded': '2024-05-14T14:41:03.706446+0000', 'last_fullsized': '2024-05-14T14:41:03.706446+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-14T14:41:09.567 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2b is not active+clean 2024-05-14T14:41:09.567 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 35, 'state': 'creating+activating', 'last_fresh': '2024-05-14T14:41:04.707459+0000', 'last_change': '2024-05-14T14:41:04.707459+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:04.707459+0000', 'last_undegraded': '2024-05-14T14:41:04.707459+0000', 'last_fullsized': '2024-05-14T14:41:04.707459+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': ['5', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-14T14:41:09.567 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2a is not active+clean 2024-05-14T14:41:09.567 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 35, 'state': 'creating+activating', 'last_fresh': '2024-05-14T14:41:04.706820+0000', 'last_change': '2024-05-14T14:41:04.706820+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:04.706820+0000', 'last_undegraded': '2024-05-14T14:41:04.706820+0000', 'last_fullsized': '2024-05-14T14:41:04.706820+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': ['4', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-14T14:41:09.567 INFO:tasks.ceph.ceph_manager.ceph:PG 6.29 is not active+clean 2024-05-14T14:41:09.567 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-05-14T14:41:03.708608+0000', 'last_change': '2024-05-14T14:41:03.708608+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:03.708608+0000', 'last_undegraded': '2024-05-14T14:41:03.708608+0000', 'last_fullsized': '2024-05-14T14:41:03.708608+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-14T14:41:09.567 INFO:tasks.ceph.ceph_manager.ceph:PG 6.28 is not active+clean 2024-05-14T14:41:09.567 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-05-14T14:41:03.709136+0000', 'last_change': '2024-05-14T14:41:03.709136+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:03.709136+0000', 'last_undegraded': '2024-05-14T14:41:03.709136+0000', 'last_fullsized': '2024-05-14T14:41:03.709136+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-14T14:41:09.568 INFO:tasks.ceph.ceph_manager.ceph:PG 6.27 is not active+clean 2024-05-14T14:41:09.568 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-05-14T14:41:03.707415+0000', 'last_change': '2024-05-14T14:41:03.707415+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:03.707415+0000', 'last_undegraded': '2024-05-14T14:41:03.707415+0000', 'last_fullsized': '2024-05-14T14:41:03.707415+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-14T14:41:09.568 INFO:tasks.ceph.ceph_manager.ceph:PG 6.25 is not active+clean 2024-05-14T14:41:09.568 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-05-14T14:41:03.705867+0000', 'last_change': '2024-05-14T14:41:03.705867+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:03.705867+0000', 'last_undegraded': '2024-05-14T14:41:03.705867+0000', 'last_fullsized': '2024-05-14T14:41:03.705867+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-14T14:41:09.568 INFO:tasks.ceph.ceph_manager.ceph:PG 6.24 is not active+clean 2024-05-14T14:41:09.569 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 35, 'state': 'creating+activating', 'last_fresh': '2024-05-14T14:41:04.708320+0000', 'last_change': '2024-05-14T14:41:04.708320+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:04.708320+0000', 'last_undegraded': '2024-05-14T14:41:04.708320+0000', 'last_fullsized': '2024-05-14T14:41:04.708320+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': ['5', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-14T14:41:09.569 INFO:tasks.ceph.ceph_manager.ceph:PG 6.23 is not active+clean 2024-05-14T14:41:09.569 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-05-14T14:41:03.706862+0000', 'last_change': '2024-05-14T14:41:03.706862+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:03.706862+0000', 'last_undegraded': '2024-05-14T14:41:03.706862+0000', 'last_fullsized': '2024-05-14T14:41:03.706862+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-14T14:41:09.569 INFO:tasks.ceph.ceph_manager.ceph:PG 6.22 is not active+clean 2024-05-14T14:41:09.569 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-05-14T14:41:03.706355+0000', 'last_change': '2024-05-14T14:41:03.706355+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:03.706355+0000', 'last_undegraded': '2024-05-14T14:41:03.706355+0000', 'last_fullsized': '2024-05-14T14:41:03.706355+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-05-14T14:41:09.569 INFO:tasks.ceph.ceph_manager.ceph:PG 6.21 is not active+clean 2024-05-14T14:41:09.569 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-05-14T14:41:03.706245+0000', 'last_change': '2024-05-14T14:41:03.706245+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:03.706245+0000', 'last_undegraded': '2024-05-14T14:41:03.706245+0000', 'last_fullsized': '2024-05-14T14:41:03.706245+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-14T14:41:09.569 INFO:tasks.ceph.ceph_manager.ceph:PG 6.20 is not active+clean 2024-05-14T14:41:09.569 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 35, 'state': 'creating+activating', 'last_fresh': '2024-05-14T14:41:04.711669+0000', 'last_change': '2024-05-14T14:41:04.711669+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:04.711669+0000', 'last_undegraded': '2024-05-14T14:41:04.711669+0000', 'last_fullsized': '2024-05-14T14:41:04.711669+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': ['1', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-14T14:41:09.569 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1c is not active+clean 2024-05-14T14:41:09.569 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-05-14T14:41:03.707141+0000', 'last_change': '2024-05-14T14:41:03.707141+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:03.707141+0000', 'last_undegraded': '2024-05-14T14:41:03.707141+0000', 'last_fullsized': '2024-05-14T14:41:03.707141+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-14T14:41:09.570 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1e is not active+clean 2024-05-14T14:41:09.570 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 35, 'state': 'creating+activating', 'last_fresh': '2024-05-14T14:41:04.707153+0000', 'last_change': '2024-05-14T14:41:04.707153+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:04.707153+0000', 'last_undegraded': '2024-05-14T14:41:04.707153+0000', 'last_fullsized': '2024-05-14T14:41:04.707153+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': ['4', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-14T14:41:09.570 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1f is not active+clean 2024-05-14T14:41:09.570 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-05-14T14:41:03.710318+0000', 'last_change': '2024-05-14T14:41:03.710318+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:03.710318+0000', 'last_undegraded': '2024-05-14T14:41:03.710318+0000', 'last_fullsized': '2024-05-14T14:41:03.710318+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-14T14:41:09.570 INFO:tasks.ceph.ceph_manager.ceph:PG 6.18 is not active+clean 2024-05-14T14:41:09.570 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-05-14T14:41:03.713211+0000', 'last_change': '2024-05-14T14:41:03.713211+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:03.713211+0000', 'last_undegraded': '2024-05-14T14:41:03.713211+0000', 'last_fullsized': '2024-05-14T14:41:03.713211+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-14T14:41:09.570 INFO:tasks.ceph.ceph_manager.ceph:PG 6.19 is not active+clean 2024-05-14T14:41:09.570 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 35, 'state': 'creating+activating', 'last_fresh': '2024-05-14T14:41:04.706964+0000', 'last_change': '2024-05-14T14:41:04.706964+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:04.706964+0000', 'last_undegraded': '2024-05-14T14:41:04.706964+0000', 'last_fullsized': '2024-05-14T14:41:04.706964+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': ['5', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-14T14:41:09.570 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1b is not active+clean 2024-05-14T14:41:09.570 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-05-14T14:41:03.710142+0000', 'last_change': '2024-05-14T14:41:03.710142+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:03.710142+0000', 'last_undegraded': '2024-05-14T14:41:03.710142+0000', 'last_fullsized': '2024-05-14T14:41:03.710142+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-14T14:41:09.571 INFO:tasks.ceph.ceph_manager.ceph:PG 6.14 is not active+clean 2024-05-14T14:41:09.571 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-05-14T14:41:03.710161+0000', 'last_change': '2024-05-14T14:41:03.710161+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:03.710161+0000', 'last_undegraded': '2024-05-14T14:41:03.710161+0000', 'last_fullsized': '2024-05-14T14:41:03.710161+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-14T14:41:09.571 INFO:tasks.ceph.ceph_manager.ceph:PG 6.15 is not active+clean 2024-05-14T14:41:09.571 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-05-14T14:41:03.707881+0000', 'last_change': '2024-05-14T14:41:03.707881+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:03.707881+0000', 'last_undegraded': '2024-05-14T14:41:03.707881+0000', 'last_fullsized': '2024-05-14T14:41:03.707881+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-14T14:41:09.571 INFO:tasks.ceph.ceph_manager.ceph:PG 6.16 is not active+clean 2024-05-14T14:41:09.571 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-05-14T14:41:03.713459+0000', 'last_change': '2024-05-14T14:41:03.713459+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:03.713459+0000', 'last_undegraded': '2024-05-14T14:41:03.713459+0000', 'last_fullsized': '2024-05-14T14:41:03.713459+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-14T14:41:09.571 INFO:tasks.ceph.ceph_manager.ceph:PG 6.17 is not active+clean 2024-05-14T14:41:09.571 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 35, 'state': 'creating+activating', 'last_fresh': '2024-05-14T14:41:04.708166+0000', 'last_change': '2024-05-14T14:41:04.708166+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:04.708166+0000', 'last_undegraded': '2024-05-14T14:41:04.708166+0000', 'last_fullsized': '2024-05-14T14:41:04.708166+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': ['4', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-14T14:41:09.571 INFO:tasks.ceph.ceph_manager.ceph:PG 6.10 is not active+clean 2024-05-14T14:41:09.571 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-05-14T14:41:03.712543+0000', 'last_change': '2024-05-14T14:41:03.712543+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:03.712543+0000', 'last_undegraded': '2024-05-14T14:41:03.712543+0000', 'last_fullsized': '2024-05-14T14:41:03.712543+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-14T14:41:09.571 INFO:tasks.ceph.ceph_manager.ceph:PG 6.11 is not active+clean 2024-05-14T14:41:09.572 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-05-14T14:41:03.709531+0000', 'last_change': '2024-05-14T14:41:03.709531+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:03.709531+0000', 'last_undegraded': '2024-05-14T14:41:03.709531+0000', 'last_fullsized': '2024-05-14T14:41:03.709531+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-14T14:41:09.572 INFO:tasks.ceph.ceph_manager.ceph:PG 6.12 is not active+clean 2024-05-14T14:41:09.572 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-05-14T14:41:03.705770+0000', 'last_change': '2024-05-14T14:41:03.705770+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:03.705770+0000', 'last_undegraded': '2024-05-14T14:41:03.705770+0000', 'last_fullsized': '2024-05-14T14:41:03.705770+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-14T14:41:09.572 INFO:tasks.ceph.ceph_manager.ceph:PG 6.13 is not active+clean 2024-05-14T14:41:09.572 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-05-14T14:41:03.709721+0000', 'last_change': '2024-05-14T14:41:03.709721+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:03.709721+0000', 'last_undegraded': '2024-05-14T14:41:03.709721+0000', 'last_fullsized': '2024-05-14T14:41:03.709721+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-14T14:41:09.572 INFO:tasks.ceph.ceph_manager.ceph:PG 6.c is not active+clean 2024-05-14T14:41:09.572 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-05-14T14:41:03.709005+0000', 'last_change': '2024-05-14T14:41:03.709005+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:03.709005+0000', 'last_undegraded': '2024-05-14T14:41:03.709005+0000', 'last_fullsized': '2024-05-14T14:41:03.709005+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-14T14:41:09.572 INFO:tasks.ceph.ceph_manager.ceph:PG 6.d is not active+clean 2024-05-14T14:41:09.572 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 35, 'state': 'creating+activating', 'last_fresh': '2024-05-14T14:41:04.710078+0000', 'last_change': '2024-05-14T14:41:04.710078+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:04.710078+0000', 'last_undegraded': '2024-05-14T14:41:04.710078+0000', 'last_fullsized': '2024-05-14T14:41:04.710078+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': ['5', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-14T14:41:09.572 INFO:tasks.ceph.ceph_manager.ceph:PG 6.e is not active+clean 2024-05-14T14:41:09.572 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 35, 'state': 'creating+activating', 'last_fresh': '2024-05-14T14:41:04.707064+0000', 'last_change': '2024-05-14T14:41:04.707064+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:04.707064+0000', 'last_undegraded': '2024-05-14T14:41:04.707064+0000', 'last_fullsized': '2024-05-14T14:41:04.707064+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': ['4', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-14T14:41:09.573 INFO:tasks.ceph.ceph_manager.ceph:PG 6.f is not active+clean 2024-05-14T14:41:09.573 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-05-14T14:41:03.710449+0000', 'last_change': '2024-05-14T14:41:03.710449+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:03.710449+0000', 'last_undegraded': '2024-05-14T14:41:03.710449+0000', 'last_fullsized': '2024-05-14T14:41:03.710449+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-05-14T14:41:09.573 INFO:tasks.ceph.ceph_manager.ceph:PG 6.8 is not active+clean 2024-05-14T14:41:09.573 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-05-14T14:41:03.708355+0000', 'last_change': '2024-05-14T14:41:03.708355+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:03.708355+0000', 'last_undegraded': '2024-05-14T14:41:03.708355+0000', 'last_fullsized': '2024-05-14T14:41:03.708355+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-14T14:41:09.573 INFO:tasks.ceph.ceph_manager.ceph:PG 6.9 is not active+clean 2024-05-14T14:41:09.573 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-05-14T14:41:03.712524+0000', 'last_change': '2024-05-14T14:41:03.712524+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:03.712524+0000', 'last_undegraded': '2024-05-14T14:41:03.712524+0000', 'last_fullsized': '2024-05-14T14:41:03.712524+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-14T14:41:09.573 INFO:tasks.ceph.ceph_manager.ceph:PG 6.a is not active+clean 2024-05-14T14:41:09.573 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 35, 'state': 'creating+activating', 'last_fresh': '2024-05-14T14:41:04.707794+0000', 'last_change': '2024-05-14T14:41:04.707794+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:04.707794+0000', 'last_undegraded': '2024-05-14T14:41:04.707794+0000', 'last_fullsized': '2024-05-14T14:41:04.707794+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': ['5', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-14T14:41:09.573 INFO:tasks.ceph.ceph_manager.ceph:PG 6.b is not active+clean 2024-05-14T14:41:09.573 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-05-14T14:41:03.708432+0000', 'last_change': '2024-05-14T14:41:03.708432+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:03.708432+0000', 'last_undegraded': '2024-05-14T14:41:03.708432+0000', 'last_fullsized': '2024-05-14T14:41:03.708432+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-14T14:41:09.573 INFO:tasks.ceph.ceph_manager.ceph:PG 6.5 is not active+clean 2024-05-14T14:41:09.574 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-05-14T14:41:03.706704+0000', 'last_change': '2024-05-14T14:41:03.706704+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:03.706704+0000', 'last_undegraded': '2024-05-14T14:41:03.706704+0000', 'last_fullsized': '2024-05-14T14:41:03.706704+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-14T14:41:09.574 INFO:tasks.ceph.ceph_manager.ceph:PG 6.6 is not active+clean 2024-05-14T14:41:09.574 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-05-14T14:41:03.707599+0000', 'last_change': '2024-05-14T14:41:03.707599+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:03.707599+0000', 'last_undegraded': '2024-05-14T14:41:03.707599+0000', 'last_fullsized': '2024-05-14T14:41:03.707599+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-05-14T14:41:09.574 INFO:tasks.ceph.ceph_manager.ceph:PG 6.0 is not active+clean 2024-05-14T14:41:09.574 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-05-14T14:41:03.712018+0000', 'last_change': '2024-05-14T14:41:03.712018+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:03.712018+0000', 'last_undegraded': '2024-05-14T14:41:03.712018+0000', 'last_fullsized': '2024-05-14T14:41:03.712018+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-05-14T14:41:09.574 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1 is not active+clean 2024-05-14T14:41:09.574 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 35, 'state': 'creating+activating', 'last_fresh': '2024-05-14T14:41:04.711202+0000', 'last_change': '2024-05-14T14:41:04.711202+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:04.711202+0000', 'last_undegraded': '2024-05-14T14:41:04.711202+0000', 'last_fullsized': '2024-05-14T14:41:04.711202+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': ['1', '6'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-05-14T14:41:09.574 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2 is not active+clean 2024-05-14T14:41:09.574 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 35, 'state': 'creating+activating', 'last_fresh': '2024-05-14T14:41:04.707282+0000', 'last_change': '2024-05-14T14:41:04.707282+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:04.707282+0000', 'last_undegraded': '2024-05-14T14:41:04.707282+0000', 'last_fullsized': '2024-05-14T14:41:04.707282+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': ['4', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-05-14T14:41:09.574 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3 is not active+clean 2024-05-14T14:41:09.574 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-05-14T14:41:03.706448+0000', 'last_change': '2024-05-14T14:41:03.706448+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:03.706448+0000', 'last_undegraded': '2024-05-14T14:41:03.706448+0000', 'last_fullsized': '2024-05-14T14:41:03.706448+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-05-14T14:41:09.575 INFO:tasks.ceph.ceph_manager.ceph:PG 6.7 is not active+clean 2024-05-14T14:41:09.575 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 35, 'state': 'creating+activating', 'last_fresh': '2024-05-14T14:41:04.708386+0000', 'last_change': '2024-05-14T14:41:04.708386+0000', 'last_active': '2024-05-14T14:41:03.688710+0000', 'last_peered': '2024-05-14T14:41:03.688710+0000', 'last_clean': '2024-05-14T14:41:03.688710+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-05-14T14:41:04.708386+0000', 'last_undegraded': '2024-05-14T14:41:04.708386+0000', 'last_fullsized': '2024-05-14T14:41:04.708386+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'last_clean_scrub_stamp': '2024-05-14T14:41:03.688710+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': ['5', '3'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-05-14T14:41:09.575 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-05-14T14:41:09.576 INFO:tasks.ceph.mds.b.smithi062.stderr:2024-05-14T14:41:09.585+0000 7fcc22b1a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-14T14:41:09.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.729+0000 7fe81e2d9640 1 Processor -- start 2024-05-14T14:41:09.714 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.729+0000 7fe81e2d9640 1 -- start start 2024-05-14T14:41:09.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.730+0000 7fe81e2d9640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe81815e240 0x7fe818162660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:09.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.730+0000 7fe81e2d9640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8180b5500 0x7fe8180b5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:09.715 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.730+0000 7fe81e2d9640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe818162ba0 con 0x7fe8180ce2e0 2024-05-14T14:41:09.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.731+0000 7fe81e2d9640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7fe818071190 con 0x7fe81815e240 2024-05-14T14:41:09.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.731+0000 7fe81e2d9640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe8180b5e50 con 0x7fe8180b5500 2024-05-14T14:41:09.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.731+0000 7fe8177fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8180b5500 0x7fe8180b5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:09.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.731+0000 7fe817fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe81815e240 0x7fe818162660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:09.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.731+0000 7fe8177fe640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8180b5500 0x7fe8180b5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3301/0 says I am v2:172.21.15.39:44580/0 (socket says 172.21.15.39:44580) 2024-05-14T14:41:09.716 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.731+0000 7fe8177fe640 1 -- 172.21.15.39:0/2869162386 learned_addr learned my addr 172.21.15.39:0/2869162386 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:41:09.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.731+0000 7fe8177fe640 1 -- 172.21.15.39:0/2869162386 >> v2:172.21.15.62:3300/0 conn(0x7fe81815e240 msgr2=0x7fe818162660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:09.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.731+0000 7fe8177fe640 1 --2- 172.21.15.39:0/2869162386 >> v2:172.21.15.62:3300/0 conn(0x7fe81815e240 0x7fe818162660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:09.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.731+0000 7fe8177fe640 1 -- 172.21.15.39:0/2869162386 >> v1:172.21.15.62:6789/0 conn(0x7fe8180ce2e0 legacy=0x7fe8180ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:09.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.731+0000 7fe8177fe640 1 -- 172.21.15.39:0/2869162386 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe818070580 con 0x7fe8180b5500 2024-05-14T14:41:09.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.731+0000 7fe817fff640 1 --2- 172.21.15.39:0/2869162386 >> v2:172.21.15.62:3300/0 conn(0x7fe81815e240 0x7fe818162660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T14:41:09.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.732+0000 7fe8177fe640 1 --2- 172.21.15.39:0/2869162386 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8180b5500 0x7fe8180b5910 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe80c009870 tx=0x7fe80c02a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9832a90deb5e01b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:09.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.732+0000 7fe816ffd640 1 -- 172.21.15.39:0/2869162386 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80c037070 con 0x7fe8180b5500 2024-05-14T14:41:09.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.732+0000 7fe816ffd640 1 -- 172.21.15.39:0/2869162386 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe80c032440 con 0x7fe8180b5500 2024-05-14T14:41:09.717 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.732+0000 7fe816ffd640 1 -- 172.21.15.39:0/2869162386 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80c032810 con 0x7fe8180b5500 2024-05-14T14:41:09.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.733+0000 7fe81e2d9640 1 -- 172.21.15.39:0/2869162386 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8180b5500 msgr2=0x7fe8180b5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:09.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.733+0000 7fe81e2d9640 1 --2- 172.21.15.39:0/2869162386 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8180b5500 0x7fe8180b5910 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe80c009870 tx=0x7fe80c02a270 comp rx=0 tx=0).stop 2024-05-14T14:41:09.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.733+0000 7fe81e2d9640 1 -- 172.21.15.39:0/2869162386 shutdown_connections 2024-05-14T14:41:09.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.733+0000 7fe81e2d9640 1 --2- 172.21.15.39:0/2869162386 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8180b5500 0x7fe8180b5910 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:09.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.733+0000 7fe81e2d9640 1 --2- 172.21.15.39:0/2869162386 >> v2:172.21.15.62:3300/0 conn(0x7fe81815e240 0x7fe818162660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:09.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.733+0000 7fe81e2d9640 1 -- 172.21.15.39:0/2869162386 >> 172.21.15.39:0/2869162386 conn(0x7fe8180d0500 msgr2=0x7fe8180d0910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:09.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.733+0000 7fe81e2d9640 1 -- 172.21.15.39:0/2869162386 shutdown_connections 2024-05-14T14:41:09.718 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.733+0000 7fe81e2d9640 1 -- 172.21.15.39:0/2869162386 wait complete. 2024-05-14T14:41:09.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.735+0000 7fe81e2d9640 1 Processor -- start 2024-05-14T14:41:09.719 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.735+0000 7fe81e2d9640 1 -- start start 2024-05-14T14:41:09.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.736+0000 7fe81e2d9640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8180b5500 0x7fe81815b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:09.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.736+0000 7fe81e2d9640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8180ce2e0 0x7fe8180b8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:09.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.736+0000 7fe81e2d9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe81815e240 0x7fe8180b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:09.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.736+0000 7fe81e2d9640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fe818070e20 con 0x7fe8180ce2e0 2024-05-14T14:41:09.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.736+0000 7fe81e2d9640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fe818070b40 con 0x7fe81815e240 2024-05-14T14:41:09.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.736+0000 7fe81e2d9640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fe818070250 con 0x7fe8180b5500 2024-05-14T14:41:09.722 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.736+0000 7fe8177fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8180ce2e0 0x7fe8180b8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:09.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.736+0000 7fe8177fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8180ce2e0 0x7fe8180b8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41352/0 (socket says 172.21.15.39:41352) 2024-05-14T14:41:09.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.736+0000 7fe8177fe640 1 -- 172.21.15.39:0/3895885461 learned_addr learned my addr 172.21.15.39:0/3895885461 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:41:09.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.737+0000 7fe817fff640 1 --2- 172.21.15.39:0/3895885461 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8180b5500 0x7fe81815b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:09.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.737+0000 7fe81c876640 1 --2- 172.21.15.39:0/3895885461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe81815e240 0x7fe8180b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:09.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.737+0000 7fe8177fe640 1 -- 172.21.15.39:0/3895885461 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8180b5500 msgr2=0x7fe81815b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:09.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.737+0000 7fe8177fe640 1 --2- 172.21.15.39:0/3895885461 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8180b5500 0x7fe81815b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:09.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.737+0000 7fe8177fe640 1 -- 172.21.15.39:0/3895885461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe81815e240 msgr2=0x7fe8180b41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:09.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.737+0000 7fe8177fe640 1 --2- 172.21.15.39:0/3895885461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe81815e240 0x7fe8180b41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:09.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.737+0000 7fe8177fe640 1 -- 172.21.15.39:0/3895885461 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8180cdb60 con 0x7fe8180ce2e0 2024-05-14T14:41:09.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.737+0000 7fe8177fe640 1 --2- 172.21.15.39:0/3895885461 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8180ce2e0 0x7fe8180b8270 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe80c000c00 tx=0x7fe80c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:09.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.737+0000 7fe814ff9640 1 -- 172.21.15.39:0/3895885461 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80c037040 con 0x7fe8180ce2e0 2024-05-14T14:41:09.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.737+0000 7fe814ff9640 1 -- 172.21.15.39:0/3895885461 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe80c042070 con 0x7fe8180ce2e0 2024-05-14T14:41:09.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.737+0000 7fe81e2d9640 1 -- 172.21.15.39:0/3895885461 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8180b8e50 con 0x7fe8180ce2e0 2024-05-14T14:41:09.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.737+0000 7fe814ff9640 1 -- 172.21.15.39:0/3895885461 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80c030880 con 0x7fe8180ce2e0 2024-05-14T14:41:09.723 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.737+0000 7fe81e2d9640 1 -- 172.21.15.39:0/3895885461 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8180b6ee0 con 0x7fe8180ce2e0 2024-05-14T14:41:09.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.738+0000 7fe81e2d9640 1 -- 172.21.15.39:0/3895885461 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe818076aa0 con 0x7fe8180ce2e0 2024-05-14T14:41:09.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.739+0000 7fe814ff9640 1 -- 172.21.15.39:0/3895885461 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fe80c030a20 con 0x7fe8180ce2e0 2024-05-14T14:41:09.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.740+0000 7fe814ff9640 1 --2- 172.21.15.39:0/3895885461 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe804076300 0x7fe804078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:09.724 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.740+0000 7fe817fff640 1 --2- 172.21.15.39:0/3895885461 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe804076300 0x7fe804078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:09.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.740+0000 7fe814ff9640 1 -- 172.21.15.39:0/3895885461 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7fe80c0b7f10 con 0x7fe8180ce2e0 2024-05-14T14:41:09.725 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.740+0000 7fe817fff640 1 --2- 172.21.15.39:0/3895885461 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe804076300 0x7fe804078810 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe808009560 tx=0x7fe808009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:09.729 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:09.745+0000 7fe814ff9640 1 -- 172.21.15.39:0/3895885461 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fe80c081090 con 0x7fe8180ce2e0 2024-05-14T14:41:09.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.011+0000 7fe81e2d9640 1 -- 172.21.15.39:0/3895885461 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fe8180d1b10 con 0x7fe8180ce2e0 2024-05-14T14:41:09.995 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.012+0000 7fe814ff9640 1 -- 172.21.15.39:0/3895885461 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1629 (secure 0 0 0) 0x7fe80c085390 con 0x7fe8180ce2e0 2024-05-14T14:41:09.996 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:41:09.996 INFO:teuthology.orchestra.run.smithi039.stdout:{"fsid":"d7983fec-79c7-4991-b19c-1aecead64611","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":77,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":36,"num_osds":8,"num_up_osds":8,"osd_up_since":1715697603,"num_in_osds":8,"osd_in_since":1715697594,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":40},{"state_name":"active+clean","count":38},{"state_name":"creating+activating","count":19}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":238460928,"bytes_avail":772855652352,"bytes_total":773094113280,"inactive_pgs_ratio":0.60824739933013916},"fsmap":{"epoch":18,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"b","status":"up:active","gid":4905}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-05-14T14:41:06.687805+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-05-14T14:41:09.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.014+0000 7fe81e2d9640 1 -- 172.21.15.39:0/3895885461 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe804076300 msgr2=0x7fe804078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:09.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.014+0000 7fe81e2d9640 1 --2- 172.21.15.39:0/3895885461 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe804076300 0x7fe804078810 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe808009560 tx=0x7fe808009190 comp rx=0 tx=0).stop 2024-05-14T14:41:09.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.014+0000 7fe81e2d9640 1 -- 172.21.15.39:0/3895885461 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8180ce2e0 msgr2=0x7fe8180b8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:09.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.014+0000 7fe81e2d9640 1 --2- 172.21.15.39:0/3895885461 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8180ce2e0 0x7fe8180b8270 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe80c000c00 tx=0x7fe80c0046c0 comp rx=0 tx=0).stop 2024-05-14T14:41:09.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.014+0000 7fe81e2d9640 1 -- 172.21.15.39:0/3895885461 shutdown_connections 2024-05-14T14:41:09.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.014+0000 7fe81e2d9640 1 --2- 172.21.15.39:0/3895885461 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fe804076300 0x7fe804078810 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:09.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.014+0000 7fe81e2d9640 1 --2- 172.21.15.39:0/3895885461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe81815e240 0x7fe8180b41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:09.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.014+0000 7fe81e2d9640 1 --2- 172.21.15.39:0/3895885461 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fe8180ce2e0 0x7fe8180b8270 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:09.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.014+0000 7fe81e2d9640 1 --2- 172.21.15.39:0/3895885461 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fe8180b5500 0x7fe81815b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:09.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.014+0000 7fe81e2d9640 1 -- 172.21.15.39:0/3895885461 >> 172.21.15.39:0/3895885461 conn(0x7fe8180d0500 msgr2=0x7fe8180d2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:09.998 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.014+0000 7fe81e2d9640 1 -- 172.21.15.39:0/3895885461 shutdown_connections 2024-05-14T14:41:09.999 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.014+0000 7fe81e2d9640 1 -- 172.21.15.39:0/3895885461 wait complete. 2024-05-14T14:41:10.009 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-05-14T14:41:10.009 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T14:41:10.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.140+0000 7f063bc49640 1 Processor -- start 2024-05-14T14:41:10.123 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.140+0000 7f063bc49640 1 -- start start 2024-05-14T14:41:10.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.141+0000 7f063bc49640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f063406dce0 0x7f063416b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:10.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.141+0000 7f063bc49640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06340d5840 con 0x7f06340b4ec0 2024-05-14T14:41:10.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.141+0000 7f063bc49640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06340d4fa0 con 0x7f06341602d0 2024-05-14T14:41:10.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.141+0000 7f063bc49640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f06340d4d50 con 0x7f063406dce0 2024-05-14T14:41:10.127 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.141+0000 7f06399e5640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f06340b4ec0 0x7f06340d0ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:36516/0 (socket says 172.21.15.39:36516) 2024-05-14T14:41:10.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.141+0000 7f06399e5640 1 -- 172.21.15.39:0/4088393013 learned_addr learned my addr 172.21.15.39:0/4088393013 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:41:10.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.141+0000 7f063a1e6640 1 --2- 172.21.15.39:0/4088393013 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f063406dce0 0x7f063416b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:10.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.142+0000 7f06389e3640 1 -- 172.21.15.39:0/4088393013 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1861959567 0 0) 0x7f06340d5840 con 0x7f06340b4ec0 2024-05-14T14:41:10.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.142+0000 7f06389e3640 1 -- 172.21.15.39:0/4088393013 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0620003520 con 0x7f06340b4ec0 2024-05-14T14:41:10.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.142+0000 7f06389e3640 1 -- 172.21.15.39:0/4088393013 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2570219248 0 0) 0x7f06340d4fa0 con 0x7f06341602d0 2024-05-14T14:41:10.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.142+0000 7f06389e3640 1 -- 172.21.15.39:0/4088393013 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06340d5840 con 0x7f06341602d0 2024-05-14T14:41:10.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.142+0000 7f06389e3640 1 -- 172.21.15.39:0/4088393013 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3796814987 0 0) 0x7f0620003520 con 0x7f06340b4ec0 2024-05-14T14:41:10.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.142+0000 7f06389e3640 1 -- 172.21.15.39:0/4088393013 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f063406dce0 msgr2=0x7f063416b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:10.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.142+0000 7f06389e3640 1 --2- 172.21.15.39:0/4088393013 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f063406dce0 0x7f063416b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:10.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.142+0000 7f06389e3640 1 -- 172.21.15.39:0/4088393013 >> v1:172.21.15.62:6789/0 conn(0x7f06341602d0 legacy=0x7f06340d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:10.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.142+0000 7f06389e3640 1 -- 172.21.15.39:0/4088393013 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06340d5280 con 0x7f06340b4ec0 2024-05-14T14:41:10.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.142+0000 7f06389e3640 1 -- 172.21.15.39:0/4088393013 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1803005051 0 0) 0x7f06300016f0 con 0x7f06340b4ec0 2024-05-14T14:41:10.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.142+0000 7f06389e3640 1 -- 172.21.15.39:0/4088393013 >> v1:172.21.15.39:6789/0 conn(0x7f06340b4ec0 legacy=0x7f06340d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:10.128 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.142+0000 7f06389e3640 1 --2- 172.21.15.39:0/4088393013 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0620003c10 0x7f0620004060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:10.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.142+0000 7f06389e3640 1 --2- 172.21.15.39:0/4088393013 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f063406dce0 0x7f0620004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:10.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.142+0000 7f06389e3640 1 --2- 172.21.15.39:0/4088393013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0620004d90 0x7f0620005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:10.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.142+0000 7f06389e3640 1 -- 172.21.15.39:0/4088393013 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f06340d4d50 con 0x7f0620003c10 2024-05-14T14:41:10.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.142+0000 7f06389e3640 1 -- 172.21.15.39:0/4088393013 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f062000bc00 con 0x7f0620004d90 2024-05-14T14:41:10.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.142+0000 7f06389e3640 1 -- 172.21.15.39:0/4088393013 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f062000be00 con 0x7f063406dce0 2024-05-14T14:41:10.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.142+0000 7f06399e5640 1 --2- 172.21.15.39:0/4088393013 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0620003c10 0x7f0620004060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:10.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.142+0000 7f06391e4640 1 --2- 172.21.15.39:0/4088393013 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f063406dce0 0x7f0620004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:10.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.142+0000 7f063a1e6640 1 --2- 172.21.15.39:0/4088393013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0620004d90 0x7f0620005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:10.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.142+0000 7f06399e5640 1 -- 172.21.15.39:0/4088393013 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f063406dce0 msgr2=0x7f0620004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:10.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.142+0000 7f06399e5640 1 --2- 172.21.15.39:0/4088393013 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f063406dce0 0x7f0620004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:10.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.142+0000 7f06399e5640 1 -- 172.21.15.39:0/4088393013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0620004d90 msgr2=0x7f0620005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:10.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.142+0000 7f06399e5640 1 --2- 172.21.15.39:0/4088393013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0620004d90 0x7f0620005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:10.129 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.142+0000 7f06399e5640 1 -- 172.21.15.39:0/4088393013 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0620003520 con 0x7f0620003c10 2024-05-14T14:41:10.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.142+0000 7f063a1e6640 1 --2- 172.21.15.39:0/4088393013 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0620004d90 0x7f0620005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:41:10.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.143+0000 7f06399e5640 1 --2- 172.21.15.39:0/4088393013 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0620003c10 0x7f0620004060 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f063000c160 tx=0x7f0620005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=892fea5b2cc8a791 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:10.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.143+0000 7f06389e3640 1 -- 172.21.15.39:0/4088393013 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0630007ca0 con 0x7f0620003c10 2024-05-14T14:41:10.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.143+0000 7f06389e3640 1 -- 172.21.15.39:0/4088393013 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0630005af0 con 0x7f0620003c10 2024-05-14T14:41:10.130 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.143+0000 7f06389e3640 1 -- 172.21.15.39:0/4088393013 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0630007070 con 0x7f0620003c10 2024-05-14T14:41:10.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.144+0000 7f063bc49640 1 -- 172.21.15.39:0/4088393013 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0620003c10 msgr2=0x7f0620004060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:10.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.144+0000 7f063bc49640 1 --2- 172.21.15.39:0/4088393013 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f0620003c10 0x7f0620004060 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f063000c160 tx=0x7f0620005830 comp rx=0 tx=0).stop 2024-05-14T14:41:10.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.144+0000 7f063a1e6640 1 -- 172.21.15.39:0/4088393013 reap_dead start 2024-05-14T14:41:10.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.144+0000 7f063bc49640 1 -- 172.21.15.39:0/4088393013 shutdown_connections 2024-05-14T14:41:10.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.144+0000 7f063bc49640 1 -- 172.21.15.39:0/4088393013 >> 172.21.15.39:0/4088393013 conn(0x7f063406f270 msgr2=0x7f06340d5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:10.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.144+0000 7f063bc49640 1 -- 172.21.15.39:0/4088393013 shutdown_connections 2024-05-14T14:41:10.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.144+0000 7f063bc49640 1 -- 172.21.15.39:0/4088393013 wait complete. 2024-05-14T14:41:10.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.146+0000 7f063bc49640 1 Processor -- start 2024-05-14T14:41:10.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.146+0000 7f063bc49640 1 -- start start 2024-05-14T14:41:10.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.147+0000 7f063bc49640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0620003c10 0x7f06340cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:10.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.147+0000 7f063bc49640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f06341f94d0 0x7f063415bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:10.133 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.147+0000 7f063bc49640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f063415c1d0 0x7f063415a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:10.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.147+0000 7f063bc49640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f06341606e0 con 0x7f063415c1d0 2024-05-14T14:41:10.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.147+0000 7f063bc49640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f063406c840 con 0x7f06341f94d0 2024-05-14T14:41:10.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.147+0000 7f063bc49640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f06340b5480 con 0x7f0620003c10 2024-05-14T14:41:10.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.148+0000 7f063a1e6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f063415c1d0 0x7f063415a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:10.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.148+0000 7f063a1e6640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f063415c1d0 0x7f063415a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41364/0 (socket says 172.21.15.39:41364) 2024-05-14T14:41:10.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.148+0000 7f063a1e6640 1 -- 172.21.15.39:0/3298812187 learned_addr learned my addr 172.21.15.39:0/3298812187 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:41:10.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.148+0000 7f06391e4640 1 --2- 172.21.15.39:0/3298812187 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f06341f94d0 0x7f063415bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:10.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.148+0000 7f06399e5640 1 --2- 172.21.15.39:0/3298812187 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0620003c10 0x7f06340cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:10.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.148+0000 7f063a1e6640 1 -- 172.21.15.39:0/3298812187 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0620003c10 msgr2=0x7f06340cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:10.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.148+0000 7f063a1e6640 1 --2- 172.21.15.39:0/3298812187 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0620003c10 0x7f06340cdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:10.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.148+0000 7f063a1e6640 1 -- 172.21.15.39:0/3298812187 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f06341f94d0 msgr2=0x7f063415bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:10.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.148+0000 7f063a1e6640 1 --2- 172.21.15.39:0/3298812187 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f06341f94d0 0x7f063415bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:10.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.148+0000 7f063a1e6640 1 -- 172.21.15.39:0/3298812187 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06341f6770 con 0x7f063415c1d0 2024-05-14T14:41:10.134 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.148+0000 7f063a1e6640 1 --2- 172.21.15.39:0/3298812187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f063415c1d0 0x7f063415a770 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f063408e6f0 tx=0x7f062c010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:10.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.148+0000 7f062a7fc640 1 -- 172.21.15.39:0/3298812187 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f062c010e00 con 0x7f063415c1d0 2024-05-14T14:41:10.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.148+0000 7f062a7fc640 1 -- 172.21.15.39:0/3298812187 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f062c003990 con 0x7f063415c1d0 2024-05-14T14:41:10.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.148+0000 7f063bc49640 1 -- 172.21.15.39:0/3298812187 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f063415c5e0 con 0x7f063415c1d0 2024-05-14T14:41:10.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.148+0000 7f062a7fc640 1 -- 172.21.15.39:0/3298812187 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f062c003dc0 con 0x7f063415c1d0 2024-05-14T14:41:10.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.148+0000 7f063bc49640 1 -- 172.21.15.39:0/3298812187 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06340ce670 con 0x7f063415c1d0 2024-05-14T14:41:10.135 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.149+0000 7f063bc49640 1 -- 172.21.15.39:0/3298812187 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06340ce3e0 con 0x7f063415c1d0 2024-05-14T14:41:10.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.150+0000 7f062a7fc640 1 -- 172.21.15.39:0/3298812187 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f062c01e030 con 0x7f063415c1d0 2024-05-14T14:41:10.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.151+0000 7f062a7fc640 1 --2- 172.21.15.39:0/3298812187 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0618076300 0x7f0618078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:10.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.151+0000 7f062a7fc640 1 -- 172.21.15.39:0/3298812187 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7f062c097e30 con 0x7f063415c1d0 2024-05-14T14:41:10.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.151+0000 7f06399e5640 1 --2- 172.21.15.39:0/3298812187 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0618076300 0x7f0618078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:10.136 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.151+0000 7f06399e5640 1 --2- 172.21.15.39:0/3298812187 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0618076300 0x7f0618078810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0630032000 tx=0x7f0630034040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:10.139 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.155+0000 7f062a7fc640 1 -- 172.21.15.39:0/3298812187 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f062c025020 con 0x7f063415c1d0 2024-05-14T14:41:10.329 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.346+0000 7f063bc49640 1 -- 172.21.15.39:0/3298812187 --> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f06340b4ca0 con 0x7f0618076300 2024-05-14T14:41:10.335 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.352+0000 7f062a7fc640 1 -- 172.21.15.39:0/3298812187 <== mgr.4105 v2:172.21.15.39:6832/498853008 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247226 (secure 0 0 0) 0x7f06340b4ca0 con 0x7f0618076300 2024-05-14T14:41:10.338 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:41:10.339 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-05-14T14:41:10.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.355+0000 7f063bc49640 1 -- 172.21.15.39:0/3298812187 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0618076300 msgr2=0x7f0618078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:10.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.355+0000 7f063bc49640 1 --2- 172.21.15.39:0/3298812187 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0618076300 0x7f0618078810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0630032000 tx=0x7f0630034040 comp rx=0 tx=0).stop 2024-05-14T14:41:10.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.355+0000 7f063bc49640 1 -- 172.21.15.39:0/3298812187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f063415c1d0 msgr2=0x7f063415a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:10.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.355+0000 7f063bc49640 1 --2- 172.21.15.39:0/3298812187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f063415c1d0 0x7f063415a770 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f063408e6f0 tx=0x7f062c010590 comp rx=0 tx=0).stop 2024-05-14T14:41:10.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.355+0000 7f063bc49640 1 -- 172.21.15.39:0/3298812187 shutdown_connections 2024-05-14T14:41:10.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.355+0000 7f063bc49640 1 --2- 172.21.15.39:0/3298812187 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f0618076300 0x7f0618078810 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:10.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.355+0000 7f063bc49640 1 --2- 172.21.15.39:0/3298812187 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f063415c1d0 0x7f063415a770 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:10.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.355+0000 7f063bc49640 1 --2- 172.21.15.39:0/3298812187 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f06341f94d0 0x7f063415bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:10.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.355+0000 7f063bc49640 1 --2- 172.21.15.39:0/3298812187 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f0620003c10 0x7f06340cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:10.341 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.355+0000 7f063bc49640 1 -- 172.21.15.39:0/3298812187 >> 172.21.15.39:0/3298812187 conn(0x7f063406f270 msgr2=0x7f06340b91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:10.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.355+0000 7f063bc49640 1 -- 172.21.15.39:0/3298812187 shutdown_connections 2024-05-14T14:41:10.342 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:10.355+0000 7f063bc49640 1 -- 172.21.15.39:0/3298812187 wait complete. 2024-05-14T14:41:10.350 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-05-14T14:41:08.688202+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":68,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232872,"kb_used_data":4200,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754741848,"statfs":{"total":773094113280,"available":772855652352,"internally_reserved":0,"allocated":4300800,"data_stored":2472352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":234016308},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.994927"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.710751+0000","last_change":"2024-05-14T14:41:03.710751+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.710751+0000","last_undegraded":"2024-05-14T14:41:03.710751+0000","last_fullsized":"2024-05-14T14:41:03.710751+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.711273+0000","last_change":"2024-05-14T14:41:03.711273+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.711273+0000","last_undegraded":"2024-05-14T14:41:03.711273+0000","last_fullsized":"2024-05-14T14:41:03.711273+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.712600+0000","last_change":"2024-05-14T14:41:03.712600+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.712600+0000","last_undegraded":"2024-05-14T14:41:03.712600+0000","last_fullsized":"2024-05-14T14:41:03.712600+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.710582+0000","last_change":"2024-05-14T14:41:03.710582+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.710582+0000","last_undegraded":"2024-05-14T14:41:03.710582+0000","last_fullsized":"2024-05-14T14:41:03.710582+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.710541+0000","last_change":"2024-05-14T14:41:03.710541+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.710541+0000","last_undegraded":"2024-05-14T14:41:03.710541+0000","last_fullsized":"2024-05-14T14:41:03.710541+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.711520+0000","last_change":"2024-05-14T14:41:04.711520+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.711520+0000","last_undegraded":"2024-05-14T14:41:04.711520+0000","last_fullsized":"2024-05-14T14:41:04.711520+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":["1","3"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.707430+0000","last_change":"2024-05-14T14:41:04.707430+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.707430+0000","last_undegraded":"2024-05-14T14:41:04.707430+0000","last_fullsized":"2024-05-14T14:41:04.707430+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.712079+0000","last_change":"2024-05-14T14:41:03.712079+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.712079+0000","last_undegraded":"2024-05-14T14:41:03.712079+0000","last_fullsized":"2024-05-14T14:41:03.712079+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.712021+0000","last_change":"2024-05-14T14:41:03.712021+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.712021+0000","last_undegraded":"2024-05-14T14:41:03.712021+0000","last_fullsized":"2024-05-14T14:41:03.712021+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.709089+0000","last_change":"2024-05-14T14:41:04.709089+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.709089+0000","last_undegraded":"2024-05-14T14:41:04.709089+0000","last_fullsized":"2024-05-14T14:41:04.709089+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.711683+0000","last_change":"2024-05-14T14:41:04.711683+0000","last_active":"2024-05-14T14:41:04.711683+0000","last_peered":"2024-05-14T14:41:04.711683+0000","last_clean":"2024-05-14T14:41:04.711683+0000","last_became_active":"2024-05-14T14:41:04.711190+0000","last_became_peered":"2024-05-14T14:41:04.711190+0000","last_unstale":"2024-05-14T14:41:04.711683+0000","last_undegraded":"2024-05-14T14:41:04.711683+0000","last_fullsized":"2024-05-14T14:41:04.711683+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:15:39.767392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.712853+0000","last_change":"2024-05-14T14:41:03.712853+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.712853+0000","last_undegraded":"2024-05-14T14:41:03.712853+0000","last_fullsized":"2024-05-14T14:41:03.712853+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.707023+0000","last_change":"2024-05-14T14:41:04.707023+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.707023+0000","last_undegraded":"2024-05-14T14:41:04.707023+0000","last_fullsized":"2024-05-14T14:41:04.707023+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":["5","7"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.707681+0000","last_change":"2024-05-14T14:41:04.707681+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.707681+0000","last_undegraded":"2024-05-14T14:41:04.707681+0000","last_fullsized":"2024-05-14T14:41:04.707681+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.707342+0000","last_change":"2024-05-14T14:41:04.707342+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.707342+0000","last_undegraded":"2024-05-14T14:41:04.707342+0000","last_fullsized":"2024-05-14T14:41:04.707342+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":["5","2"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.709076+0000","last_change":"2024-05-14T14:41:03.709076+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.709076+0000","last_undegraded":"2024-05-14T14:41:03.709076+0000","last_fullsized":"2024-05-14T14:41:03.709076+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.708302+0000","last_change":"2024-05-14T14:41:03.708302+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.708302+0000","last_undegraded":"2024-05-14T14:41:03.708302+0000","last_fullsized":"2024-05-14T14:41:03.708302+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.706987+0000","last_change":"2024-05-14T14:41:03.706987+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.706987+0000","last_undegraded":"2024-05-14T14:41:03.706987+0000","last_fullsized":"2024-05-14T14:41:03.706987+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.711391+0000","last_change":"2024-05-14T14:41:03.711391+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.711391+0000","last_undegraded":"2024-05-14T14:41:03.711391+0000","last_fullsized":"2024-05-14T14:41:03.711391+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.706446+0000","last_change":"2024-05-14T14:41:03.706446+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.706446+0000","last_undegraded":"2024-05-14T14:41:03.706446+0000","last_fullsized":"2024-05-14T14:41:03.706446+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.707459+0000","last_change":"2024-05-14T14:41:04.707459+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.707459+0000","last_undegraded":"2024-05-14T14:41:04.707459+0000","last_fullsized":"2024-05-14T14:41:04.707459+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.706820+0000","last_change":"2024-05-14T14:41:04.706820+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.706820+0000","last_undegraded":"2024-05-14T14:41:04.706820+0000","last_fullsized":"2024-05-14T14:41:04.706820+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":["4","2"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.708608+0000","last_change":"2024-05-14T14:41:03.708608+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.708608+0000","last_undegraded":"2024-05-14T14:41:03.708608+0000","last_fullsized":"2024-05-14T14:41:03.708608+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.709136+0000","last_change":"2024-05-14T14:41:03.709136+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.709136+0000","last_undegraded":"2024-05-14T14:41:03.709136+0000","last_fullsized":"2024-05-14T14:41:03.709136+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.707415+0000","last_change":"2024-05-14T14:41:03.707415+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.707415+0000","last_undegraded":"2024-05-14T14:41:03.707415+0000","last_fullsized":"2024-05-14T14:41:03.707415+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.720570+0000","last_change":"2024-05-14T14:41:04.719868+0000","last_active":"2024-05-14T14:41:04.720570+0000","last_peered":"2024-05-14T14:41:04.720570+0000","last_clean":"2024-05-14T14:41:04.720570+0000","last_became_active":"2024-05-14T14:41:04.719499+0000","last_became_peered":"2024-05-14T14:41:04.719499+0000","last_unstale":"2024-05-14T14:41:04.720570+0000","last_undegraded":"2024-05-14T14:41:04.720570+0000","last_fullsized":"2024-05-14T14:41:04.720570+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:58:50.938093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.705867+0000","last_change":"2024-05-14T14:41:03.705867+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.705867+0000","last_undegraded":"2024-05-14T14:41:03.705867+0000","last_fullsized":"2024-05-14T14:41:03.705867+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.708320+0000","last_change":"2024-05-14T14:41:04.708320+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.708320+0000","last_undegraded":"2024-05-14T14:41:04.708320+0000","last_fullsized":"2024-05-14T14:41:04.708320+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.706862+0000","last_change":"2024-05-14T14:41:03.706862+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.706862+0000","last_undegraded":"2024-05-14T14:41:03.706862+0000","last_fullsized":"2024-05-14T14:41:03.706862+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.706355+0000","last_change":"2024-05-14T14:41:03.706355+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.706355+0000","last_undegraded":"2024-05-14T14:41:03.706355+0000","last_fullsized":"2024-05-14T14:41:03.706355+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.706245+0000","last_change":"2024-05-14T14:41:03.706245+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.706245+0000","last_undegraded":"2024-05-14T14:41:03.706245+0000","last_fullsized":"2024-05-14T14:41:03.706245+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.711669+0000","last_change":"2024-05-14T14:41:04.711669+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.711669+0000","last_undegraded":"2024-05-14T14:41:04.711669+0000","last_fullsized":"2024-05-14T14:41:04.711669+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.707141+0000","last_change":"2024-05-14T14:41:03.707141+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.707141+0000","last_undegraded":"2024-05-14T14:41:03.707141+0000","last_fullsized":"2024-05-14T14:41:03.707141+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.727025+0000","last_change":"2024-05-14T14:41:03.722090+0000","last_active":"2024-05-14T14:41:03.727025+0000","last_peered":"2024-05-14T14:41:03.727025+0000","last_clean":"2024-05-14T14:41:03.727025+0000","last_became_active":"2024-05-14T14:41:03.721399+0000","last_became_peered":"2024-05-14T14:41:03.721399+0000","last_unstale":"2024-05-14T14:41:03.727025+0000","last_undegraded":"2024-05-14T14:41:03.727025+0000","last_fullsized":"2024-05-14T14:41:03.727025+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:58:48.310740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.720632+0000","last_change":"2024-05-14T14:41:04.719693+0000","last_active":"2024-05-14T14:41:04.720632+0000","last_peered":"2024-05-14T14:41:04.720632+0000","last_clean":"2024-05-14T14:41:04.720632+0000","last_became_active":"2024-05-14T14:41:04.719354+0000","last_became_peered":"2024-05-14T14:41:04.719354+0000","last_unstale":"2024-05-14T14:41:04.720632+0000","last_undegraded":"2024-05-14T14:41:04.720632+0000","last_fullsized":"2024-05-14T14:41:04.720632+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:22:38.020883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.728723+0000","last_change":"2024-05-14T14:41:03.724616+0000","last_active":"2024-05-14T14:41:03.728723+0000","last_peered":"2024-05-14T14:41:03.728723+0000","last_clean":"2024-05-14T14:41:03.728723+0000","last_became_active":"2024-05-14T14:41:03.724230+0000","last_became_peered":"2024-05-14T14:41:03.724230+0000","last_unstale":"2024-05-14T14:41:03.728723+0000","last_undegraded":"2024-05-14T14:41:03.728723+0000","last_fullsized":"2024-05-14T14:41:03.728723+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:03:30.890353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.707153+0000","last_change":"2024-05-14T14:41:04.707153+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.707153+0000","last_undegraded":"2024-05-14T14:41:04.707153+0000","last_fullsized":"2024-05-14T14:41:04.707153+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":["4","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.711815+0000","last_change":"2024-05-14T14:41:03.719275+0000","last_active":"2024-05-14T14:41:04.711815+0000","last_peered":"2024-05-14T14:41:04.711815+0000","last_clean":"2024-05-14T14:41:04.711815+0000","last_became_active":"2024-05-14T14:41:03.718969+0000","last_became_peered":"2024-05-14T14:41:03.718969+0000","last_unstale":"2024-05-14T14:41:04.711815+0000","last_undegraded":"2024-05-14T14:41:04.711815+0000","last_fullsized":"2024-05-14T14:41:04.711815+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:24:12.482756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.710318+0000","last_change":"2024-05-14T14:41:03.710318+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.710318+0000","last_undegraded":"2024-05-14T14:41:03.710318+0000","last_fullsized":"2024-05-14T14:41:03.710318+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.709241+0000","last_change":"2024-05-14T14:41:03.725959+0000","last_active":"2024-05-14T14:41:04.709241+0000","last_peered":"2024-05-14T14:41:04.709241+0000","last_clean":"2024-05-14T14:41:04.709241+0000","last_became_active":"2024-05-14T14:41:03.725575+0000","last_became_peered":"2024-05-14T14:41:03.725575+0000","last_unstale":"2024-05-14T14:41:04.709241+0000","last_undegraded":"2024-05-14T14:41:04.709241+0000","last_fullsized":"2024-05-14T14:41:04.709241+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:19:36.739344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.713211+0000","last_change":"2024-05-14T14:41:03.713211+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.713211+0000","last_undegraded":"2024-05-14T14:41:03.713211+0000","last_fullsized":"2024-05-14T14:41:03.713211+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.708792+0000","last_change":"2024-05-14T14:41:03.721697+0000","last_active":"2024-05-14T14:41:04.708792+0000","last_peered":"2024-05-14T14:41:04.708792+0000","last_clean":"2024-05-14T14:41:04.708792+0000","last_became_active":"2024-05-14T14:41:03.721285+0000","last_became_peered":"2024-05-14T14:41:03.721285+0000","last_unstale":"2024-05-14T14:41:04.708792+0000","last_undegraded":"2024-05-14T14:41:04.708792+0000","last_fullsized":"2024-05-14T14:41:04.708792+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:19:32.801434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.706964+0000","last_change":"2024-05-14T14:41:04.706964+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.706964+0000","last_undegraded":"2024-05-14T14:41:04.706964+0000","last_fullsized":"2024-05-14T14:41:04.706964+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.723070+0000","last_change":"2024-05-14T14:41:03.717009+0000","last_active":"2024-05-14T14:41:03.723070+0000","last_peered":"2024-05-14T14:41:03.723070+0000","last_clean":"2024-05-14T14:41:03.723070+0000","last_became_active":"2024-05-14T14:41:03.716607+0000","last_became_peered":"2024-05-14T14:41:03.716607+0000","last_unstale":"2024-05-14T14:41:03.723070+0000","last_undegraded":"2024-05-14T14:41:03.723070+0000","last_fullsized":"2024-05-14T14:41:03.723070+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:35:33.172311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":8,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.711646+0000","last_change":"2024-05-14T14:41:04.711646+0000","last_active":"2024-05-14T14:41:04.711646+0000","last_peered":"2024-05-14T14:41:04.711646+0000","last_clean":"2024-05-14T14:41:04.711646+0000","last_became_active":"2024-05-14T14:41:04.711301+0000","last_became_peered":"2024-05-14T14:41:04.711301+0000","last_unstale":"2024-05-14T14:41:04.711646+0000","last_undegraded":"2024-05-14T14:41:04.711646+0000","last_fullsized":"2024-05-14T14:41:04.711646+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:06:44.239186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.711438+0000","last_change":"2024-05-14T14:41:03.725105+0000","last_active":"2024-05-14T14:41:04.711438+0000","last_peered":"2024-05-14T14:41:04.711438+0000","last_clean":"2024-05-14T14:41:04.711438+0000","last_became_active":"2024-05-14T14:41:03.724805+0000","last_became_peered":"2024-05-14T14:41:03.724805+0000","last_unstale":"2024-05-14T14:41:04.711438+0000","last_undegraded":"2024-05-14T14:41:04.711438+0000","last_fullsized":"2024-05-14T14:41:04.711438+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:44:06.562919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.710142+0000","last_change":"2024-05-14T14:41:03.710142+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.710142+0000","last_undegraded":"2024-05-14T14:41:03.710142+0000","last_fullsized":"2024-05-14T14:41:03.710142+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.707229+0000","last_change":"2024-05-14T14:41:03.725816+0000","last_active":"2024-05-14T14:41:04.707229+0000","last_peered":"2024-05-14T14:41:04.707229+0000","last_clean":"2024-05-14T14:41:04.707229+0000","last_became_active":"2024-05-14T14:41:03.725330+0000","last_became_peered":"2024-05-14T14:41:03.725330+0000","last_unstale":"2024-05-14T14:41:04.707229+0000","last_undegraded":"2024-05-14T14:41:04.707229+0000","last_fullsized":"2024-05-14T14:41:04.707229+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:48:09.099466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.710161+0000","last_change":"2024-05-14T14:41:03.710161+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.710161+0000","last_undegraded":"2024-05-14T14:41:03.710161+0000","last_fullsized":"2024-05-14T14:41:03.710161+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.728824+0000","last_change":"2024-05-14T14:41:03.723514+0000","last_active":"2024-05-14T14:41:03.728824+0000","last_peered":"2024-05-14T14:41:03.728824+0000","last_clean":"2024-05-14T14:41:03.728824+0000","last_became_active":"2024-05-14T14:41:03.723194+0000","last_became_peered":"2024-05-14T14:41:03.723194+0000","last_unstale":"2024-05-14T14:41:03.728824+0000","last_undegraded":"2024-05-14T14:41:03.728824+0000","last_fullsized":"2024-05-14T14:41:03.728824+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:58:49.925408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.707881+0000","last_change":"2024-05-14T14:41:03.707881+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.707881+0000","last_undegraded":"2024-05-14T14:41:03.707881+0000","last_fullsized":"2024-05-14T14:41:03.707881+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.709687+0000","last_change":"2024-05-14T14:41:03.728813+0000","last_active":"2024-05-14T14:41:04.709687+0000","last_peered":"2024-05-14T14:41:04.709687+0000","last_clean":"2024-05-14T14:41:04.709687+0000","last_became_active":"2024-05-14T14:41:03.728446+0000","last_became_peered":"2024-05-14T14:41:03.728446+0000","last_unstale":"2024-05-14T14:41:04.709687+0000","last_undegraded":"2024-05-14T14:41:04.709687+0000","last_fullsized":"2024-05-14T14:41:04.709687+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:25:38.605834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.713459+0000","last_change":"2024-05-14T14:41:03.713459+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.713459+0000","last_undegraded":"2024-05-14T14:41:03.713459+0000","last_fullsized":"2024-05-14T14:41:03.713459+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.710361+0000","last_change":"2024-05-14T14:41:03.725010+0000","last_active":"2024-05-14T14:41:04.710361+0000","last_peered":"2024-05-14T14:41:04.710361+0000","last_clean":"2024-05-14T14:41:04.710361+0000","last_became_active":"2024-05-14T14:41:03.724614+0000","last_became_peered":"2024-05-14T14:41:03.724614+0000","last_unstale":"2024-05-14T14:41:04.710361+0000","last_undegraded":"2024-05-14T14:41:04.710361+0000","last_fullsized":"2024-05-14T14:41:04.710361+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:15:55.345619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.708166+0000","last_change":"2024-05-14T14:41:04.708166+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.708166+0000","last_undegraded":"2024-05-14T14:41:04.708166+0000","last_fullsized":"2024-05-14T14:41:04.708166+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":["4","2"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.728043+0000","last_change":"2024-05-14T14:41:03.717651+0000","last_active":"2024-05-14T14:41:03.728043+0000","last_peered":"2024-05-14T14:41:03.728043+0000","last_clean":"2024-05-14T14:41:03.728043+0000","last_became_active":"2024-05-14T14:41:03.717304+0000","last_became_peered":"2024-05-14T14:41:03.717304+0000","last_unstale":"2024-05-14T14:41:03.728043+0000","last_undegraded":"2024-05-14T14:41:03.728043+0000","last_fullsized":"2024-05-14T14:41:03.728043+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:24:12.482756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.712543+0000","last_change":"2024-05-14T14:41:03.712543+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.712543+0000","last_undegraded":"2024-05-14T14:41:03.712543+0000","last_fullsized":"2024-05-14T14:41:03.712543+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.728113+0000","last_change":"2024-05-14T14:41:03.718433+0000","last_active":"2024-05-14T14:41:03.728113+0000","last_peered":"2024-05-14T14:41:03.728113+0000","last_clean":"2024-05-14T14:41:03.728113+0000","last_became_active":"2024-05-14T14:41:03.718116+0000","last_became_peered":"2024-05-14T14:41:03.718116+0000","last_unstale":"2024-05-14T14:41:03.728113+0000","last_undegraded":"2024-05-14T14:41:03.728113+0000","last_fullsized":"2024-05-14T14:41:03.728113+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:22:37.008198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.709531+0000","last_change":"2024-05-14T14:41:03.709531+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.709531+0000","last_undegraded":"2024-05-14T14:41:03.709531+0000","last_fullsized":"2024-05-14T14:41:03.709531+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.711603+0000","last_change":"2024-05-14T14:41:03.720545+0000","last_active":"2024-05-14T14:41:04.711603+0000","last_peered":"2024-05-14T14:41:04.711603+0000","last_clean":"2024-05-14T14:41:04.711603+0000","last_became_active":"2024-05-14T14:41:03.720240+0000","last_became_peered":"2024-05-14T14:41:03.720240+0000","last_unstale":"2024-05-14T14:41:04.711603+0000","last_undegraded":"2024-05-14T14:41:04.711603+0000","last_fullsized":"2024-05-14T14:41:04.711603+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:19:36.739344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.705770+0000","last_change":"2024-05-14T14:41:03.705770+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.705770+0000","last_undegraded":"2024-05-14T14:41:03.705770+0000","last_fullsized":"2024-05-14T14:41:03.705770+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.726984+0000","last_change":"2024-05-14T14:41:03.720418+0000","last_active":"2024-05-14T14:41:03.726984+0000","last_peered":"2024-05-14T14:41:03.726984+0000","last_clean":"2024-05-14T14:41:03.726984+0000","last_became_active":"2024-05-14T14:41:03.720036+0000","last_became_peered":"2024-05-14T14:41:03.720036+0000","last_unstale":"2024-05-14T14:41:03.726984+0000","last_undegraded":"2024-05-14T14:41:03.726984+0000","last_fullsized":"2024-05-14T14:41:03.726984+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:10:37.215267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.709721+0000","last_change":"2024-05-14T14:41:03.709721+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.709721+0000","last_undegraded":"2024-05-14T14:41:03.709721+0000","last_fullsized":"2024-05-14T14:41:03.709721+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.724580+0000","last_change":"2024-05-14T14:41:03.722530+0000","last_active":"2024-05-14T14:41:03.724580+0000","last_peered":"2024-05-14T14:41:03.724580+0000","last_clean":"2024-05-14T14:41:03.724580+0000","last_became_active":"2024-05-14T14:41:03.722183+0000","last_became_peered":"2024-05-14T14:41:03.722183+0000","last_unstale":"2024-05-14T14:41:03.724580+0000","last_undegraded":"2024-05-14T14:41:03.724580+0000","last_fullsized":"2024-05-14T14:41:03.724580+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:44:06.562919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.709005+0000","last_change":"2024-05-14T14:41:03.709005+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.709005+0000","last_undegraded":"2024-05-14T14:41:03.709005+0000","last_fullsized":"2024-05-14T14:41:03.709005+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.708785+0000","last_change":"2024-05-14T14:41:03.722508+0000","last_active":"2024-05-14T14:41:04.708785+0000","last_peered":"2024-05-14T14:41:04.708785+0000","last_clean":"2024-05-14T14:41:04.708785+0000","last_became_active":"2024-05-14T14:41:03.722177+0000","last_became_peered":"2024-05-14T14:41:03.722177+0000","last_unstale":"2024-05-14T14:41:04.708785+0000","last_undegraded":"2024-05-14T14:41:04.708785+0000","last_fullsized":"2024-05-14T14:41:04.708785+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:10:56.869516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.710078+0000","last_change":"2024-05-14T14:41:04.710078+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.710078+0000","last_undegraded":"2024-05-14T14:41:04.710078+0000","last_fullsized":"2024-05-14T14:41:04.710078+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":["5","1"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.707629+0000","last_change":"2024-05-14T14:41:03.726623+0000","last_active":"2024-05-14T14:41:04.707629+0000","last_peered":"2024-05-14T14:41:04.707629+0000","last_clean":"2024-05-14T14:41:04.707629+0000","last_became_active":"2024-05-14T14:41:03.726240+0000","last_became_peered":"2024-05-14T14:41:03.726240+0000","last_unstale":"2024-05-14T14:41:04.707629+0000","last_undegraded":"2024-05-14T14:41:04.707629+0000","last_fullsized":"2024-05-14T14:41:04.707629+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:44:06.562919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.707064+0000","last_change":"2024-05-14T14:41:04.707064+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.707064+0000","last_undegraded":"2024-05-14T14:41:04.707064+0000","last_fullsized":"2024-05-14T14:41:04.707064+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":["4","1"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.728974+0000","last_change":"2024-05-14T14:41:03.723637+0000","last_active":"2024-05-14T14:41:03.728974+0000","last_peered":"2024-05-14T14:41:03.728974+0000","last_clean":"2024-05-14T14:41:03.728974+0000","last_became_active":"2024-05-14T14:41:03.723309+0000","last_became_peered":"2024-05-14T14:41:03.723309+0000","last_unstale":"2024-05-14T14:41:03.728974+0000","last_undegraded":"2024-05-14T14:41:03.728974+0000","last_fullsized":"2024-05-14T14:41:03.728974+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:01:46.708136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.710449+0000","last_change":"2024-05-14T14:41:03.710449+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.710449+0000","last_undegraded":"2024-05-14T14:41:03.710449+0000","last_fullsized":"2024-05-14T14:41:03.710449+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.711808+0000","last_change":"2024-05-14T14:41:03.718155+0000","last_active":"2024-05-14T14:41:04.711808+0000","last_peered":"2024-05-14T14:41:04.711808+0000","last_clean":"2024-05-14T14:41:04.711808+0000","last_became_active":"2024-05-14T14:41:03.717826+0000","last_became_peered":"2024-05-14T14:41:03.717826+0000","last_unstale":"2024-05-14T14:41:04.711808+0000","last_undegraded":"2024-05-14T14:41:04.711808+0000","last_fullsized":"2024-05-14T14:41:04.711808+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:06:43.226500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.708355+0000","last_change":"2024-05-14T14:41:03.708355+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.708355+0000","last_undegraded":"2024-05-14T14:41:03.708355+0000","last_fullsized":"2024-05-14T14:41:03.708355+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.724108+0000","last_change":"2024-05-14T14:41:03.719237+0000","last_active":"2024-05-14T14:41:03.724108+0000","last_peered":"2024-05-14T14:41:03.724108+0000","last_clean":"2024-05-14T14:41:03.724108+0000","last_became_active":"2024-05-14T14:41:03.718944+0000","last_became_peered":"2024-05-14T14:41:03.718944+0000","last_unstale":"2024-05-14T14:41:03.724108+0000","last_undegraded":"2024-05-14T14:41:03.724108+0000","last_fullsized":"2024-05-14T14:41:03.724108+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:01:45.552050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.712524+0000","last_change":"2024-05-14T14:41:03.712524+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.712524+0000","last_undegraded":"2024-05-14T14:41:03.712524+0000","last_fullsized":"2024-05-14T14:41:03.712524+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.723995+0000","last_change":"2024-05-14T14:41:03.718362+0000","last_active":"2024-05-14T14:41:03.723995+0000","last_peered":"2024-05-14T14:41:03.723995+0000","last_clean":"2024-05-14T14:41:03.723995+0000","last_became_active":"2024-05-14T14:41:03.718041+0000","last_became_peered":"2024-05-14T14:41:03.718041+0000","last_unstale":"2024-05-14T14:41:03.723995+0000","last_undegraded":"2024-05-14T14:41:03.723995+0000","last_fullsized":"2024-05-14T14:41:03.723995+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:42:29.851541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.707794+0000","last_change":"2024-05-14T14:41:04.707794+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.707794+0000","last_undegraded":"2024-05-14T14:41:04.707794+0000","last_fullsized":"2024-05-14T14:41:04.707794+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":["5","6"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.724462+0000","last_change":"2024-05-14T14:41:03.722600+0000","last_active":"2024-05-14T14:41:03.724462+0000","last_peered":"2024-05-14T14:41:03.724462+0000","last_clean":"2024-05-14T14:41:03.724462+0000","last_became_active":"2024-05-14T14:41:03.722240+0000","last_became_peered":"2024-05-14T14:41:03.722240+0000","last_unstale":"2024-05-14T14:41:03.724462+0000","last_undegraded":"2024-05-14T14:41:03.724462+0000","last_fullsized":"2024-05-14T14:41:03.724462+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:19:36.739344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.708432+0000","last_change":"2024-05-14T14:41:03.708432+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.708432+0000","last_undegraded":"2024-05-14T14:41:03.708432+0000","last_fullsized":"2024-05-14T14:41:03.708432+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.723944+0000","last_change":"2024-05-14T14:41:03.719224+0000","last_active":"2024-05-14T14:41:03.723944+0000","last_peered":"2024-05-14T14:41:03.723944+0000","last_clean":"2024-05-14T14:41:03.723944+0000","last_became_active":"2024-05-14T14:41:03.718916+0000","last_became_peered":"2024-05-14T14:41:03.718916+0000","last_unstale":"2024-05-14T14:41:03.723944+0000","last_undegraded":"2024-05-14T14:41:03.723944+0000","last_fullsized":"2024-05-14T14:41:03.723944+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:29:22.537342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.720623+0000","last_change":"2024-05-14T14:41:04.719892+0000","last_active":"2024-05-14T14:41:04.720623+0000","last_peered":"2024-05-14T14:41:04.720623+0000","last_clean":"2024-05-14T14:41:04.720623+0000","last_became_active":"2024-05-14T14:41:04.719326+0000","last_became_peered":"2024-05-14T14:41:04.719326+0000","last_unstale":"2024-05-14T14:41:04.720623+0000","last_undegraded":"2024-05-14T14:41:04.720623+0000","last_fullsized":"2024-05-14T14:41:04.720623+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:25:40.670957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.709178+0000","last_change":"2024-05-14T14:41:03.723786+0000","last_active":"2024-05-14T14:41:04.709178+0000","last_peered":"2024-05-14T14:41:04.709178+0000","last_clean":"2024-05-14T14:41:04.709178+0000","last_became_active":"2024-05-14T14:41:03.723431+0000","last_became_peered":"2024-05-14T14:41:03.723431+0000","last_unstale":"2024-05-14T14:41:04.709178+0000","last_undegraded":"2024-05-14T14:41:04.709178+0000","last_fullsized":"2024-05-14T14:41:04.709178+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:46:23.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.706704+0000","last_change":"2024-05-14T14:41:03.706704+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.706704+0000","last_undegraded":"2024-05-14T14:41:03.706704+0000","last_fullsized":"2024-05-14T14:41:03.706704+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.728966+0000","last_change":"2024-05-14T14:41:03.724813+0000","last_active":"2024-05-14T14:41:03.728966+0000","last_peered":"2024-05-14T14:41:03.728966+0000","last_clean":"2024-05-14T14:41:03.728966+0000","last_became_active":"2024-05-14T14:41:03.724505+0000","last_became_peered":"2024-05-14T14:41:03.724505+0000","last_unstale":"2024-05-14T14:41:03.728966+0000","last_undegraded":"2024-05-14T14:41:03.728966+0000","last_fullsized":"2024-05-14T14:41:03.728966+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:55:44.412342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.707599+0000","last_change":"2024-05-14T14:41:03.707599+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.707599+0000","last_undegraded":"2024-05-14T14:41:03.707599+0000","last_fullsized":"2024-05-14T14:41:03.707599+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.728739+0000","last_change":"2024-05-14T14:41:03.724743+0000","last_active":"2024-05-14T14:41:03.728739+0000","last_peered":"2024-05-14T14:41:03.728739+0000","last_clean":"2024-05-14T14:41:03.728739+0000","last_became_active":"2024-05-14T14:41:03.724406+0000","last_became_peered":"2024-05-14T14:41:03.724406+0000","last_unstale":"2024-05-14T14:41:03.728739+0000","last_undegraded":"2024-05-14T14:41:03.728739+0000","last_fullsized":"2024-05-14T14:41:03.728739+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:35:33.172311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.712018+0000","last_change":"2024-05-14T14:41:03.712018+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.712018+0000","last_undegraded":"2024-05-14T14:41:03.712018+0000","last_fullsized":"2024-05-14T14:41:03.712018+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.728768+0000","last_change":"2024-05-14T14:41:03.724699+0000","last_active":"2024-05-14T14:41:03.728768+0000","last_peered":"2024-05-14T14:41:03.728768+0000","last_clean":"2024-05-14T14:41:03.728768+0000","last_became_active":"2024-05-14T14:41:03.724321+0000","last_became_peered":"2024-05-14T14:41:03.724321+0000","last_unstale":"2024-05-14T14:41:03.728768+0000","last_undegraded":"2024-05-14T14:41:03.728768+0000","last_fullsized":"2024-05-14T14:41:03.728768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:24:26.460528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.711202+0000","last_change":"2024-05-14T14:41:04.711202+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.711202+0000","last_undegraded":"2024-05-14T14:41:04.711202+0000","last_fullsized":"2024-05-14T14:41:04.711202+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":["1","6"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.726325+0000","last_change":"2024-05-14T14:41:03.719362+0000","last_active":"2024-05-14T14:41:03.726325+0000","last_peered":"2024-05-14T14:41:03.726325+0000","last_clean":"2024-05-14T14:41:03.726325+0000","last_became_active":"2024-05-14T14:41:03.719038+0000","last_became_peered":"2024-05-14T14:41:03.719038+0000","last_unstale":"2024-05-14T14:41:03.726325+0000","last_undegraded":"2024-05-14T14:41:03.726325+0000","last_fullsized":"2024-05-14T14:41:03.726325+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:20:11.233493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.707282+0000","last_change":"2024-05-14T14:41:04.707282+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.707282+0000","last_undegraded":"2024-05-14T14:41:04.707282+0000","last_fullsized":"2024-05-14T14:41:04.707282+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":["4","3"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-05-14T14:41:04.707074+0000","last_change":"2024-05-14T14:41:03.726792+0000","last_active":"2024-05-14T14:41:04.707074+0000","last_peered":"2024-05-14T14:41:04.707074+0000","last_clean":"2024-05-14T14:41:04.707074+0000","last_became_active":"2024-05-14T14:41:03.726248+0000","last_became_peered":"2024-05-14T14:41:03.726248+0000","last_unstale":"2024-05-14T14:41:04.707074+0000","last_undegraded":"2024-05-14T14:41:04.707074+0000","last_fullsized":"2024-05-14T14:41:04.707074+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:35:33.172311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-05-14T14:41:03.706448+0000","last_change":"2024-05-14T14:41:03.706448+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:03.706448+0000","last_undegraded":"2024-05-14T14:41:03.706448+0000","last_fullsized":"2024-05-14T14:41:03.706448+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.728711+0000","last_change":"2024-05-14T14:41:03.723567+0000","last_active":"2024-05-14T14:41:03.728711+0000","last_peered":"2024-05-14T14:41:03.728711+0000","last_clean":"2024-05-14T14:41:03.728711+0000","last_became_active":"2024-05-14T14:41:03.723265+0000","last_became_peered":"2024-05-14T14:41:03.723265+0000","last_unstale":"2024-05-14T14:41:03.728711+0000","last_undegraded":"2024-05-14T14:41:03.728711+0000","last_fullsized":"2024-05-14T14:41:03.728711+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:25:39.658272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":3,"reported_epoch":35,"state":"creating+activating","last_fresh":"2024-05-14T14:41:04.708386+0000","last_change":"2024-05-14T14:41:04.708386+0000","last_active":"2024-05-14T14:41:03.688710+0000","last_peered":"2024-05-14T14:41:03.688710+0000","last_clean":"2024-05-14T14:41:03.688710+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-05-14T14:41:04.708386+0000","last_undegraded":"2024-05-14T14:41:04.708386+0000","last_fullsized":"2024-05-14T14:41:04.708386+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":["5","3"],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.723197+0000","last_change":"2024-05-14T14:41:03.718095+0000","last_active":"2024-05-14T14:41:03.723197+0000","last_peered":"2024-05-14T14:41:03.723197+0000","last_clean":"2024-05-14T14:41:03.723197+0000","last_became_active":"2024-05-14T14:41:03.717721+0000","last_became_peered":"2024-05-14T14:41:03.717721+0000","last_unstale":"2024-05-14T14:41:03.723197+0000","last_undegraded":"2024-05-14T14:41:03.723197+0000","last_fullsized":"2024-05-14T14:41:03.723197+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:48:09.099466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":134,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-05-14T14:41:03.709908+0000","last_change":"2024-05-14T14:40:06.302050+0000","last_active":"2024-05-14T14:41:03.709908+0000","last_peered":"2024-05-14T14:41:03.709908+0000","last_clean":"2024-05-14T14:41:03.709908+0000","last_became_active":"2024-05-14T14:40:06.300956+0000","last_became_peered":"2024-05-14T14:40:06.300956+0000","last_unstale":"2024-05-14T14:41:03.709908+0000","last_undegraded":"2024-05-14T14:41:03.709908+0000","last_fullsized":"2024-05-14T14:41:03.709908+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:04.850996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:04.850996+0000","last_clean_scrub_stamp":"2024-05-14T14:40:04.850996+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:08:41.028114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":983040,"data_stored":751820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":161452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":161452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":161452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":389120,"data_stored":161452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":161452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":389120,"data_stored":161452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":983040,"data_stored":751820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T14:41:12.370 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:41:12.374 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:41:13.355 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T14:41:13.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.500+0000 7fdea089f640 1 Processor -- start 2024-05-14T14:41:13.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.500+0000 7fdea089f640 1 -- start start 2024-05-14T14:41:13.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.502+0000 7fdea089f640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fde9c0d26f0 0x7fde9c15bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:13.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.502+0000 7fdea089f640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde9c072fd0 0x7fde9c0733e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:13.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.502+0000 7fdea089f640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde9c073920 con 0x7fde9c15f0f0 2024-05-14T14:41:13.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.502+0000 7fdea089f640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7fde9c15c180 con 0x7fde9c0d26f0 2024-05-14T14:41:13.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.502+0000 7fdea089f640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fde9c15ec60 con 0x7fde9c072fd0 2024-05-14T14:41:13.488 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.502+0000 7fde9a59c640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fde9c0d26f0 0x7fde9c15bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:13.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.502+0000 7fde9a59c640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7fde9c0d26f0 0x7fde9c15bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41372/0 (socket says 172.21.15.39:41372) 2024-05-14T14:41:13.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.502+0000 7fde99d9b640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fde9c15f0f0 0x7fde9c0ce700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:36524/0 (socket says 172.21.15.39:36524) 2024-05-14T14:41:13.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.502+0000 7fde9a59c640 1 -- 172.21.15.39:0/2406449570 learned_addr learned my addr 172.21.15.39:0/2406449570 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:41:13.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.502+0000 7fde9ad9d640 1 --2- 172.21.15.39:0/2406449570 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde9c072fd0 0x7fde9c0733e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:13.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.503+0000 7fde9a59c640 1 -- 172.21.15.39:0/2406449570 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde9c072fd0 msgr2=0x7fde9c0733e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:13.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.503+0000 7fde9a59c640 1 --2- 172.21.15.39:0/2406449570 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde9c072fd0 0x7fde9c0733e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:13.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.503+0000 7fde9a59c640 1 -- 172.21.15.39:0/2406449570 >> v1:172.21.15.39:6789/0 conn(0x7fde9c15f0f0 legacy=0x7fde9c0ce700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:13.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.503+0000 7fde9a59c640 1 -- 172.21.15.39:0/2406449570 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde9c0cf070 con 0x7fde9c0d26f0 2024-05-14T14:41:13.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.503+0000 7fde9959a640 1 -- 172.21.15.39:0/2406449570 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1394184812 0 0) 0x7fde90001110 con 0x7fde9c15f0f0 2024-05-14T14:41:13.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.503+0000 7fde9a59c640 1 --2- 172.21.15.39:0/2406449570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde9c0d26f0 0x7fde9c15bc40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fde8c009e50 tx=0x7fde8c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e149cdfbe4073b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:13.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.504+0000 7fde9959a640 1 -- 172.21.15.39:0/2406449570 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde8c036070 con 0x7fde9c0d26f0 2024-05-14T14:41:13.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.504+0000 7fde9959a640 1 -- 172.21.15.39:0/2406449570 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde8c031600 con 0x7fde9c0d26f0 2024-05-14T14:41:13.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.504+0000 7fde9959a640 1 -- 172.21.15.39:0/2406449570 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde8c0319d0 con 0x7fde9c0d26f0 2024-05-14T14:41:13.489 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.504+0000 7fdea089f640 1 -- 172.21.15.39:0/2406449570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde9c0d26f0 msgr2=0x7fde9c15bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:13.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.504+0000 7fdea089f640 1 --2- 172.21.15.39:0/2406449570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde9c0d26f0 0x7fde9c15bc40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fde8c009e50 tx=0x7fde8c02a680 comp rx=0 tx=0).stop 2024-05-14T14:41:13.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.504+0000 7fdea089f640 1 -- 172.21.15.39:0/2406449570 shutdown_connections 2024-05-14T14:41:13.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.504+0000 7fdea089f640 1 --2- 172.21.15.39:0/2406449570 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde9c072fd0 0x7fde9c0733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:13.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.504+0000 7fdea089f640 1 --2- 172.21.15.39:0/2406449570 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde9c0d26f0 0x7fde9c15bc40 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:13.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.504+0000 7fdea089f640 1 -- 172.21.15.39:0/2406449570 >> 172.21.15.39:0/2406449570 conn(0x7fde9c0d3ae0 msgr2=0x7fde9c0d3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:13.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.504+0000 7fdea089f640 1 -- 172.21.15.39:0/2406449570 shutdown_connections 2024-05-14T14:41:13.490 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.504+0000 7fdea089f640 1 -- 172.21.15.39:0/2406449570 wait complete. 2024-05-14T14:41:13.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.506+0000 7fdea089f640 1 Processor -- start 2024-05-14T14:41:13.491 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.506+0000 7fdea089f640 1 -- start start 2024-05-14T14:41:13.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.508+0000 7fdea089f640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde9c072fd0 0x7fde9c0ac2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:13.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.508+0000 7fdea089f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde9c0d26f0 0x7fde9c151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:13.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.508+0000 7fdea089f640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde9c15f0f0 0x7fde9c0aa600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:13.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.508+0000 7fdea089f640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fde9c15e8f0 con 0x7fde9c15f0f0 2024-05-14T14:41:13.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.508+0000 7fdea089f640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fde9c0cee10 con 0x7fde9c0d26f0 2024-05-14T14:41:13.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.508+0000 7fdea089f640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fde9c15f500 con 0x7fde9c072fd0 2024-05-14T14:41:13.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.508+0000 7fde9ad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde9c15f0f0 0x7fde9c0aa600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:13.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.508+0000 7fde9ad9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde9c15f0f0 0x7fde9c0aa600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41386/0 (socket says 172.21.15.39:41386) 2024-05-14T14:41:13.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.508+0000 7fde9ad9d640 1 -- 172.21.15.39:0/2951266643 learned_addr learned my addr 172.21.15.39:0/2951266643 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:41:13.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.508+0000 7fde9a59c640 1 --2- 172.21.15.39:0/2951266643 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde9c072fd0 0x7fde9c0ac2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:13.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.508+0000 7fde99d9b640 1 --2- 172.21.15.39:0/2951266643 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde9c0d26f0 0x7fde9c151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:13.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.508+0000 7fde9ad9d640 1 -- 172.21.15.39:0/2951266643 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde9c072fd0 msgr2=0x7fde9c0ac2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:13.493 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.508+0000 7fde9ad9d640 1 --2- 172.21.15.39:0/2951266643 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde9c072fd0 0x7fde9c0ac2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:13.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.508+0000 7fde9ad9d640 1 -- 172.21.15.39:0/2951266643 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde9c0d26f0 msgr2=0x7fde9c151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:13.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.508+0000 7fde9ad9d640 1 --2- 172.21.15.39:0/2951266643 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde9c0d26f0 0x7fde9c151e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:13.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.508+0000 7fde9ad9d640 1 -- 172.21.15.39:0/2951266643 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde9c0ab250 con 0x7fde9c15f0f0 2024-05-14T14:41:13.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.508+0000 7fde9ad9d640 1 --2- 172.21.15.39:0/2951266643 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde9c15f0f0 0x7fde9c0aa600 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fde9400e7c0 tx=0x7fde9400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:13.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.509+0000 7fde8affd640 1 -- 172.21.15.39:0/2951266643 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde94017070 con 0x7fde9c15f0f0 2024-05-14T14:41:13.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.509+0000 7fde8affd640 1 -- 172.21.15.39:0/2951266643 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde9400c6d0 con 0x7fde9c15f0f0 2024-05-14T14:41:13.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.509+0000 7fdea089f640 1 -- 172.21.15.39:0/2951266643 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde9c0ab530 con 0x7fde9c15f0f0 2024-05-14T14:41:13.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.509+0000 7fde8affd640 1 -- 172.21.15.39:0/2951266643 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9400cac0 con 0x7fde9c15f0f0 2024-05-14T14:41:13.494 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.509+0000 7fdea089f640 1 -- 172.21.15.39:0/2951266643 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde9c0abaf0 con 0x7fde9c15f0f0 2024-05-14T14:41:13.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.510+0000 7fdea089f640 1 -- 172.21.15.39:0/2951266643 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde9c076aa0 con 0x7fde9c15f0f0 2024-05-14T14:41:13.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.511+0000 7fde8affd640 1 -- 172.21.15.39:0/2951266643 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fde9401a070 con 0x7fde9c15f0f0 2024-05-14T14:41:13.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.511+0000 7fde8affd640 1 --2- 172.21.15.39:0/2951266643 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fde7c076300 0x7fde7c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:13.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.511+0000 7fde8affd640 1 -- 172.21.15.39:0/2951266643 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7fde94097770 con 0x7fde9c15f0f0 2024-05-14T14:41:13.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.511+0000 7fde9a59c640 1 --2- 172.21.15.39:0/2951266643 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fde7c076300 0x7fde7c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:13.495 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.512+0000 7fde9a59c640 1 --2- 172.21.15.39:0/2951266643 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fde7c076300 0x7fde7c078810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fde8c033000 tx=0x7fde8c009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:13.500 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.516+0000 7fde8affd640 1 -- 172.21.15.39:0/2951266643 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fde94060980 con 0x7fde9c15f0f0 2024-05-14T14:41:13.687 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.703+0000 7fdea089f640 1 -- 172.21.15.39:0/2951266643 --> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fde9c0aafe0 con 0x7fde7c076300 2024-05-14T14:41:13.693 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.709+0000 7fde8affd640 1 -- 172.21.15.39:0/2951266643 <== mgr.4105 v2:172.21.15.39:6832/498853008 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251947 (secure 0 0 0) 0x7fde9c0aafe0 con 0x7fde7c076300 2024-05-14T14:41:13.695 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:41:13.697 INFO:teuthology.orchestra.run.smithi039.stderr:dumped all 2024-05-14T14:41:13.698 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.712+0000 7fdea089f640 1 -- 172.21.15.39:0/2951266643 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fde7c076300 msgr2=0x7fde7c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:13.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.712+0000 7fdea089f640 1 --2- 172.21.15.39:0/2951266643 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fde7c076300 0x7fde7c078810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fde8c033000 tx=0x7fde8c009000 comp rx=0 tx=0).stop 2024-05-14T14:41:13.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.712+0000 7fdea089f640 1 -- 172.21.15.39:0/2951266643 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde9c15f0f0 msgr2=0x7fde9c0aa600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:13.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.712+0000 7fdea089f640 1 --2- 172.21.15.39:0/2951266643 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde9c15f0f0 0x7fde9c0aa600 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fde9400e7c0 tx=0x7fde9400ec80 comp rx=0 tx=0).stop 2024-05-14T14:41:13.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.712+0000 7fdea089f640 1 -- 172.21.15.39:0/2951266643 shutdown_connections 2024-05-14T14:41:13.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.712+0000 7fdea089f640 1 --2- 172.21.15.39:0/2951266643 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fde7c076300 0x7fde7c078810 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:13.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.712+0000 7fdea089f640 1 --2- 172.21.15.39:0/2951266643 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fde9c15f0f0 0x7fde9c0aa600 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:13.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.712+0000 7fdea089f640 1 --2- 172.21.15.39:0/2951266643 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fde9c0d26f0 0x7fde9c151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:13.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.712+0000 7fdea089f640 1 --2- 172.21.15.39:0/2951266643 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fde9c072fd0 0x7fde9c0ac2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:13.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.712+0000 7fdea089f640 1 -- 172.21.15.39:0/2951266643 >> 172.21.15.39:0/2951266643 conn(0x7fde9c0d3ae0 msgr2=0x7fde9c0b55b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:13.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.712+0000 7fdea089f640 1 -- 172.21.15.39:0/2951266643 shutdown_connections 2024-05-14T14:41:13.699 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.712+0000 7fdea089f640 1 -- 172.21.15.39:0/2951266643 wait complete. 2024-05-14T14:41:13.707 INFO:teuthology.orchestra.run.smithi039.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-05-14T14:41:12.689435+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":233096,"kb_used_data":4456,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754741624,"statfs":{"total":773094113280,"available":772855422976,"internally_reserved":0,"allocated":4562944,"data_stored":2588044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":234016308},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002235"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.145027+0000","last_change":"2024-05-14T14:41:04.732158+0000","last_active":"2024-05-14T14:41:06.145027+0000","last_peered":"2024-05-14T14:41:06.145027+0000","last_clean":"2024-05-14T14:41:06.145027+0000","last_became_active":"2024-05-14T14:41:04.731851+0000","last_became_peered":"2024-05-14T14:41:04.731851+0000","last_unstale":"2024-05-14T14:41:06.145027+0000","last_undegraded":"2024-05-14T14:41:06.145027+0000","last_fullsized":"2024-05-14T14:41:06.145027+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:14:33.615399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.144400+0000","last_change":"2024-05-14T14:41:04.735574+0000","last_active":"2024-05-14T14:41:06.144400+0000","last_peered":"2024-05-14T14:41:06.144400+0000","last_clean":"2024-05-14T14:41:06.144400+0000","last_became_active":"2024-05-14T14:41:04.735271+0000","last_became_peered":"2024-05-14T14:41:04.735271+0000","last_unstale":"2024-05-14T14:41:06.144400+0000","last_undegraded":"2024-05-14T14:41:06.144400+0000","last_fullsized":"2024-05-14T14:41:06.144400+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:05:08.417720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.143748+0000","last_change":"2024-05-14T14:41:04.738643+0000","last_active":"2024-05-14T14:41:06.143748+0000","last_peered":"2024-05-14T14:41:06.143748+0000","last_clean":"2024-05-14T14:41:06.143748+0000","last_became_active":"2024-05-14T14:41:04.738315+0000","last_became_peered":"2024-05-14T14:41:04.738315+0000","last_unstale":"2024-05-14T14:41:06.143748+0000","last_undegraded":"2024-05-14T14:41:06.143748+0000","last_fullsized":"2024-05-14T14:41:06.143748+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:15:56.358305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.707216+0000","last_change":"2024-05-14T14:41:04.733789+0000","last_active":"2024-05-14T14:41:05.707216+0000","last_peered":"2024-05-14T14:41:05.707216+0000","last_clean":"2024-05-14T14:41:05.707216+0000","last_became_active":"2024-05-14T14:41:04.733444+0000","last_became_peered":"2024-05-14T14:41:04.733444+0000","last_unstale":"2024-05-14T14:41:05.707216+0000","last_undegraded":"2024-05-14T14:41:05.707216+0000","last_fullsized":"2024-05-14T14:41:05.707216+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:20:12.246178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.707026+0000","last_change":"2024-05-14T14:41:04.732025+0000","last_active":"2024-05-14T14:41:05.707026+0000","last_peered":"2024-05-14T14:41:05.707026+0000","last_clean":"2024-05-14T14:41:05.707026+0000","last_became_active":"2024-05-14T14:41:04.731724+0000","last_became_peered":"2024-05-14T14:41:04.731724+0000","last_unstale":"2024-05-14T14:41:05.707026+0000","last_undegraded":"2024-05-14T14:41:05.707026+0000","last_fullsized":"2024-05-14T14:41:05.707026+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:33:02.646527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.143944+0000","last_change":"2024-05-14T14:41:04.731626+0000","last_active":"2024-05-14T14:41:06.143944+0000","last_peered":"2024-05-14T14:41:06.143944+0000","last_clean":"2024-05-14T14:41:06.143944+0000","last_became_active":"2024-05-14T14:41:04.731240+0000","last_became_peered":"2024-05-14T14:41:04.731240+0000","last_unstale":"2024-05-14T14:41:06.143944+0000","last_undegraded":"2024-05-14T14:41:06.143944+0000","last_fullsized":"2024-05-14T14:41:06.143944+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:04:50.947565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.736037+0000","last_change":"2024-05-14T14:41:04.725032+0000","last_active":"2024-05-14T14:41:05.736037+0000","last_peered":"2024-05-14T14:41:05.736037+0000","last_clean":"2024-05-14T14:41:05.736037+0000","last_became_active":"2024-05-14T14:41:04.724562+0000","last_became_peered":"2024-05-14T14:41:04.724562+0000","last_unstale":"2024-05-14T14:41:05.736037+0000","last_undegraded":"2024-05-14T14:41:05.736037+0000","last_fullsized":"2024-05-14T14:41:05.736037+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:05:08.417720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.144324+0000","last_change":"2024-05-14T14:41:04.736538+0000","last_active":"2024-05-14T14:41:06.144324+0000","last_peered":"2024-05-14T14:41:06.144324+0000","last_clean":"2024-05-14T14:41:06.144324+0000","last_became_active":"2024-05-14T14:41:04.736213+0000","last_became_peered":"2024-05-14T14:41:04.736213+0000","last_unstale":"2024-05-14T14:41:06.144324+0000","last_undegraded":"2024-05-14T14:41:06.144324+0000","last_fullsized":"2024-05-14T14:41:06.144324+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:54:45.493543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.144895+0000","last_change":"2024-05-14T14:41:04.740769+0000","last_active":"2024-05-14T14:41:06.144895+0000","last_peered":"2024-05-14T14:41:06.144895+0000","last_clean":"2024-05-14T14:41:06.144895+0000","last_became_active":"2024-05-14T14:41:04.740425+0000","last_became_peered":"2024-05-14T14:41:04.740425+0000","last_unstale":"2024-05-14T14:41:06.144895+0000","last_undegraded":"2024-05-14T14:41:06.144895+0000","last_fullsized":"2024-05-14T14:41:06.144895+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:57:50.350343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.736680+0000","last_change":"2024-05-14T14:41:04.729912+0000","last_active":"2024-05-14T14:41:05.736680+0000","last_peered":"2024-05-14T14:41:05.736680+0000","last_clean":"2024-05-14T14:41:05.736680+0000","last_became_active":"2024-05-14T14:41:04.729316+0000","last_became_peered":"2024-05-14T14:41:04.729316+0000","last_unstale":"2024-05-14T14:41:05.736680+0000","last_undegraded":"2024-05-14T14:41:05.736680+0000","last_fullsized":"2024-05-14T14:41:05.736680+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:53:57.510894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.736603+0000","last_change":"2024-05-14T14:41:04.711683+0000","last_active":"2024-05-14T14:41:05.736603+0000","last_peered":"2024-05-14T14:41:05.736603+0000","last_clean":"2024-05-14T14:41:05.736603+0000","last_became_active":"2024-05-14T14:41:04.711190+0000","last_became_peered":"2024-05-14T14:41:04.711190+0000","last_unstale":"2024-05-14T14:41:05.736603+0000","last_undegraded":"2024-05-14T14:41:05.736603+0000","last_fullsized":"2024-05-14T14:41:05.736603+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:10:47.704183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.144349+0000","last_change":"2024-05-14T14:41:04.733418+0000","last_active":"2024-05-14T14:41:06.144349+0000","last_peered":"2024-05-14T14:41:06.144349+0000","last_clean":"2024-05-14T14:41:06.144349+0000","last_became_active":"2024-05-14T14:41:04.733102+0000","last_became_peered":"2024-05-14T14:41:04.733102+0000","last_unstale":"2024-05-14T14:41:06.144349+0000","last_undegraded":"2024-05-14T14:41:06.144349+0000","last_fullsized":"2024-05-14T14:41:06.144349+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:07:38.773476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.736290+0000","last_change":"2024-05-14T14:41:04.724205+0000","last_active":"2024-05-14T14:41:05.736290+0000","last_peered":"2024-05-14T14:41:05.736290+0000","last_clean":"2024-05-14T14:41:05.736290+0000","last_became_active":"2024-05-14T14:41:04.723870+0000","last_became_peered":"2024-05-14T14:41:04.723870+0000","last_unstale":"2024-05-14T14:41:05.736290+0000","last_undegraded":"2024-05-14T14:41:05.736290+0000","last_fullsized":"2024-05-14T14:41:05.736290+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:07:43.817289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.709320+0000","last_change":"2024-05-14T14:41:04.726391+0000","last_active":"2024-05-14T14:41:05.709320+0000","last_peered":"2024-05-14T14:41:05.709320+0000","last_clean":"2024-05-14T14:41:05.709320+0000","last_became_active":"2024-05-14T14:41:04.726073+0000","last_became_peered":"2024-05-14T14:41:04.726073+0000","last_unstale":"2024-05-14T14:41:05.709320+0000","last_undegraded":"2024-05-14T14:41:05.709320+0000","last_fullsized":"2024-05-14T14:41:05.709320+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:46:24.703089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.736081+0000","last_change":"2024-05-14T14:41:04.738279+0000","last_active":"2024-05-14T14:41:05.736081+0000","last_peered":"2024-05-14T14:41:05.736081+0000","last_clean":"2024-05-14T14:41:05.736081+0000","last_became_active":"2024-05-14T14:41:04.735648+0000","last_became_peered":"2024-05-14T14:41:04.735648+0000","last_unstale":"2024-05-14T14:41:05.736081+0000","last_undegraded":"2024-05-14T14:41:05.736081+0000","last_fullsized":"2024-05-14T14:41:05.736081+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:24:20.032766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.708262+0000","last_change":"2024-05-14T14:41:04.736802+0000","last_active":"2024-05-14T14:41:05.708262+0000","last_peered":"2024-05-14T14:41:05.708262+0000","last_clean":"2024-05-14T14:41:05.708262+0000","last_became_active":"2024-05-14T14:41:04.734245+0000","last_became_peered":"2024-05-14T14:41:04.734245+0000","last_unstale":"2024-05-14T14:41:05.708262+0000","last_undegraded":"2024-05-14T14:41:05.708262+0000","last_fullsized":"2024-05-14T14:41:05.708262+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:57:50.350343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.708948+0000","last_change":"2024-05-14T14:41:04.741589+0000","last_active":"2024-05-14T14:41:05.708948+0000","last_peered":"2024-05-14T14:41:05.708948+0000","last_clean":"2024-05-14T14:41:05.708948+0000","last_became_active":"2024-05-14T14:41:04.741268+0000","last_became_peered":"2024-05-14T14:41:04.741268+0000","last_unstale":"2024-05-14T14:41:05.708948+0000","last_undegraded":"2024-05-14T14:41:05.708948+0000","last_fullsized":"2024-05-14T14:41:05.708948+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:54:45.493543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.144459+0000","last_change":"2024-05-14T14:41:04.727438+0000","last_active":"2024-05-14T14:41:06.144459+0000","last_peered":"2024-05-14T14:41:06.144459+0000","last_clean":"2024-05-14T14:41:06.144459+0000","last_became_active":"2024-05-14T14:41:04.727074+0000","last_became_peered":"2024-05-14T14:41:04.727074+0000","last_unstale":"2024-05-14T14:41:06.144459+0000","last_undegraded":"2024-05-14T14:41:06.144459+0000","last_fullsized":"2024-05-14T14:41:06.144459+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:15:56.358305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.707283+0000","last_change":"2024-05-14T14:41:04.732851+0000","last_active":"2024-05-14T14:41:05.707283+0000","last_peered":"2024-05-14T14:41:05.707283+0000","last_clean":"2024-05-14T14:41:05.707283+0000","last_became_active":"2024-05-14T14:41:04.732538+0000","last_became_peered":"2024-05-14T14:41:04.732538+0000","last_unstale":"2024-05-14T14:41:05.707283+0000","last_undegraded":"2024-05-14T14:41:05.707283+0000","last_fullsized":"2024-05-14T14:41:05.707283+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:10:38.227952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.144245+0000","last_change":"2024-05-14T14:41:04.726480+0000","last_active":"2024-05-14T14:41:06.144245+0000","last_peered":"2024-05-14T14:41:06.144245+0000","last_clean":"2024-05-14T14:41:06.144245+0000","last_became_active":"2024-05-14T14:41:04.726176+0000","last_became_peered":"2024-05-14T14:41:04.726176+0000","last_unstale":"2024-05-14T14:41:06.144245+0000","last_undegraded":"2024-05-14T14:41:06.144245+0000","last_fullsized":"2024-05-14T14:41:06.144245+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:19:33.814119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.736197+0000","last_change":"2024-05-14T14:41:04.718806+0000","last_active":"2024-05-14T14:41:05.736197+0000","last_peered":"2024-05-14T14:41:05.736197+0000","last_clean":"2024-05-14T14:41:05.736197+0000","last_became_active":"2024-05-14T14:41:04.718045+0000","last_became_peered":"2024-05-14T14:41:04.718045+0000","last_unstale":"2024-05-14T14:41:05.736197+0000","last_undegraded":"2024-05-14T14:41:05.736197+0000","last_fullsized":"2024-05-14T14:41:05.736197+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:27:36.632048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.709840+0000","last_change":"2024-05-14T14:41:04.733905+0000","last_active":"2024-05-14T14:41:05.709840+0000","last_peered":"2024-05-14T14:41:05.709840+0000","last_clean":"2024-05-14T14:41:05.709840+0000","last_became_active":"2024-05-14T14:41:04.733610+0000","last_became_peered":"2024-05-14T14:41:04.733610+0000","last_unstale":"2024-05-14T14:41:05.709840+0000","last_undegraded":"2024-05-14T14:41:05.709840+0000","last_fullsized":"2024-05-14T14:41:05.709840+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:15:56.358305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.708470+0000","last_change":"2024-05-14T14:41:04.734402+0000","last_active":"2024-05-14T14:41:05.708470+0000","last_peered":"2024-05-14T14:41:05.708470+0000","last_clean":"2024-05-14T14:41:05.708470+0000","last_became_active":"2024-05-14T14:41:04.733809+0000","last_became_peered":"2024-05-14T14:41:04.733809+0000","last_unstale":"2024-05-14T14:41:05.708470+0000","last_undegraded":"2024-05-14T14:41:05.708470+0000","last_fullsized":"2024-05-14T14:41:05.708470+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:47:24.631283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.706919+0000","last_change":"2024-05-14T14:41:04.741270+0000","last_active":"2024-05-14T14:41:05.706919+0000","last_peered":"2024-05-14T14:41:05.706919+0000","last_clean":"2024-05-14T14:41:05.706919+0000","last_became_active":"2024-05-14T14:41:04.740980+0000","last_became_peered":"2024-05-14T14:41:04.740980+0000","last_unstale":"2024-05-14T14:41:05.706919+0000","last_undegraded":"2024-05-14T14:41:05.706919+0000","last_fullsized":"2024-05-14T14:41:05.706919+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:48:24.550950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.144450+0000","last_change":"2024-05-14T14:41:04.734794+0000","last_active":"2024-05-14T14:41:06.144450+0000","last_peered":"2024-05-14T14:41:06.144450+0000","last_clean":"2024-05-14T14:41:06.144450+0000","last_became_active":"2024-05-14T14:41:04.734459+0000","last_became_peered":"2024-05-14T14:41:04.734459+0000","last_unstale":"2024-05-14T14:41:06.144450+0000","last_undegraded":"2024-05-14T14:41:06.144450+0000","last_fullsized":"2024-05-14T14:41:06.144450+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:25:39.618519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.144766+0000","last_change":"2024-05-14T14:41:04.719868+0000","last_active":"2024-05-14T14:41:06.144766+0000","last_peered":"2024-05-14T14:41:06.144766+0000","last_clean":"2024-05-14T14:41:06.144766+0000","last_became_active":"2024-05-14T14:41:04.719499+0000","last_became_peered":"2024-05-14T14:41:04.719499+0000","last_unstale":"2024-05-14T14:41:06.144766+0000","last_undegraded":"2024-05-14T14:41:06.144766+0000","last_fullsized":"2024-05-14T14:41:06.144766+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:07:38.773476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.144440+0000","last_change":"2024-05-14T14:41:04.734051+0000","last_active":"2024-05-14T14:41:06.144440+0000","last_peered":"2024-05-14T14:41:06.144440+0000","last_clean":"2024-05-14T14:41:06.144440+0000","last_became_active":"2024-05-14T14:41:04.733691+0000","last_became_peered":"2024-05-14T14:41:04.733691+0000","last_unstale":"2024-05-14T14:41:06.144440+0000","last_undegraded":"2024-05-14T14:41:06.144440+0000","last_fullsized":"2024-05-14T14:41:06.144440+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:46:24.703089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.736539+0000","last_change":"2024-05-14T14:41:04.737607+0000","last_active":"2024-05-14T14:41:05.736539+0000","last_peered":"2024-05-14T14:41:05.736539+0000","last_clean":"2024-05-14T14:41:05.736539+0000","last_became_active":"2024-05-14T14:41:04.735265+0000","last_became_peered":"2024-05-14T14:41:04.735265+0000","last_unstale":"2024-05-14T14:41:05.736539+0000","last_undegraded":"2024-05-14T14:41:05.736539+0000","last_fullsized":"2024-05-14T14:41:05.736539+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:34:43.055490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.144150+0000","last_change":"2024-05-14T14:41:04.724137+0000","last_active":"2024-05-14T14:41:06.144150+0000","last_peered":"2024-05-14T14:41:06.144150+0000","last_clean":"2024-05-14T14:41:06.144150+0000","last_became_active":"2024-05-14T14:41:04.723721+0000","last_became_peered":"2024-05-14T14:41:04.723721+0000","last_unstale":"2024-05-14T14:41:06.144150+0000","last_undegraded":"2024-05-14T14:41:06.144150+0000","last_fullsized":"2024-05-14T14:41:06.144150+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:10:57.882201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.144083+0000","last_change":"2024-05-14T14:41:04.730588+0000","last_active":"2024-05-14T14:41:06.144083+0000","last_peered":"2024-05-14T14:41:06.144083+0000","last_clean":"2024-05-14T14:41:06.144083+0000","last_became_active":"2024-05-14T14:41:04.730260+0000","last_became_peered":"2024-05-14T14:41:04.730260+0000","last_unstale":"2024-05-14T14:41:06.144083+0000","last_undegraded":"2024-05-14T14:41:06.144083+0000","last_fullsized":"2024-05-14T14:41:06.144083+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:25:40.670957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.708714+0000","last_change":"2024-05-14T14:41:04.736379+0000","last_active":"2024-05-14T14:41:05.708714+0000","last_peered":"2024-05-14T14:41:05.708714+0000","last_clean":"2024-05-14T14:41:05.708714+0000","last_became_active":"2024-05-14T14:41:04.736001+0000","last_became_peered":"2024-05-14T14:41:04.736001+0000","last_unstale":"2024-05-14T14:41:05.708714+0000","last_undegraded":"2024-05-14T14:41:05.708714+0000","last_fullsized":"2024-05-14T14:41:05.708714+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:25:59.860252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.143766+0000","last_change":"2024-05-14T14:41:04.733652+0000","last_active":"2024-05-14T14:41:06.143766+0000","last_peered":"2024-05-14T14:41:06.143766+0000","last_clean":"2024-05-14T14:41:06.143766+0000","last_became_active":"2024-05-14T14:41:04.733333+0000","last_became_peered":"2024-05-14T14:41:04.733333+0000","last_unstale":"2024-05-14T14:41:06.143766+0000","last_undegraded":"2024-05-14T14:41:06.143766+0000","last_fullsized":"2024-05-14T14:41:06.143766+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:15:56.358305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.708427+0000","last_change":"2024-05-14T14:41:04.740186+0000","last_active":"2024-05-14T14:41:05.708427+0000","last_peered":"2024-05-14T14:41:05.708427+0000","last_clean":"2024-05-14T14:41:05.708427+0000","last_became_active":"2024-05-14T14:41:04.739611+0000","last_became_peered":"2024-05-14T14:41:04.739611+0000","last_unstale":"2024-05-14T14:41:05.708427+0000","last_undegraded":"2024-05-14T14:41:05.708427+0000","last_fullsized":"2024-05-14T14:41:05.708427+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:01:48.904941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"35'4","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.144416+0000","last_change":"2024-05-14T14:41:03.722090+0000","last_active":"2024-05-14T14:41:06.144416+0000","last_peered":"2024-05-14T14:41:06.144416+0000","last_clean":"2024-05-14T14:41:06.144416+0000","last_became_active":"2024-05-14T14:41:03.721399+0000","last_became_peered":"2024-05-14T14:41:03.721399+0000","last_unstale":"2024-05-14T14:41:06.144416+0000","last_undegraded":"2024-05-14T14:41:06.144416+0000","last_fullsized":"2024-05-14T14:41:06.144416+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:35:33.172311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.144332+0000","last_change":"2024-05-14T14:41:04.719693+0000","last_active":"2024-05-14T14:41:06.144332+0000","last_peered":"2024-05-14T14:41:06.144332+0000","last_clean":"2024-05-14T14:41:06.144332+0000","last_became_active":"2024-05-14T14:41:04.719354+0000","last_became_peered":"2024-05-14T14:41:04.719354+0000","last_unstale":"2024-05-14T14:41:06.144332+0000","last_undegraded":"2024-05-14T14:41:06.144332+0000","last_fullsized":"2024-05-14T14:41:06.144332+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:41:45.988742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.144421+0000","last_change":"2024-05-14T14:41:03.724616+0000","last_active":"2024-05-14T14:41:06.144421+0000","last_peered":"2024-05-14T14:41:06.144421+0000","last_clean":"2024-05-14T14:41:06.144421+0000","last_became_active":"2024-05-14T14:41:03.724230+0000","last_became_peered":"2024-05-14T14:41:03.724230+0000","last_unstale":"2024-05-14T14:41:06.144421+0000","last_undegraded":"2024-05-14T14:41:06.144421+0000","last_fullsized":"2024-05-14T14:41:06.144421+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:44:06.562919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.710171+0000","last_change":"2024-05-14T14:41:04.730431+0000","last_active":"2024-05-14T14:41:05.710171+0000","last_peered":"2024-05-14T14:41:05.710171+0000","last_clean":"2024-05-14T14:41:05.710171+0000","last_became_active":"2024-05-14T14:41:04.730130+0000","last_became_peered":"2024-05-14T14:41:04.730130+0000","last_unstale":"2024-05-14T14:41:05.710171+0000","last_undegraded":"2024-05-14T14:41:05.710171+0000","last_fullsized":"2024-05-14T14:41:05.710171+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:41:45.988742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.144540+0000","last_change":"2024-05-14T14:41:03.719275+0000","last_active":"2024-05-14T14:41:06.144540+0000","last_peered":"2024-05-14T14:41:06.144540+0000","last_clean":"2024-05-14T14:41:06.144540+0000","last_became_active":"2024-05-14T14:41:03.718969+0000","last_became_peered":"2024-05-14T14:41:03.718969+0000","last_unstale":"2024-05-14T14:41:06.144540+0000","last_undegraded":"2024-05-14T14:41:06.144540+0000","last_fullsized":"2024-05-14T14:41:06.144540+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:24:12.482756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.144927+0000","last_change":"2024-05-14T14:41:04.743229+0000","last_active":"2024-05-14T14:41:06.144927+0000","last_peered":"2024-05-14T14:41:06.144927+0000","last_clean":"2024-05-14T14:41:06.144927+0000","last_became_active":"2024-05-14T14:41:04.742944+0000","last_became_peered":"2024-05-14T14:41:04.742944+0000","last_unstale":"2024-05-14T14:41:06.144927+0000","last_undegraded":"2024-05-14T14:41:06.144927+0000","last_fullsized":"2024-05-14T14:41:06.144927+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:07:43.817289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.709730+0000","last_change":"2024-05-14T14:41:03.725959+0000","last_active":"2024-05-14T14:41:05.709730+0000","last_peered":"2024-05-14T14:41:05.709730+0000","last_clean":"2024-05-14T14:41:05.709730+0000","last_became_active":"2024-05-14T14:41:03.725575+0000","last_became_peered":"2024-05-14T14:41:03.725575+0000","last_unstale":"2024-05-14T14:41:05.709730+0000","last_undegraded":"2024-05-14T14:41:05.709730+0000","last_fullsized":"2024-05-14T14:41:05.709730+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:19:36.739344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.143718+0000","last_change":"2024-05-14T14:41:04.731132+0000","last_active":"2024-05-14T14:41:06.143718+0000","last_peered":"2024-05-14T14:41:06.143718+0000","last_clean":"2024-05-14T14:41:06.143718+0000","last_became_active":"2024-05-14T14:41:04.730568+0000","last_became_peered":"2024-05-14T14:41:04.730568+0000","last_unstale":"2024-05-14T14:41:06.143718+0000","last_undegraded":"2024-05-14T14:41:06.143718+0000","last_fullsized":"2024-05-14T14:41:06.143718+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:25:39.618519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.736369+0000","last_change":"2024-05-14T14:41:03.721697+0000","last_active":"2024-05-14T14:41:05.736369+0000","last_peered":"2024-05-14T14:41:05.736369+0000","last_clean":"2024-05-14T14:41:05.736369+0000","last_became_active":"2024-05-14T14:41:03.721285+0000","last_became_peered":"2024-05-14T14:41:03.721285+0000","last_unstale":"2024-05-14T14:41:05.736369+0000","last_undegraded":"2024-05-14T14:41:05.736369+0000","last_fullsized":"2024-05-14T14:41:05.736369+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:19:32.801434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.736291+0000","last_change":"2024-05-14T14:41:04.718515+0000","last_active":"2024-05-14T14:41:05.736291+0000","last_peered":"2024-05-14T14:41:05.736291+0000","last_clean":"2024-05-14T14:41:05.736291+0000","last_became_active":"2024-05-14T14:41:04.718200+0000","last_became_peered":"2024-05-14T14:41:04.718200+0000","last_unstale":"2024-05-14T14:41:05.736291+0000","last_undegraded":"2024-05-14T14:41:05.736291+0000","last_fullsized":"2024-05-14T14:41:05.736291+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:14:33.615399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.708800+0000","last_change":"2024-05-14T14:41:03.717009+0000","last_active":"2024-05-14T14:41:05.708800+0000","last_peered":"2024-05-14T14:41:05.708800+0000","last_clean":"2024-05-14T14:41:05.708800+0000","last_became_active":"2024-05-14T14:41:03.716607+0000","last_became_peered":"2024-05-14T14:41:03.716607+0000","last_unstale":"2024-05-14T14:41:05.708800+0000","last_undegraded":"2024-05-14T14:41:05.708800+0000","last_fullsized":"2024-05-14T14:41:05.708800+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:25:39.658272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.710284+0000","last_change":"2024-05-14T14:41:04.711646+0000","last_active":"2024-05-14T14:41:05.710284+0000","last_peered":"2024-05-14T14:41:05.710284+0000","last_clean":"2024-05-14T14:41:05.710284+0000","last_became_active":"2024-05-14T14:41:04.711301+0000","last_became_peered":"2024-05-14T14:41:04.711301+0000","last_unstale":"2024-05-14T14:41:05.710284+0000","last_undegraded":"2024-05-14T14:41:05.710284+0000","last_fullsized":"2024-05-14T14:41:05.710284+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:47:24.268135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.143905+0000","last_change":"2024-05-14T14:41:03.725105+0000","last_active":"2024-05-14T14:41:06.143905+0000","last_peered":"2024-05-14T14:41:06.143905+0000","last_clean":"2024-05-14T14:41:06.143905+0000","last_became_active":"2024-05-14T14:41:03.724805+0000","last_became_peered":"2024-05-14T14:41:03.724805+0000","last_unstale":"2024-05-14T14:41:06.143905+0000","last_undegraded":"2024-05-14T14:41:06.143905+0000","last_fullsized":"2024-05-14T14:41:06.143905+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:44:06.562919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.144339+0000","last_change":"2024-05-14T14:41:04.730585+0000","last_active":"2024-05-14T14:41:06.144339+0000","last_peered":"2024-05-14T14:41:06.144339+0000","last_clean":"2024-05-14T14:41:06.144339+0000","last_became_active":"2024-05-14T14:41:04.730204+0000","last_became_peered":"2024-05-14T14:41:04.730204+0000","last_unstale":"2024-05-14T14:41:06.144339+0000","last_undegraded":"2024-05-14T14:41:06.144339+0000","last_fullsized":"2024-05-14T14:41:06.144339+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:02:17.484376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.709329+0000","last_change":"2024-05-14T14:41:03.725816+0000","last_active":"2024-05-14T14:41:05.709329+0000","last_peered":"2024-05-14T14:41:05.709329+0000","last_clean":"2024-05-14T14:41:05.709329+0000","last_became_active":"2024-05-14T14:41:03.725330+0000","last_became_peered":"2024-05-14T14:41:03.725330+0000","last_unstale":"2024-05-14T14:41:05.709329+0000","last_undegraded":"2024-05-14T14:41:05.709329+0000","last_fullsized":"2024-05-14T14:41:05.709329+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:48:09.099466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.707320+0000","last_change":"2024-05-14T14:41:04.733656+0000","last_active":"2024-05-14T14:41:05.707320+0000","last_peered":"2024-05-14T14:41:05.707320+0000","last_clean":"2024-05-14T14:41:05.707320+0000","last_became_active":"2024-05-14T14:41:04.733342+0000","last_became_peered":"2024-05-14T14:41:04.733342+0000","last_unstale":"2024-05-14T14:41:05.707320+0000","last_undegraded":"2024-05-14T14:41:05.707320+0000","last_fullsized":"2024-05-14T14:41:05.707320+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:58:49.323425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.145031+0000","last_change":"2024-05-14T14:41:03.723514+0000","last_active":"2024-05-14T14:41:06.145031+0000","last_peered":"2024-05-14T14:41:06.145031+0000","last_clean":"2024-05-14T14:41:06.145031+0000","last_became_active":"2024-05-14T14:41:03.723194+0000","last_became_peered":"2024-05-14T14:41:03.723194+0000","last_unstale":"2024-05-14T14:41:06.145031+0000","last_undegraded":"2024-05-14T14:41:06.145031+0000","last_fullsized":"2024-05-14T14:41:06.145031+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:15:55.345619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.709105+0000","last_change":"2024-05-14T14:41:04.729653+0000","last_active":"2024-05-14T14:41:05.709105+0000","last_peered":"2024-05-14T14:41:05.709105+0000","last_clean":"2024-05-14T14:41:05.709105+0000","last_became_active":"2024-05-14T14:41:04.729316+0000","last_became_peered":"2024-05-14T14:41:04.729316+0000","last_unstale":"2024-05-14T14:41:05.709105+0000","last_undegraded":"2024-05-14T14:41:05.709105+0000","last_fullsized":"2024-05-14T14:41:05.709105+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:20:03.119112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.736743+0000","last_change":"2024-05-14T14:41:03.728813+0000","last_active":"2024-05-14T14:41:05.736743+0000","last_peered":"2024-05-14T14:41:05.736743+0000","last_clean":"2024-05-14T14:41:05.736743+0000","last_became_active":"2024-05-14T14:41:03.728446+0000","last_became_peered":"2024-05-14T14:41:03.728446+0000","last_unstale":"2024-05-14T14:41:05.736743+0000","last_undegraded":"2024-05-14T14:41:05.736743+0000","last_fullsized":"2024-05-14T14:41:05.736743+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:25:38.605834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.144300+0000","last_change":"2024-05-14T14:41:04.730093+0000","last_active":"2024-05-14T14:41:06.144300+0000","last_peered":"2024-05-14T14:41:06.144300+0000","last_clean":"2024-05-14T14:41:06.144300+0000","last_became_active":"2024-05-14T14:41:04.729509+0000","last_became_peered":"2024-05-14T14:41:04.729509+0000","last_unstale":"2024-05-14T14:41:06.144300+0000","last_undegraded":"2024-05-14T14:41:06.144300+0000","last_fullsized":"2024-05-14T14:41:06.144300+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:47:24.268135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"35'3","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.736770+0000","last_change":"2024-05-14T14:41:03.725010+0000","last_active":"2024-05-14T14:41:05.736770+0000","last_peered":"2024-05-14T14:41:05.736770+0000","last_clean":"2024-05-14T14:41:05.736770+0000","last_became_active":"2024-05-14T14:41:03.724614+0000","last_became_peered":"2024-05-14T14:41:03.724614+0000","last_unstale":"2024-05-14T14:41:05.736770+0000","last_undegraded":"2024-05-14T14:41:05.736770+0000","last_fullsized":"2024-05-14T14:41:05.736770+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:15:55.345619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.709983+0000","last_change":"2024-05-14T14:41:04.734751+0000","last_active":"2024-05-14T14:41:05.709983+0000","last_peered":"2024-05-14T14:41:05.709983+0000","last_clean":"2024-05-14T14:41:05.709983+0000","last_became_active":"2024-05-14T14:41:04.734434+0000","last_became_peered":"2024-05-14T14:41:04.734434+0000","last_unstale":"2024-05-14T14:41:05.709983+0000","last_undegraded":"2024-05-14T14:41:05.709983+0000","last_fullsized":"2024-05-14T14:41:05.709983+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:15:39.767392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"35'6","reported_seq":20,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.145148+0000","last_change":"2024-05-14T14:41:03.717651+0000","last_active":"2024-05-14T14:41:06.145148+0000","last_peered":"2024-05-14T14:41:06.145148+0000","last_clean":"2024-05-14T14:41:06.145148+0000","last_became_active":"2024-05-14T14:41:03.717304+0000","last_became_peered":"2024-05-14T14:41:03.717304+0000","last_unstale":"2024-05-14T14:41:06.145148+0000","last_undegraded":"2024-05-14T14:41:06.145148+0000","last_fullsized":"2024-05-14T14:41:06.145148+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:25:38.605834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.143909+0000","last_change":"2024-05-14T14:41:04.738638+0000","last_active":"2024-05-14T14:41:06.143909+0000","last_peered":"2024-05-14T14:41:06.143909+0000","last_clean":"2024-05-14T14:41:06.143909+0000","last_became_active":"2024-05-14T14:41:04.738299+0000","last_became_peered":"2024-05-14T14:41:04.738299+0000","last_unstale":"2024-05-14T14:41:06.143909+0000","last_undegraded":"2024-05-14T14:41:06.143909+0000","last_fullsized":"2024-05-14T14:41:06.143909+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:04:50.947565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.144857+0000","last_change":"2024-05-14T14:41:03.718433+0000","last_active":"2024-05-14T14:41:06.144857+0000","last_peered":"2024-05-14T14:41:06.144857+0000","last_clean":"2024-05-14T14:41:06.144857+0000","last_became_active":"2024-05-14T14:41:03.718116+0000","last_became_peered":"2024-05-14T14:41:03.718116+0000","last_unstale":"2024-05-14T14:41:06.144857+0000","last_undegraded":"2024-05-14T14:41:06.144857+0000","last_fullsized":"2024-05-14T14:41:06.144857+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:19:32.801434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.144783+0000","last_change":"2024-05-14T14:41:04.735022+0000","last_active":"2024-05-14T14:41:06.144783+0000","last_peered":"2024-05-14T14:41:06.144783+0000","last_clean":"2024-05-14T14:41:06.144783+0000","last_became_active":"2024-05-14T14:41:04.732505+0000","last_became_peered":"2024-05-14T14:41:04.732505+0000","last_unstale":"2024-05-14T14:41:06.144783+0000","last_undegraded":"2024-05-14T14:41:06.144783+0000","last_fullsized":"2024-05-14T14:41:06.144783+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:27:36.632048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.143975+0000","last_change":"2024-05-14T14:41:03.720545+0000","last_active":"2024-05-14T14:41:06.143975+0000","last_peered":"2024-05-14T14:41:06.143975+0000","last_clean":"2024-05-14T14:41:06.143975+0000","last_became_active":"2024-05-14T14:41:03.720240+0000","last_became_peered":"2024-05-14T14:41:03.720240+0000","last_unstale":"2024-05-14T14:41:06.143975+0000","last_undegraded":"2024-05-14T14:41:06.143975+0000","last_fullsized":"2024-05-14T14:41:06.143975+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:19:36.739344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.708628+0000","last_change":"2024-05-14T14:41:04.734104+0000","last_active":"2024-05-14T14:41:05.708628+0000","last_peered":"2024-05-14T14:41:05.708628+0000","last_clean":"2024-05-14T14:41:05.708628+0000","last_became_active":"2024-05-14T14:41:04.733767+0000","last_became_peered":"2024-05-14T14:41:04.733767+0000","last_unstale":"2024-05-14T14:41:05.708628+0000","last_undegraded":"2024-05-14T14:41:05.708628+0000","last_fullsized":"2024-05-14T14:41:05.708628+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:10:18.526579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.143917+0000","last_change":"2024-05-14T14:41:03.720418+0000","last_active":"2024-05-14T14:41:06.143917+0000","last_peered":"2024-05-14T14:41:06.143917+0000","last_clean":"2024-05-14T14:41:06.143917+0000","last_became_active":"2024-05-14T14:41:03.720036+0000","last_became_peered":"2024-05-14T14:41:03.720036+0000","last_unstale":"2024-05-14T14:41:06.143917+0000","last_undegraded":"2024-05-14T14:41:06.143917+0000","last_fullsized":"2024-05-14T14:41:06.143917+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:24:26.460528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.144540+0000","last_change":"2024-05-14T14:41:04.736347+0000","last_active":"2024-05-14T14:41:06.144540+0000","last_peered":"2024-05-14T14:41:06.144540+0000","last_clean":"2024-05-14T14:41:06.144540+0000","last_became_active":"2024-05-14T14:41:04.735485+0000","last_became_peered":"2024-05-14T14:41:04.735485+0000","last_unstale":"2024-05-14T14:41:06.144540+0000","last_undegraded":"2024-05-14T14:41:06.144540+0000","last_fullsized":"2024-05-14T14:41:06.144540+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:24:20.032766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"35'8","reported_seq":22,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.708249+0000","last_change":"2024-05-14T14:41:03.722530+0000","last_active":"2024-05-14T14:41:05.708249+0000","last_peered":"2024-05-14T14:41:05.708249+0000","last_clean":"2024-05-14T14:41:05.708249+0000","last_became_active":"2024-05-14T14:41:03.722183+0000","last_became_peered":"2024-05-14T14:41:03.722183+0000","last_unstale":"2024-05-14T14:41:05.708249+0000","last_undegraded":"2024-05-14T14:41:05.708249+0000","last_fullsized":"2024-05-14T14:41:05.708249+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:24:12.482756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.145165+0000","last_change":"2024-05-14T14:41:04.741650+0000","last_active":"2024-05-14T14:41:06.145165+0000","last_peered":"2024-05-14T14:41:06.145165+0000","last_clean":"2024-05-14T14:41:06.145165+0000","last_became_active":"2024-05-14T14:41:04.741314+0000","last_became_peered":"2024-05-14T14:41:04.741314+0000","last_unstale":"2024-05-14T14:41:06.145165+0000","last_undegraded":"2024-05-14T14:41:06.145165+0000","last_fullsized":"2024-05-14T14:41:06.145165+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:10:47.704183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.736775+0000","last_change":"2024-05-14T14:41:03.722508+0000","last_active":"2024-05-14T14:41:05.736775+0000","last_peered":"2024-05-14T14:41:05.736775+0000","last_clean":"2024-05-14T14:41:05.736775+0000","last_became_active":"2024-05-14T14:41:03.722177+0000","last_became_peered":"2024-05-14T14:41:03.722177+0000","last_unstale":"2024-05-14T14:41:05.736775+0000","last_undegraded":"2024-05-14T14:41:05.736775+0000","last_fullsized":"2024-05-14T14:41:05.736775+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:10:56.869516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.736665+0000","last_change":"2024-05-14T14:41:04.718320+0000","last_active":"2024-05-14T14:41:05.736665+0000","last_peered":"2024-05-14T14:41:05.736665+0000","last_clean":"2024-05-14T14:41:05.736665+0000","last_became_active":"2024-05-14T14:41:04.717824+0000","last_became_peered":"2024-05-14T14:41:04.717824+0000","last_unstale":"2024-05-14T14:41:05.736665+0000","last_undegraded":"2024-05-14T14:41:05.736665+0000","last_fullsized":"2024-05-14T14:41:05.736665+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:00:23.605945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.710132+0000","last_change":"2024-05-14T14:41:03.726623+0000","last_active":"2024-05-14T14:41:05.710132+0000","last_peered":"2024-05-14T14:41:05.710132+0000","last_clean":"2024-05-14T14:41:05.710132+0000","last_became_active":"2024-05-14T14:41:03.726240+0000","last_became_peered":"2024-05-14T14:41:03.726240+0000","last_unstale":"2024-05-14T14:41:05.710132+0000","last_undegraded":"2024-05-14T14:41:05.710132+0000","last_fullsized":"2024-05-14T14:41:05.710132+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:44:06.562919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.710006+0000","last_change":"2024-05-14T14:41:04.720169+0000","last_active":"2024-05-14T14:41:05.710006+0000","last_peered":"2024-05-14T14:41:05.710006+0000","last_clean":"2024-05-14T14:41:05.710006+0000","last_became_active":"2024-05-14T14:41:04.719796+0000","last_became_peered":"2024-05-14T14:41:04.719796+0000","last_unstale":"2024-05-14T14:41:05.710006+0000","last_undegraded":"2024-05-14T14:41:05.710006+0000","last_fullsized":"2024-05-14T14:41:05.710006+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:04:50.947565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"35'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.707218+0000","last_change":"2024-05-14T14:41:03.723637+0000","last_active":"2024-05-14T14:41:05.707218+0000","last_peered":"2024-05-14T14:41:05.707218+0000","last_clean":"2024-05-14T14:41:05.707218+0000","last_became_active":"2024-05-14T14:41:03.723309+0000","last_became_peered":"2024-05-14T14:41:03.723309+0000","last_unstale":"2024-05-14T14:41:05.707218+0000","last_undegraded":"2024-05-14T14:41:05.707218+0000","last_fullsized":"2024-05-14T14:41:05.707218+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:06:52.306462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.707448+0000","last_change":"2024-05-14T14:41:04.738459+0000","last_active":"2024-05-14T14:41:05.707448+0000","last_peered":"2024-05-14T14:41:05.707448+0000","last_clean":"2024-05-14T14:41:05.707448+0000","last_became_active":"2024-05-14T14:41:04.738149+0000","last_became_peered":"2024-05-14T14:41:04.738149+0000","last_unstale":"2024-05-14T14:41:05.707448+0000","last_undegraded":"2024-05-14T14:41:05.707448+0000","last_fullsized":"2024-05-14T14:41:05.707448+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:03:31.903038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.144457+0000","last_change":"2024-05-14T14:41:03.718155+0000","last_active":"2024-05-14T14:41:06.144457+0000","last_peered":"2024-05-14T14:41:06.144457+0000","last_clean":"2024-05-14T14:41:06.144457+0000","last_became_active":"2024-05-14T14:41:03.717826+0000","last_became_peered":"2024-05-14T14:41:03.717826+0000","last_unstale":"2024-05-14T14:41:06.144457+0000","last_undegraded":"2024-05-14T14:41:06.144457+0000","last_fullsized":"2024-05-14T14:41:06.144457+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:06:43.226500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.709240+0000","last_change":"2024-05-14T14:41:04.737525+0000","last_active":"2024-05-14T14:41:05.709240+0000","last_peered":"2024-05-14T14:41:05.709240+0000","last_clean":"2024-05-14T14:41:05.709240+0000","last_became_active":"2024-05-14T14:41:04.737127+0000","last_became_peered":"2024-05-14T14:41:04.737127+0000","last_unstale":"2024-05-14T14:41:05.709240+0000","last_undegraded":"2024-05-14T14:41:05.709240+0000","last_fullsized":"2024-05-14T14:41:05.709240+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:24:20.032766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.707136+0000","last_change":"2024-05-14T14:41:03.719237+0000","last_active":"2024-05-14T14:41:05.707136+0000","last_peered":"2024-05-14T14:41:05.707136+0000","last_clean":"2024-05-14T14:41:05.707136+0000","last_became_active":"2024-05-14T14:41:03.718944+0000","last_became_peered":"2024-05-14T14:41:03.718944+0000","last_unstale":"2024-05-14T14:41:05.707136+0000","last_undegraded":"2024-05-14T14:41:05.707136+0000","last_fullsized":"2024-05-14T14:41:05.707136+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:20:14.005071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.143778+0000","last_change":"2024-05-14T14:41:04.729843+0000","last_active":"2024-05-14T14:41:06.143778+0000","last_peered":"2024-05-14T14:41:06.143778+0000","last_clean":"2024-05-14T14:41:06.143778+0000","last_became_active":"2024-05-14T14:41:04.729551+0000","last_became_peered":"2024-05-14T14:41:04.729551+0000","last_unstale":"2024-05-14T14:41:06.143778+0000","last_undegraded":"2024-05-14T14:41:06.143778+0000","last_fullsized":"2024-05-14T14:41:06.143778+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:15:39.767392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.707050+0000","last_change":"2024-05-14T14:41:03.718362+0000","last_active":"2024-05-14T14:41:05.707050+0000","last_peered":"2024-05-14T14:41:05.707050+0000","last_clean":"2024-05-14T14:41:05.707050+0000","last_became_active":"2024-05-14T14:41:03.718041+0000","last_became_peered":"2024-05-14T14:41:03.718041+0000","last_unstale":"2024-05-14T14:41:05.707050+0000","last_undegraded":"2024-05-14T14:41:05.707050+0000","last_fullsized":"2024-05-14T14:41:05.707050+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:10:17.740347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.736136+0000","last_change":"2024-05-14T14:41:04.723468+0000","last_active":"2024-05-14T14:41:05.736136+0000","last_peered":"2024-05-14T14:41:05.736136+0000","last_clean":"2024-05-14T14:41:05.736136+0000","last_became_active":"2024-05-14T14:41:04.723159+0000","last_became_peered":"2024-05-14T14:41:04.723159+0000","last_unstale":"2024-05-14T14:41:05.736136+0000","last_undegraded":"2024-05-14T14:41:05.736136+0000","last_fullsized":"2024-05-14T14:41:05.736136+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:20:03.119112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.708737+0000","last_change":"2024-05-14T14:41:03.722600+0000","last_active":"2024-05-14T14:41:05.708737+0000","last_peered":"2024-05-14T14:41:05.708737+0000","last_clean":"2024-05-14T14:41:05.708737+0000","last_became_active":"2024-05-14T14:41:03.722240+0000","last_became_peered":"2024-05-14T14:41:03.722240+0000","last_unstale":"2024-05-14T14:41:05.708737+0000","last_undegraded":"2024-05-14T14:41:05.708737+0000","last_fullsized":"2024-05-14T14:41:05.708737+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:22:37.008198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.144742+0000","last_change":"2024-05-14T14:41:04.730499+0000","last_active":"2024-05-14T14:41:06.144742+0000","last_peered":"2024-05-14T14:41:06.144742+0000","last_clean":"2024-05-14T14:41:06.144742+0000","last_became_active":"2024-05-14T14:41:04.729793+0000","last_became_peered":"2024-05-14T14:41:04.729793+0000","last_unstale":"2024-05-14T14:41:06.144742+0000","last_undegraded":"2024-05-14T14:41:06.144742+0000","last_fullsized":"2024-05-14T14:41:06.144742+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:20:03.119112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.706881+0000","last_change":"2024-05-14T14:41:03.719224+0000","last_active":"2024-05-14T14:41:05.706881+0000","last_peered":"2024-05-14T14:41:05.706881+0000","last_clean":"2024-05-14T14:41:05.706881+0000","last_became_active":"2024-05-14T14:41:03.718916+0000","last_became_peered":"2024-05-14T14:41:03.718916+0000","last_unstale":"2024-05-14T14:41:05.706881+0000","last_undegraded":"2024-05-14T14:41:05.706881+0000","last_fullsized":"2024-05-14T14:41:05.706881+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:37:25.220210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.144346+0000","last_change":"2024-05-14T14:41:04.719892+0000","last_active":"2024-05-14T14:41:06.144346+0000","last_peered":"2024-05-14T14:41:06.144346+0000","last_clean":"2024-05-14T14:41:06.144346+0000","last_became_active":"2024-05-14T14:41:04.719326+0000","last_became_peered":"2024-05-14T14:41:04.719326+0000","last_unstale":"2024-05-14T14:41:06.144346+0000","last_undegraded":"2024-05-14T14:41:06.144346+0000","last_fullsized":"2024-05-14T14:41:06.144346+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:47:24.268135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"35'2","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.736874+0000","last_change":"2024-05-14T14:41:03.723786+0000","last_active":"2024-05-14T14:41:05.736874+0000","last_peered":"2024-05-14T14:41:05.736874+0000","last_clean":"2024-05-14T14:41:05.736874+0000","last_became_active":"2024-05-14T14:41:03.723431+0000","last_became_peered":"2024-05-14T14:41:03.723431+0000","last_unstale":"2024-05-14T14:41:05.736874+0000","last_undegraded":"2024-05-14T14:41:05.736874+0000","last_fullsized":"2024-05-14T14:41:05.736874+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:46:23.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.709135+0000","last_change":"2024-05-14T14:41:04.729634+0000","last_active":"2024-05-14T14:41:05.709135+0000","last_peered":"2024-05-14T14:41:05.709135+0000","last_clean":"2024-05-14T14:41:05.709135+0000","last_became_active":"2024-05-14T14:41:04.729274+0000","last_became_peered":"2024-05-14T14:41:04.729274+0000","last_unstale":"2024-05-14T14:41:05.709135+0000","last_undegraded":"2024-05-14T14:41:05.709135+0000","last_fullsized":"2024-05-14T14:41:05.709135+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:05:08.417720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"36'1","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.707305+0000","last_change":"2024-05-14T14:41:03.724813+0000","last_active":"2024-05-14T14:41:05.707305+0000","last_peered":"2024-05-14T14:41:05.707305+0000","last_clean":"2024-05-14T14:41:05.707305+0000","last_became_active":"2024-05-14T14:41:03.724505+0000","last_became_peered":"2024-05-14T14:41:03.724505+0000","last_unstale":"2024-05-14T14:41:05.707305+0000","last_undegraded":"2024-05-14T14:41:05.707305+0000","last_fullsized":"2024-05-14T14:41:05.707305+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:12:47.176768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.145079+0000","last_change":"2024-05-14T14:41:04.734830+0000","last_active":"2024-05-14T14:41:06.145079+0000","last_peered":"2024-05-14T14:41:06.145079+0000","last_clean":"2024-05-14T14:41:06.145079+0000","last_became_active":"2024-05-14T14:41:04.733018+0000","last_became_peered":"2024-05-14T14:41:04.733018+0000","last_unstale":"2024-05-14T14:41:06.145079+0000","last_undegraded":"2024-05-14T14:41:06.145079+0000","last_fullsized":"2024-05-14T14:41:06.145079+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:34:43.055490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.144075+0000","last_change":"2024-05-14T14:41:03.724743+0000","last_active":"2024-05-14T14:41:06.144075+0000","last_peered":"2024-05-14T14:41:06.144075+0000","last_clean":"2024-05-14T14:41:06.144075+0000","last_became_active":"2024-05-14T14:41:03.724406+0000","last_became_peered":"2024-05-14T14:41:03.724406+0000","last_unstale":"2024-05-14T14:41:06.144075+0000","last_undegraded":"2024-05-14T14:41:06.144075+0000","last_fullsized":"2024-05-14T14:41:06.144075+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:48:09.099466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.144085+0000","last_change":"2024-05-14T14:41:04.730875+0000","last_active":"2024-05-14T14:41:06.144085+0000","last_peered":"2024-05-14T14:41:06.144085+0000","last_clean":"2024-05-14T14:41:06.144085+0000","last_became_active":"2024-05-14T14:41:04.730190+0000","last_became_peered":"2024-05-14T14:41:04.730190+0000","last_unstale":"2024-05-14T14:41:06.144085+0000","last_undegraded":"2024-05-14T14:41:06.144085+0000","last_fullsized":"2024-05-14T14:41:06.144085+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T14:41:45.988742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.144107+0000","last_change":"2024-05-14T14:41:03.724699+0000","last_active":"2024-05-14T14:41:06.144107+0000","last_peered":"2024-05-14T14:41:06.144107+0000","last_clean":"2024-05-14T14:41:06.144107+0000","last_became_active":"2024-05-14T14:41:03.724321+0000","last_became_peered":"2024-05-14T14:41:03.724321+0000","last_unstale":"2024-05-14T14:41:06.144107+0000","last_undegraded":"2024-05-14T14:41:06.144107+0000","last_fullsized":"2024-05-14T14:41:06.144107+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:19:36.739344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.143783+0000","last_change":"2024-05-14T14:41:04.723639+0000","last_active":"2024-05-14T14:41:06.143783+0000","last_peered":"2024-05-14T14:41:06.143783+0000","last_clean":"2024-05-14T14:41:06.143783+0000","last_became_active":"2024-05-14T14:41:04.723269+0000","last_became_peered":"2024-05-14T14:41:04.723269+0000","last_unstale":"2024-05-14T14:41:06.143783+0000","last_undegraded":"2024-05-14T14:41:06.143783+0000","last_fullsized":"2024-05-14T14:41:06.143783+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:15:39.767392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.144003+0000","last_change":"2024-05-14T14:41:03.719362+0000","last_active":"2024-05-14T14:41:06.144003+0000","last_peered":"2024-05-14T14:41:06.144003+0000","last_clean":"2024-05-14T14:41:06.144003+0000","last_became_active":"2024-05-14T14:41:03.719038+0000","last_became_peered":"2024-05-14T14:41:03.719038+0000","last_unstale":"2024-05-14T14:41:06.144003+0000","last_undegraded":"2024-05-14T14:41:06.144003+0000","last_fullsized":"2024-05-14T14:41:06.144003+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:48:09.099466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.709534+0000","last_change":"2024-05-14T14:41:04.731185+0000","last_active":"2024-05-14T14:41:05.709534+0000","last_peered":"2024-05-14T14:41:05.709534+0000","last_clean":"2024-05-14T14:41:05.709534+0000","last_became_active":"2024-05-14T14:41:04.730647+0000","last_became_peered":"2024-05-14T14:41:04.730647+0000","last_unstale":"2024-05-14T14:41:05.709534+0000","last_undegraded":"2024-05-14T14:41:05.709534+0000","last_fullsized":"2024-05-14T14:41:05.709534+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:25:39.618519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.709222+0000","last_change":"2024-05-14T14:41:03.726792+0000","last_active":"2024-05-14T14:41:05.709222+0000","last_peered":"2024-05-14T14:41:05.709222+0000","last_clean":"2024-05-14T14:41:05.709222+0000","last_became_active":"2024-05-14T14:41:03.726248+0000","last_became_peered":"2024-05-14T14:41:03.726248+0000","last_unstale":"2024-05-14T14:41:05.709222+0000","last_undegraded":"2024-05-14T14:41:05.709222+0000","last_fullsized":"2024-05-14T14:41:05.709222+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:35:33.172311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.708952+0000","last_change":"2024-05-14T14:41:04.730545+0000","last_active":"2024-05-14T14:41:05.708952+0000","last_peered":"2024-05-14T14:41:05.708952+0000","last_clean":"2024-05-14T14:41:05.708952+0000","last_became_active":"2024-05-14T14:41:04.730224+0000","last_became_peered":"2024-05-14T14:41:04.730224+0000","last_unstale":"2024-05-14T14:41:05.708952+0000","last_undegraded":"2024-05-14T14:41:05.708952+0000","last_fullsized":"2024-05-14T14:41:05.708952+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:02:17.484376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:06.144439+0000","last_change":"2024-05-14T14:41:03.723567+0000","last_active":"2024-05-14T14:41:06.144439+0000","last_peered":"2024-05-14T14:41:06.144439+0000","last_clean":"2024-05-14T14:41:06.144439+0000","last_became_active":"2024-05-14T14:41:03.723265+0000","last_became_peered":"2024-05-14T14:41:03.723265+0000","last_unstale":"2024-05-14T14:41:06.144439+0000","last_undegraded":"2024-05-14T14:41:06.144439+0000","last_fullsized":"2024-05-14T14:41:06.144439+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:46:23.690404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.736669+0000","last_change":"2024-05-14T14:41:04.739711+0000","last_active":"2024-05-14T14:41:05.736669+0000","last_peered":"2024-05-14T14:41:05.736669+0000","last_clean":"2024-05-14T14:41:05.736669+0000","last_became_active":"2024-05-14T14:41:04.735382+0000","last_became_peered":"2024-05-14T14:41:04.735382+0000","last_unstale":"2024-05-14T14:41:05.736669+0000","last_undegraded":"2024-05-14T14:41:05.736669+0000","last_fullsized":"2024-05-14T14:41:05.736669+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:03.688710+0000","last_clean_scrub_stamp":"2024-05-14T14:41:03.688710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:53:07.678698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.708617+0000","last_change":"2024-05-14T14:41:03.718095+0000","last_active":"2024-05-14T14:41:05.708617+0000","last_peered":"2024-05-14T14:41:05.708617+0000","last_clean":"2024-05-14T14:41:05.708617+0000","last_became_active":"2024-05-14T14:41:03.717721+0000","last_became_peered":"2024-05-14T14:41:03.717721+0000","last_unstale":"2024-05-14T14:41:05.708617+0000","last_undegraded":"2024-05-14T14:41:05.708617+0000","last_fullsized":"2024-05-14T14:41:05.708617+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:41:02.676025+0000","last_clean_scrub_stamp":"2024-05-14T14:41:02.676025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:58:49.925408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":138,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-05-14T14:41:05.708488+0000","last_change":"2024-05-14T14:40:06.302050+0000","last_active":"2024-05-14T14:41:05.708488+0000","last_peered":"2024-05-14T14:41:05.708488+0000","last_clean":"2024-05-14T14:41:05.708488+0000","last_became_active":"2024-05-14T14:40:06.300956+0000","last_became_peered":"2024-05-14T14:40:06.300956+0000","last_unstale":"2024-05-14T14:41:05.708488+0000","last_undegraded":"2024-05-14T14:41:05.708488+0000","last_fullsized":"2024-05-14T14:41:05.708488+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T14:40:04.850996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T14:40:04.850996+0000","last_clean_scrub_stamp":"2024-05-14T14:40:04.850996+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:08:41.028114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1024000,"data_stored":767361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":175893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":175423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":175915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31600,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":430080,"data_stored":176957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":175381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31588,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340252,"statfs":{"total":96636764160,"available":96604418048,"internally_reserved":0,"allocated":417792,"data_stored":175401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32168,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339672,"statfs":{"total":96636764160,"available":96603824128,"internally_reserved":0,"allocated":1011712,"data_stored":765713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T14:41:13.711 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-14T14:41:13.711 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-05-14T14:41:13.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.885+0000 7efc6bfc0640 1 Processor -- start 2024-05-14T14:41:13.868 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.885+0000 7efc6bfc0640 1 -- start start 2024-05-14T14:41:13.870 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.886+0000 7efc6bfc0640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7efc640cf8c0 0x7efc640cfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:13.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.886+0000 7efc6bfc0640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc640ce0e0 0x7efc640cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:13.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.886+0000 7efc6bfc0640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc64165070 con 0x7efc640d0460 2024-05-14T14:41:13.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.886+0000 7efc6bfc0640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7efc640b68e0 con 0x7efc640cf8c0 2024-05-14T14:41:13.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.886+0000 7efc6bfc0640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7efc640b8630 con 0x7efc640ce0e0 2024-05-14T14:41:13.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.886+0000 7efc69d5c640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7efc640cf8c0 0x7efc640cfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:13.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.886+0000 7efc69d5c640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7efc640cf8c0 0x7efc640cfd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41398/0 (socket says 172.21.15.39:41398) 2024-05-14T14:41:13.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.887+0000 7efc69d5c640 1 -- 172.21.15.39:0/2648565336 learned_addr learned my addr 172.21.15.39:0/2648565336 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:41:13.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.887+0000 7efc6955b640 1 --2- 172.21.15.39:0/2648565336 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc640ce0e0 0x7efc640cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:13.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.887+0000 7efc69d5c640 1 -- 172.21.15.39:0/2648565336 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc640ce0e0 msgr2=0x7efc640cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:13.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.887+0000 7efc69d5c640 1 --2- 172.21.15.39:0/2648565336 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc640ce0e0 0x7efc640cefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:13.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.887+0000 7efc69d5c640 1 -- 172.21.15.39:0/2648565336 >> v1:172.21.15.62:6789/0 conn(0x7efc640d0460 legacy=0x7efc640d0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:13.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.887+0000 7efc68d5a640 1 -- 172.21.15.39:0/2648565336 <== mon.1 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1579876505 0 0) 0x7efc64165070 con 0x7efc640d0460 2024-05-14T14:41:13.871 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.887+0000 7efc69d5c640 1 -- 172.21.15.39:0/2648565336 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc640b6b30 con 0x7efc640cf8c0 2024-05-14T14:41:13.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.888+0000 7efc69d5c640 1 --2- 172.21.15.39:0/2648565336 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc640cf8c0 0x7efc640cfd60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7efc60009870 tx=0x7efc6002a1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fbe36daa30f6586 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:13.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.888+0000 7efc68d5a640 1 -- 172.21.15.39:0/2648565336 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc60037070 con 0x7efc640cf8c0 2024-05-14T14:41:13.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.888+0000 7efc68d5a640 1 -- 172.21.15.39:0/2648565336 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc60032440 con 0x7efc640cf8c0 2024-05-14T14:41:13.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.888+0000 7efc68d5a640 1 -- 172.21.15.39:0/2648565336 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc60032810 con 0x7efc640cf8c0 2024-05-14T14:41:13.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.888+0000 7efc6bfc0640 1 -- 172.21.15.39:0/2648565336 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc640cf8c0 msgr2=0x7efc640cfd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:13.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.888+0000 7efc6bfc0640 1 --2- 172.21.15.39:0/2648565336 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc640cf8c0 0x7efc640cfd60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7efc60009870 tx=0x7efc6002a1b0 comp rx=0 tx=0).stop 2024-05-14T14:41:13.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.888+0000 7efc6bfc0640 1 -- 172.21.15.39:0/2648565336 shutdown_connections 2024-05-14T14:41:13.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.889+0000 7efc6bfc0640 1 --2- 172.21.15.39:0/2648565336 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc640ce0e0 0x7efc640cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:13.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.889+0000 7efc6bfc0640 1 --2- 172.21.15.39:0/2648565336 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc640cf8c0 0x7efc640cfd60 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:13.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.889+0000 7efc6bfc0640 1 -- 172.21.15.39:0/2648565336 >> 172.21.15.39:0/2648565336 conn(0x7efc640b5780 msgr2=0x7efc640b5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:13.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.889+0000 7efc6bfc0640 1 -- 172.21.15.39:0/2648565336 shutdown_connections 2024-05-14T14:41:13.873 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.889+0000 7efc6bfc0640 1 -- 172.21.15.39:0/2648565336 wait complete. 2024-05-14T14:41:13.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.890+0000 7efc6bfc0640 1 Processor -- start 2024-05-14T14:41:13.874 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.890+0000 7efc6bfc0640 1 -- start start 2024-05-14T14:41:13.876 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.892+0000 7efc6bfc0640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc640ce0e0 0x7efc640c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:13.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.892+0000 7efc6bfc0640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc640cf8c0 0x7efc640c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:13.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.892+0000 7efc6bfc0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc640d0460 0x7efc6406eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:13.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.892+0000 7efc6bfc0640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7efc640b6f90 con 0x7efc640cf8c0 2024-05-14T14:41:13.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.892+0000 7efc6bfc0640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7efc640b6e10 con 0x7efc640d0460 2024-05-14T14:41:13.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.892+0000 7efc6bfc0640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7efc640b8ac0 con 0x7efc640ce0e0 2024-05-14T14:41:13.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.892+0000 7efc6955b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc640cf8c0 0x7efc640c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:13.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.892+0000 7efc6955b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc640cf8c0 0x7efc640c8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41408/0 (socket says 172.21.15.39:41408) 2024-05-14T14:41:13.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.892+0000 7efc6955b640 1 -- 172.21.15.39:0/1613228150 learned_addr learned my addr 172.21.15.39:0/1613228150 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:41:13.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.892+0000 7efc69d5c640 1 --2- 172.21.15.39:0/1613228150 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc640ce0e0 0x7efc640c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:13.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.892+0000 7efc6a55d640 1 --2- 172.21.15.39:0/1613228150 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc640d0460 0x7efc6406eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:13.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.892+0000 7efc6955b640 1 -- 172.21.15.39:0/1613228150 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc640ce0e0 msgr2=0x7efc640c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:13.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.892+0000 7efc6955b640 1 --2- 172.21.15.39:0/1613228150 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc640ce0e0 0x7efc640c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:13.877 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.892+0000 7efc6955b640 1 -- 172.21.15.39:0/1613228150 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc640d0460 msgr2=0x7efc6406eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:13.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.892+0000 7efc6955b640 1 --2- 172.21.15.39:0/1613228150 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc640d0460 0x7efc6406eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:13.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.892+0000 7efc6955b640 1 -- 172.21.15.39:0/1613228150 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc641eb770 con 0x7efc640cf8c0 2024-05-14T14:41:13.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.892+0000 7efc6955b640 1 --2- 172.21.15.39:0/1613228150 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc640cf8c0 0x7efc640c8940 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7efc5800e840 tx=0x7efc5800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:13.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.892+0000 7efc567fc640 1 -- 172.21.15.39:0/1613228150 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc58017070 con 0x7efc640cf8c0 2024-05-14T14:41:13.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.893+0000 7efc567fc640 1 -- 172.21.15.39:0/1613228150 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc5800c940 con 0x7efc640cf8c0 2024-05-14T14:41:13.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.893+0000 7efc567fc640 1 -- 172.21.15.39:0/1613228150 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc5800cd10 con 0x7efc640cf8c0 2024-05-14T14:41:13.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.893+0000 7efc6bfc0640 1 -- 172.21.15.39:0/1613228150 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc6406e0e0 con 0x7efc640cf8c0 2024-05-14T14:41:13.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.893+0000 7efc6bfc0640 1 -- 172.21.15.39:0/1613228150 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc6406e6a0 con 0x7efc640cf8c0 2024-05-14T14:41:13.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.894+0000 7efc6bfc0640 1 -- 172.21.15.39:0/1613228150 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc64076aa0 con 0x7efc640cf8c0 2024-05-14T14:41:13.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.894+0000 7efc567fc640 1 -- 172.21.15.39:0/1613228150 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7efc5801a070 con 0x7efc640cf8c0 2024-05-14T14:41:13.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.895+0000 7efc567fc640 1 --2- 172.21.15.39:0/1613228150 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7efc48076300 0x7efc48078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:13.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.895+0000 7efc69d5c640 1 --2- 172.21.15.39:0/1613228150 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7efc48076300 0x7efc48078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:13.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.895+0000 7efc567fc640 1 -- 172.21.15.39:0/1613228150 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7efc58097a10 con 0x7efc640cf8c0 2024-05-14T14:41:13.879 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.896+0000 7efc69d5c640 1 --2- 172.21.15.39:0/1613228150 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7efc48076300 0x7efc48078810 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efc60034000 tx=0x7efc6002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:13.883 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:13.900+0000 7efc567fc640 1 -- 172.21.15.39:0/1613228150 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7efc58060b00 con 0x7efc640cf8c0 2024-05-14T14:41:14.147 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.164+0000 7efc6bfc0640 1 -- 172.21.15.39:0/1613228150 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7efc640d3330 con 0x7efc640cf8c0 2024-05-14T14:41:14.150 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.167+0000 7efc567fc640 1 -- 172.21.15.39:0/1613228150 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) ==== 190+0+147 (secure 0 0 0) 0x7efc580691d0 con 0x7efc640cf8c0 2024-05-14T14:41:14.151 INFO:teuthology.orchestra.run.smithi039.stdout:[client.0] 2024-05-14T14:41:14.151 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQCTd0NmL7k5EhAAA1EBx0QBmemnkBYg0scBMA== 2024-05-14T14:41:14.151 INFO:teuthology.orchestra.run.smithi039.stdout: caps mds = "allow" 2024-05-14T14:41:14.151 INFO:teuthology.orchestra.run.smithi039.stdout: caps mon = "allow r" 2024-05-14T14:41:14.151 INFO:teuthology.orchestra.run.smithi039.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-05-14T14:41:14.151 INFO:teuthology.orchestra.run.smithi039.stderr:updated caps for client.0 2024-05-14T14:41:14.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.169+0000 7efc6bfc0640 1 -- 172.21.15.39:0/1613228150 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7efc48076300 msgr2=0x7efc48078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:14.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.169+0000 7efc6bfc0640 1 --2- 172.21.15.39:0/1613228150 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7efc48076300 0x7efc48078810 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efc60034000 tx=0x7efc6002e000 comp rx=0 tx=0).stop 2024-05-14T14:41:14.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.169+0000 7efc6bfc0640 1 -- 172.21.15.39:0/1613228150 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc640cf8c0 msgr2=0x7efc640c8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:14.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.169+0000 7efc6bfc0640 1 --2- 172.21.15.39:0/1613228150 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc640cf8c0 0x7efc640c8940 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7efc5800e840 tx=0x7efc5800ed00 comp rx=0 tx=0).stop 2024-05-14T14:41:14.153 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.169+0000 7efc6bfc0640 1 -- 172.21.15.39:0/1613228150 shutdown_connections 2024-05-14T14:41:14.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.169+0000 7efc6bfc0640 1 --2- 172.21.15.39:0/1613228150 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7efc48076300 0x7efc48078810 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:14.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.169+0000 7efc6bfc0640 1 --2- 172.21.15.39:0/1613228150 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc640d0460 0x7efc6406eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:14.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.169+0000 7efc6bfc0640 1 --2- 172.21.15.39:0/1613228150 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7efc640cf8c0 0x7efc640c8940 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:14.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.169+0000 7efc6bfc0640 1 --2- 172.21.15.39:0/1613228150 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7efc640ce0e0 0x7efc640c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:14.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.169+0000 7efc6bfc0640 1 -- 172.21.15.39:0/1613228150 >> 172.21.15.39:0/1613228150 conn(0x7efc640b5780 msgr2=0x7efc640cab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:14.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.169+0000 7efc6bfc0640 1 -- 172.21.15.39:0/1613228150 shutdown_connections 2024-05-14T14:41:14.154 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.169+0000 7efc6bfc0640 1 -- 172.21.15.39:0/1613228150 wait complete. 2024-05-14T14:41:14.164 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-14T14:41:14.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.295+0000 7f429e7cf640 1 Processor -- start 2024-05-14T14:41:14.279 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.295+0000 7f429e7cf640 1 -- start start 2024-05-14T14:41:14.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.297+0000 7f429e7cf640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4298160420 0x7f42980d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:14.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.297+0000 7f429e7cf640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f42980d1140 0x7f429806d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:14.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.297+0000 7f429e7cf640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42980b9310 con 0x7f429806d5f0 2024-05-14T14:41:14.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.297+0000 7f429e7cf640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f42980d1550 con 0x7f4298160420 2024-05-14T14:41:14.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.297+0000 7f429e7cf640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f429806dd70 con 0x7f42980d1140 2024-05-14T14:41:14.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.297+0000 7f4297fff640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f4298160420 0x7f42980d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:14.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.297+0000 7f429cd6c640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f429806d5f0 0x7f42980d49e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:36534/0 (socket says 172.21.15.39:36534) 2024-05-14T14:41:14.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.297+0000 7f429cd6c640 1 -- 172.21.15.39:0/1927358308 learned_addr learned my addr 172.21.15.39:0/1927358308 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:41:14.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.297+0000 7f42977fe640 1 --2- 172.21.15.39:0/1927358308 >> v2:172.21.15.62:3300/0 conn(0x7f42980d1140 0x7f429806d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:14.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.297+0000 7f4296ffd640 1 -- 172.21.15.39:0/1927358308 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3753249584 0 0) 0x7f4290001490 con 0x7f429806d5f0 2024-05-14T14:41:14.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.297+0000 7f4296ffd640 1 -- 172.21.15.39:0/1927358308 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4280003520 con 0x7f429806d5f0 2024-05-14T14:41:14.282 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.297+0000 7f4297fff640 1 -- 172.21.15.39:0/1927358308 >> v2:172.21.15.62:3300/0 conn(0x7f42980d1140 msgr2=0x7f429806d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:14.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.297+0000 7f4297fff640 1 --2- 172.21.15.39:0/1927358308 >> v2:172.21.15.62:3300/0 conn(0x7f42980d1140 0x7f429806d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:14.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.297+0000 7f4297fff640 1 -- 172.21.15.39:0/1927358308 >> v1:172.21.15.39:6789/0 conn(0x7f429806d5f0 legacy=0x7f42980d49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:14.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.297+0000 7f4297fff640 1 -- 172.21.15.39:0/1927358308 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42980b9590 con 0x7f4298160420 2024-05-14T14:41:14.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.298+0000 7f4297fff640 1 --2- 172.21.15.39:0/1927358308 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4298160420 0x7f42980d0c00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f42980d37c0 tx=0x7f428802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a9d8eb8d1955006 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:14.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.298+0000 7f4296ffd640 1 -- 172.21.15.39:0/1927358308 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4288037070 con 0x7f4298160420 2024-05-14T14:41:14.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.298+0000 7f4296ffd640 1 -- 172.21.15.39:0/1927358308 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4288032440 con 0x7f4298160420 2024-05-14T14:41:14.283 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.298+0000 7f4296ffd640 1 -- 172.21.15.39:0/1927358308 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f428802ae60 con 0x7f4298160420 2024-05-14T14:41:14.289 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.299+0000 7f429e7cf640 1 -- 172.21.15.39:0/1927358308 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4298160420 msgr2=0x7f42980d0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:14.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.299+0000 7f429e7cf640 1 --2- 172.21.15.39:0/1927358308 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4298160420 0x7f42980d0c00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f42980d37c0 tx=0x7f428802a110 comp rx=0 tx=0).stop 2024-05-14T14:41:14.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.299+0000 7f429e7cf640 1 -- 172.21.15.39:0/1927358308 shutdown_connections 2024-05-14T14:41:14.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.299+0000 7f429e7cf640 1 --2- 172.21.15.39:0/1927358308 >> v2:172.21.15.62:3300/0 conn(0x7f42980d1140 0x7f429806d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:14.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.299+0000 7f429e7cf640 1 --2- 172.21.15.39:0/1927358308 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f4298160420 0x7f42980d0c00 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:14.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.299+0000 7f429e7cf640 1 -- 172.21.15.39:0/1927358308 >> 172.21.15.39:0/1927358308 conn(0x7f42980d27d0 msgr2=0x7f42980d2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:14.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.299+0000 7f429e7cf640 1 -- 172.21.15.39:0/1927358308 shutdown_connections 2024-05-14T14:41:14.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.299+0000 7f429e7cf640 1 -- 172.21.15.39:0/1927358308 wait complete. 2024-05-14T14:41:14.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.301+0000 7f429e7cf640 1 Processor -- start 2024-05-14T14:41:14.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.301+0000 7f429e7cf640 1 -- start start 2024-05-14T14:41:14.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.302+0000 7f429e7cf640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f429806d5f0 0x7f42980c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:14.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.302+0000 7f429e7cf640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f42980d1140 0x7f42980cce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:14.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.302+0000 7f429e7cf640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4298160420 0x7f42980cd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:14.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.302+0000 7f429e7cf640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f4298160830 con 0x7f429806d5f0 2024-05-14T14:41:14.290 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.302+0000 7f429e7cf640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f42980b9b50 con 0x7f4298160420 2024-05-14T14:41:14.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.302+0000 7f429e7cf640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f429806da00 con 0x7f42980d1140 2024-05-14T14:41:14.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.302+0000 7f4297fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f429806d5f0 0x7f42980c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:14.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.302+0000 7f4297fff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f429806d5f0 0x7f42980c8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41432/0 (socket says 172.21.15.39:41432) 2024-05-14T14:41:14.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.302+0000 7f4297fff640 1 -- 172.21.15.39:0/2557692317 learned_addr learned my addr 172.21.15.39:0/2557692317 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:41:14.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.303+0000 7f429cd6c640 1 --2- 172.21.15.39:0/2557692317 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4298160420 0x7f42980cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:14.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.303+0000 7f42977fe640 1 --2- 172.21.15.39:0/2557692317 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f42980d1140 0x7f42980cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:14.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.303+0000 7f4297fff640 1 -- 172.21.15.39:0/2557692317 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f42980d1140 msgr2=0x7f42980cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:14.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.303+0000 7f4297fff640 1 --2- 172.21.15.39:0/2557692317 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f42980d1140 0x7f42980cce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:14.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.303+0000 7f4297fff640 1 -- 172.21.15.39:0/2557692317 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4298160420 msgr2=0x7f42980cd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:14.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.303+0000 7f4297fff640 1 --2- 172.21.15.39:0/2557692317 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4298160420 0x7f42980cd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:14.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.303+0000 7f4297fff640 1 -- 172.21.15.39:0/2557692317 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42980cdb50 con 0x7f429806d5f0 2024-05-14T14:41:14.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.303+0000 7f42977fe640 1 --2- 172.21.15.39:0/2557692317 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f42980d1140 0x7f42980cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:41:14.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.303+0000 7f4297fff640 1 --2- 172.21.15.39:0/2557692317 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f429806d5f0 0x7f42980c8b40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4288000c00 tx=0x7f42880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:14.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.303+0000 7f4294ff9640 1 -- 172.21.15.39:0/2557692317 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4288041020 con 0x7f429806d5f0 2024-05-14T14:41:14.291 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.303+0000 7f4294ff9640 1 -- 172.21.15.39:0/2557692317 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f428803d700 con 0x7f429806d5f0 2024-05-14T14:41:14.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.303+0000 7f429e7cf640 1 -- 172.21.15.39:0/2557692317 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42980cde30 con 0x7f429806d5f0 2024-05-14T14:41:14.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.303+0000 7f4294ff9640 1 -- 172.21.15.39:0/2557692317 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4288037040 con 0x7f429806d5f0 2024-05-14T14:41:14.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.303+0000 7f429e7cf640 1 -- 172.21.15.39:0/2557692317 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42980ce3f0 con 0x7f429806d5f0 2024-05-14T14:41:14.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.304+0000 7f429e7cf640 1 -- 172.21.15.39:0/2557692317 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4298076aa0 con 0x7f429806d5f0 2024-05-14T14:41:14.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.305+0000 7f4294ff9640 1 -- 172.21.15.39:0/2557692317 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f4288044020 con 0x7f429806d5f0 2024-05-14T14:41:14.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.305+0000 7f4294ff9640 1 --2- 172.21.15.39:0/2557692317 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4284076300 0x7f4284078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:14.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.306+0000 7f4294ff9640 1 -- 172.21.15.39:0/2557692317 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7f42880b7f60 con 0x7f429806d5f0 2024-05-14T14:41:14.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.306+0000 7f42977fe640 1 --2- 172.21.15.39:0/2557692317 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4284076300 0x7f4284078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:14.292 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.306+0000 7f42977fe640 1 --2- 172.21.15.39:0/2557692317 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4284076300 0x7f4284078810 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f42980caef0 tx=0x7f428c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:14.293 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.310+0000 7f4294ff9640 1 -- 172.21.15.39:0/2557692317 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f428804b030 con 0x7f429806d5f0 2024-05-14T14:41:14.524 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.541+0000 7f429e7cf640 1 -- 172.21.15.39:0/2557692317 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f42981638a0 con 0x7f429806d5f0 2024-05-14T14:41:14.525 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.541+0000 7f4294ff9640 1 -- 172.21.15.39:0/2557692317 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5178 (secure 0 0 0) 0x7f42880816b0 con 0x7f429806d5f0 2024-05-14T14:41:14.525 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:41:14.525 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4804,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6837/811834490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6835","nonce":811834490},{"type":"v1","addr":"172.21.15.39:6837","nonce":811834490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4807,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/3956392973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":3956392973},{"type":"v1","addr":"172.21.15.62:6834","nonce":3956392973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4896,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.39:6836/1104312337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:6834","nonce":1104312337},{"type":"v1","addr":"172.21.15.39:6836","nonce":1104312337}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T14:41:04.091088+0000","modified":"2024-05-14T14:41:07.117999+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4905},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4905":{"gid":4905,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/2640607791","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":2640607791},{"type":"v1","addr":"172.21.15.62:6835","nonce":2640607791}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4905,"qdb_cluster":[4905]},"id":2}]} 2024-05-14T14:41:14.526 INFO:teuthology.orchestra.run.smithi039.stderr:dumped fsmap epoch 18 2024-05-14T14:41:14.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.543+0000 7f429e7cf640 1 -- 172.21.15.39:0/2557692317 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4284076300 msgr2=0x7f4284078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:14.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.543+0000 7f429e7cf640 1 --2- 172.21.15.39:0/2557692317 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4284076300 0x7f4284078810 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f42980caef0 tx=0x7f428c008040 comp rx=0 tx=0).stop 2024-05-14T14:41:14.527 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.543+0000 7f429e7cf640 1 -- 172.21.15.39:0/2557692317 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f429806d5f0 msgr2=0x7f42980c8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:14.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.543+0000 7f429e7cf640 1 --2- 172.21.15.39:0/2557692317 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f429806d5f0 0x7f42980c8b40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4288000c00 tx=0x7f42880046c0 comp rx=0 tx=0).stop 2024-05-14T14:41:14.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.543+0000 7f429e7cf640 1 -- 172.21.15.39:0/2557692317 shutdown_connections 2024-05-14T14:41:14.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.543+0000 7f429e7cf640 1 --2- 172.21.15.39:0/2557692317 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f4284076300 0x7f4284078810 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:14.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.543+0000 7f429e7cf640 1 --2- 172.21.15.39:0/2557692317 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4298160420 0x7f42980cd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:14.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.543+0000 7f429e7cf640 1 --2- 172.21.15.39:0/2557692317 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f42980d1140 0x7f42980cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:14.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.543+0000 7f429e7cf640 1 --2- 172.21.15.39:0/2557692317 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f429806d5f0 0x7f42980c8b40 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:14.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.543+0000 7f429e7cf640 1 -- 172.21.15.39:0/2557692317 >> 172.21.15.39:0/2557692317 conn(0x7f42980d27d0 msgr2=0x7f4298163090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:14.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.543+0000 7f429e7cf640 1 -- 172.21.15.39:0/2557692317 shutdown_connections 2024-05-14T14:41:14.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:14.544+0000 7f429e7cf640 1 -- 172.21.15.39:0/2557692317 wait complete. 2024-05-14T14:41:14.941 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-14T14:41:04.091088+0000', 'modified': '2024-05-14T14:41:07.117999+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4905}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4905': {'gid': 4905, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6835/2640607791', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6833', 'nonce': 2640607791}, {'type': 'v1', 'addr': '172.21.15.62:6835', 'nonce': 2640607791}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4905, 'qdb_cluster': [4905]} 2024-05-14T14:41:14.941 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-14T14:41:14.941 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-14T14:41:15.059 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.076+0000 7f2ed364c640 1 Processor -- start 2024-05-14T14:41:15.060 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.076+0000 7f2ed364c640 1 -- start start 2024-05-14T14:41:15.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.077+0000 7f2ed364c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2ecc06dce0 0x7f2ecc16b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:15.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.077+0000 7f2ed364c640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ecc0d5840 con 0x7f2ecc1602d0 2024-05-14T14:41:15.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.077+0000 7f2ed364c640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ecc0d4fa0 con 0x7f2ecc0b4ec0 2024-05-14T14:41:15.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.077+0000 7f2ed364c640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f2ecc0d4d50 con 0x7f2ecc06dce0 2024-05-14T14:41:15.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.077+0000 7f2ed0be7640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f2ecc1602d0 0x7f2ecc0d11e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:36538/0 (socket says 172.21.15.39:36538) 2024-05-14T14:41:15.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.077+0000 7f2ed0be7640 1 -- 172.21.15.39:0/921467108 learned_addr learned my addr 172.21.15.39:0/921467108 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:41:15.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.078+0000 7f2ec3fff640 1 -- 172.21.15.39:0/921467108 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2850415611 0 0) 0x7f2ecc0d5840 con 0x7f2ecc1602d0 2024-05-14T14:41:15.064 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.078+0000 7f2ec3fff640 1 -- 172.21.15.39:0/921467108 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2eb8003520 con 0x7f2ecc1602d0 2024-05-14T14:41:15.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.078+0000 7f2ed1be9640 1 --2- 172.21.15.39:0/921467108 >> v2:172.21.15.62:3300/0 conn(0x7f2ecc06dce0 0x7f2ecc16b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:15.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.078+0000 7f2ec3fff640 1 -- 172.21.15.39:0/921467108 <== mon.0 v1:172.21.15.39:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4225891452 0 0) 0x7f2eb8003520 con 0x7f2ecc1602d0 2024-05-14T14:41:15.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.078+0000 7f2ec3fff640 1 -- 172.21.15.39:0/921467108 >> v2:172.21.15.62:3300/0 conn(0x7f2ecc06dce0 msgr2=0x7f2ecc16b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:15.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.078+0000 7f2ec3fff640 1 --2- 172.21.15.39:0/921467108 >> v2:172.21.15.62:3300/0 conn(0x7f2ecc06dce0 0x7f2ecc16b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.078+0000 7f2ec3fff640 1 -- 172.21.15.39:0/921467108 >> v1:172.21.15.62:6789/0 conn(0x7f2ecc0b4ec0 legacy=0x7f2ecc0d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:15.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.078+0000 7f2ec3fff640 1 -- 172.21.15.39:0/921467108 --> v1:172.21.15.39:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ecc0d5280 con 0x7f2ecc1602d0 2024-05-14T14:41:15.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.078+0000 7f2ec3fff640 1 -- 172.21.15.39:0/921467108 <== mon.0 v1:172.21.15.39:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1803005051 0 0) 0x7f2ebc0016f0 con 0x7f2ecc1602d0 2024-05-14T14:41:15.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.078+0000 7f2ec3fff640 1 -- 172.21.15.39:0/921467108 >> v1:172.21.15.39:6789/0 conn(0x7f2ecc1602d0 legacy=0x7f2ecc0d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:15.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.078+0000 7f2ec3fff640 1 --2- 172.21.15.39:0/921467108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2eb8003a50 0x7f2eb8003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:15.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.078+0000 7f2ec3fff640 1 --2- 172.21.15.39:0/921467108 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2eb8004800 0x7f2eb8004c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:15.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.078+0000 7f2ec3fff640 1 --2- 172.21.15.39:0/921467108 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2eb8005250 0x7f2eb800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:15.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.078+0000 7f2ec3fff640 1 -- 172.21.15.39:0/921467108 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2ecc0d4d50 con 0x7f2eb8005250 2024-05-14T14:41:15.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.078+0000 7f2ec3fff640 1 -- 172.21.15.39:0/921467108 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2eb800c1e0 con 0x7f2eb8003a50 2024-05-14T14:41:15.065 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.078+0000 7f2ec3fff640 1 -- 172.21.15.39:0/921467108 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f2eb800c3e0 con 0x7f2eb8004800 2024-05-14T14:41:15.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.078+0000 7f2ed1be9640 1 --2- 172.21.15.39:0/921467108 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2eb8005250 0x7f2eb800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:15.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.078+0000 7f2ed13e8640 1 --2- 172.21.15.39:0/921467108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2eb8003a50 0x7f2eb8003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:15.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.078+0000 7f2ed0be7640 1 --2- 172.21.15.39:0/921467108 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2eb8004800 0x7f2eb8004c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:15.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.079+0000 7f2ed1be9640 1 -- 172.21.15.39:0/921467108 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2eb8004800 msgr2=0x7f2eb8004c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:15.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.079+0000 7f2ed1be9640 1 --2- 172.21.15.39:0/921467108 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2eb8004800 0x7f2eb8004c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.079+0000 7f2ed1be9640 1 -- 172.21.15.39:0/921467108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2eb8003a50 msgr2=0x7f2eb8003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:15.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.079+0000 7f2ed1be9640 1 --2- 172.21.15.39:0/921467108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2eb8003a50 0x7f2eb8003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.079+0000 7f2ed1be9640 1 -- 172.21.15.39:0/921467108 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2eb8003520 con 0x7f2eb8005250 2024-05-14T14:41:15.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.079+0000 7f2ed13e8640 1 --2- 172.21.15.39:0/921467108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2eb8003a50 0x7f2eb8003ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:41:15.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.079+0000 7f2ed1be9640 1 -- 172.21.15.39:0/921467108 reap_dead start 2024-05-14T14:41:15.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.079+0000 7f2ed1be9640 1 --2- 172.21.15.39:0/921467108 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2eb8005250 0x7f2eb800b9c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4009ac0 tx=0x7f2eb8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7c8b635d5461de9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:15.066 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.079+0000 7f2ec3fff640 1 -- 172.21.15.39:0/921467108 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec4009690 con 0x7f2eb8005250 2024-05-14T14:41:15.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.079+0000 7f2ec3fff640 1 -- 172.21.15.39:0/921467108 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ec4004020 con 0x7f2eb8005250 2024-05-14T14:41:15.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.079+0000 7f2ec3fff640 1 -- 172.21.15.39:0/921467108 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec4004410 con 0x7f2eb8005250 2024-05-14T14:41:15.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.080+0000 7f2ed364c640 1 -- 172.21.15.39:0/921467108 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2eb8005250 msgr2=0x7f2eb800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:15.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.080+0000 7f2ed364c640 1 --2- 172.21.15.39:0/921467108 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2eb8005250 0x7f2eb800b9c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4009ac0 tx=0x7f2eb8005830 comp rx=0 tx=0).stop 2024-05-14T14:41:15.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.080+0000 7f2ed364c640 1 -- 172.21.15.39:0/921467108 shutdown_connections 2024-05-14T14:41:15.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.080+0000 7f2ed364c640 1 --2- 172.21.15.39:0/921467108 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2eb8005250 0x7f2eb800b9c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.080+0000 7f2ed364c640 1 -- 172.21.15.39:0/921467108 >> 172.21.15.39:0/921467108 conn(0x7f2ecc06f270 msgr2=0x7f2ecc0d5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:15.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.080+0000 7f2ed364c640 1 -- 172.21.15.39:0/921467108 shutdown_connections 2024-05-14T14:41:15.067 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.080+0000 7f2ed364c640 1 -- 172.21.15.39:0/921467108 wait complete. 2024-05-14T14:41:15.069 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.082+0000 7f2ed364c640 1 Processor -- start 2024-05-14T14:41:15.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.082+0000 7f2ed364c640 1 -- start start 2024-05-14T14:41:15.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.083+0000 7f2ed364c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2eb8005250 0x7f2ecc0cb520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:15.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.083+0000 7f2ed364c640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ecc0cd2b0 0x7f2ecc0ca600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:15.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.083+0000 7f2ed364c640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ecc14ffb0 0x7f2ecc15c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:15.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.083+0000 7f2ed364c640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2ecc1606e0 con 0x7f2ecc0cd2b0 2024-05-14T14:41:15.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.083+0000 7f2ed364c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2ecc06c840 con 0x7f2eb8005250 2024-05-14T14:41:15.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.083+0000 7f2ed364c640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f2ecc0b5480 con 0x7f2ecc14ffb0 2024-05-14T14:41:15.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.084+0000 7f2ed0be7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ecc0cd2b0 0x7f2ecc0ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:15.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.084+0000 7f2ed0be7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ecc0cd2b0 0x7f2ecc0ca600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41450/0 (socket says 172.21.15.39:41450) 2024-05-14T14:41:15.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.084+0000 7f2ed0be7640 1 -- 172.21.15.39:0/3791703468 learned_addr learned my addr 172.21.15.39:0/3791703468 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:41:15.070 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.084+0000 7f2ed1be9640 1 --2- 172.21.15.39:0/3791703468 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ecc14ffb0 0x7f2ecc15c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:15.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.084+0000 7f2ed13e8640 1 --2- 172.21.15.39:0/3791703468 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2eb8005250 0x7f2ecc0cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:15.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.084+0000 7f2ed0be7640 1 -- 172.21.15.39:0/3791703468 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ecc14ffb0 msgr2=0x7f2ecc15c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:15.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.084+0000 7f2ed0be7640 1 --2- 172.21.15.39:0/3791703468 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ecc14ffb0 0x7f2ecc15c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.084+0000 7f2ed0be7640 1 -- 172.21.15.39:0/3791703468 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2eb8005250 msgr2=0x7f2ecc0cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:15.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.084+0000 7f2ed0be7640 1 --2- 172.21.15.39:0/3791703468 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2eb8005250 0x7f2ecc0cb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.084+0000 7f2ed0be7640 1 -- 172.21.15.39:0/3791703468 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ecc159a40 con 0x7f2ecc0cd2b0 2024-05-14T14:41:15.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.084+0000 7f2ed1be9640 1 --2- 172.21.15.39:0/3791703468 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ecc14ffb0 0x7f2ecc15c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:41:15.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.084+0000 7f2ed0be7640 1 --2- 172.21.15.39:0/3791703468 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ecc0cd2b0 0x7f2ecc0ca600 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc00e700 tx=0x7f2ebc00ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:15.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.084+0000 7f2ec1ffb640 1 -- 172.21.15.39:0/3791703468 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc00c640 con 0x7f2ecc0cd2b0 2024-05-14T14:41:15.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.084+0000 7f2ec1ffb640 1 -- 172.21.15.39:0/3791703468 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ebc018070 con 0x7f2ecc0cd2b0 2024-05-14T14:41:15.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.084+0000 7f2ed364c640 1 -- 172.21.15.39:0/3791703468 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ecc159d20 con 0x7f2ecc0cd2b0 2024-05-14T14:41:15.071 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.084+0000 7f2ec1ffb640 1 -- 172.21.15.39:0/3791703468 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc00ca40 con 0x7f2ecc0cd2b0 2024-05-14T14:41:15.072 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.085+0000 7f2ed364c640 1 -- 172.21.15.39:0/3791703468 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ecc15a2e0 con 0x7f2ecc0cd2b0 2024-05-14T14:41:15.075 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.087+0000 7f2ec1ffb640 1 -- 172.21.15.39:0/3791703468 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f2ebc00cbe0 con 0x7f2ecc0cd2b0 2024-05-14T14:41:15.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.087+0000 7f2ec1ffb640 1 --2- 172.21.15.39:0/3791703468 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f2eb00762d0 0x7f2eb00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:15.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.087+0000 7f2ec1ffb640 1 -- 172.21.15.39:0/3791703468 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7f2ebc097530 con 0x7f2ecc0cd2b0 2024-05-14T14:41:15.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.087+0000 7f2ed13e8640 1 --2- 172.21.15.39:0/3791703468 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f2eb00762d0 0x7f2eb00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:15.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.088+0000 7f2ed13e8640 1 --2- 172.21.15.39:0/3791703468 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f2eb00762d0 0x7f2eb00787e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8007fd0 tx=0x7f2ec8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:15.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.088+0000 7f2eda5dd740 1 Processor -- start 2024-05-14T14:41:15.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.088+0000 7f2eda5dd740 1 -- start start 2024-05-14T14:41:15.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.089+0000 7f2eda5dd740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555edfa5c270 0x555edfe29120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:15.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.089+0000 7f2eda5dd740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555edfa333b0 0x555edfdfe760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:15.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.089+0000 7f2eda5dd740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x555edfa3b590 0x555edfe450b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:15.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.089+0000 7f2eda5dd740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x555edfd628d0 con 0x555edfa5c270 2024-05-14T14:41:15.076 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.089+0000 7f2eda5dd740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x555edfd1bc10 con 0x555edfa333b0 2024-05-14T14:41:15.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.089+0000 7f2eda5dd740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x555edfd5e890 con 0x555edfa3b590 2024-05-14T14:41:15.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.089+0000 7f2ed13e8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555edfa5c270 0x555edfe29120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:15.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.090+0000 7f2ed13e8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555edfa5c270 0x555edfe29120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41454/0 (socket says 172.21.15.39:41454) 2024-05-14T14:41:15.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.090+0000 7f2ed13e8640 1 -- 172.21.15.39:0/3092597195 learned_addr learned my addr 172.21.15.39:0/3092597195 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:41:15.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.090+0000 7f2ed0be7640 1 --2- 172.21.15.39:0/3092597195 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555edfa333b0 0x555edfdfe760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:15.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.090+0000 7f2ed1be9640 1 --2- 172.21.15.39:0/3092597195 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x555edfa3b590 0x555edfe450b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:15.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.090+0000 7f2ed13e8640 1 -- 172.21.15.39:0/3092597195 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x555edfa3b590 msgr2=0x555edfe450b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:15.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.090+0000 7f2ed13e8640 1 --2- 172.21.15.39:0/3092597195 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x555edfa3b590 0x555edfe450b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.090+0000 7f2ed13e8640 1 -- 172.21.15.39:0/3092597195 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555edfa333b0 msgr2=0x555edfdfe760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:15.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.090+0000 7f2ed13e8640 1 --2- 172.21.15.39:0/3092597195 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555edfa333b0 0x555edfdfe760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.077 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.090+0000 7f2ed13e8640 1 -- 172.21.15.39:0/3092597195 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555edfd235d0 con 0x555edfa5c270 2024-05-14T14:41:15.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.090+0000 7f2ed13e8640 1 --2- 172.21.15.39:0/3092597195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555edfa5c270 0x555edfe29120 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8001c10 tx=0x7f2ec8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa7ab70f13285365 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:15.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.090+0000 7f2eb6ffd640 1 -- 172.21.15.39:0/3092597195 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec8027070 con 0x555edfa5c270 2024-05-14T14:41:15.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.090+0000 7f2eb6ffd640 1 -- 172.21.15.39:0/3092597195 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ec8014b80 con 0x555edfa5c270 2024-05-14T14:41:15.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.090+0000 7f2eb6ffd640 1 -- 172.21.15.39:0/3092597195 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec8013360 con 0x555edfa5c270 2024-05-14T14:41:15.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.091+0000 7f2eda5dd740 1 -- 172.21.15.39:0/3092597195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555edfa5c270 msgr2=0x555edfe29120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:15.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.091+0000 7f2eda5dd740 1 --2- 172.21.15.39:0/3092597195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555edfa5c270 0x555edfe29120 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8001c10 tx=0x7f2ec8013000 comp rx=0 tx=0).stop 2024-05-14T14:41:15.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.091+0000 7f2eda5dd740 1 -- 172.21.15.39:0/3092597195 shutdown_connections 2024-05-14T14:41:15.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.091+0000 7f2eda5dd740 1 --2- 172.21.15.39:0/3092597195 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x555edfa3b590 0x555edfe450b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.078 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.091+0000 7f2eda5dd740 1 --2- 172.21.15.39:0/3092597195 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555edfa333b0 0x555edfdfe760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.091+0000 7f2eda5dd740 1 --2- 172.21.15.39:0/3092597195 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555edfa5c270 0x555edfe29120 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.091+0000 7f2eda5dd740 1 -- 172.21.15.39:0/3092597195 >> 172.21.15.39:0/3092597195 conn(0x555edfa503c0 msgr2=0x555edfdfdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:15.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.091+0000 7f2eda5dd740 1 -- 172.21.15.39:0/3092597195 shutdown_connections 2024-05-14T14:41:15.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.091+0000 7f2eda5dd740 1 -- 172.21.15.39:0/3092597195 wait complete. 2024-05-14T14:41:15.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.092+0000 7f2eda5dd740 1 -- start start 2024-05-14T14:41:15.079 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.092+0000 7f2eda5dd740 1 Processor -- start 2024-05-14T14:41:15.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.093+0000 7f2eda5dd740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555edfa333b0 0x555edfe23710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:15.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.093+0000 7f2eda5dd740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x555edfa3b590 0x555edfe44650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:15.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.093+0000 7f2eda5dd740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555edfa5c270 0x555edfe44b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:15.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.093+0000 7f2eda5dd740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x555edfd1f760 con 0x555edfa333b0 2024-05-14T14:41:15.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.093+0000 7f2eda5dd740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x555edfe28c90 con 0x555edfa5c270 2024-05-14T14:41:15.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.093+0000 7f2eda5dd740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x555edfe20380 con 0x555edfa3b590 2024-05-14T14:41:15.084 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.094+0000 7f2eda5dd740 10 client.0 _ll_register_callbacks cb 0x555edfd58cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T14:41:15.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.094+0000 7f2ed13e8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555edfa333b0 0x555edfe23710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:15.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.094+0000 7f2ed13e8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555edfa333b0 0x555edfe23710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41462/0 (socket says 172.21.15.39:41462) 2024-05-14T14:41:15.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.094+0000 7f2ed13e8640 1 -- 172.21.15.39:0/3084259733 learned_addr learned my addr 172.21.15.39:0/3084259733 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:41:15.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.094+0000 7f2ed1be9640 1 --2- 172.21.15.39:0/3084259733 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555edfa5c270 0x555edfe44b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:15.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.094+0000 7f2ed0be7640 1 --2- 172.21.15.39:0/3084259733 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x555edfa3b590 0x555edfe44650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:15.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.094+0000 7f2ed13e8640 1 -- 172.21.15.39:0/3084259733 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x555edfa3b590 msgr2=0x555edfe44650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:15.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.094+0000 7f2ed13e8640 1 --2- 172.21.15.39:0/3084259733 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x555edfa3b590 0x555edfe44650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.094+0000 7f2ed13e8640 1 -- 172.21.15.39:0/3084259733 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555edfa5c270 msgr2=0x555edfe44b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:15.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.094+0000 7f2ed13e8640 1 --2- 172.21.15.39:0/3084259733 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555edfa5c270 0x555edfe44b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.094+0000 7f2ed13e8640 1 -- 172.21.15.39:0/3084259733 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555edfa742d0 con 0x555edfa333b0 2024-05-14T14:41:15.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.094+0000 7f2ed1be9640 1 --2- 172.21.15.39:0/3084259733 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555edfa5c270 0x555edfe44b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:41:15.085 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.094+0000 7f2ed13e8640 1 --2- 172.21.15.39:0/3084259733 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555edfa333b0 0x555edfe23710 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8025040 tx=0x7f2ec8001510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e49e5dfb1fe83e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:15.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.094+0000 7f2eabfff640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-05-14T14:41:15.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.094+0000 7f2eabfff640 1 -- 172.21.15.39:0/3084259733 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec8033060 con 0x555edfa333b0 2024-05-14T14:41:15.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.094+0000 7f2eabfff640 1 -- 172.21.15.39:0/3084259733 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7f2ec8021ba0 con 0x555edfa333b0 2024-05-14T14:41:15.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.094+0000 7f2eda5dd740 1 -- 172.21.15.39:0/3084259733 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ec8014b80 con 0x555edfa333b0 2024-05-14T14:41:15.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.094+0000 7f2eabfff640 1 -- 172.21.15.39:0/3084259733 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f2ec8039050 con 0x555edfa333b0 2024-05-14T14:41:15.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.094+0000 7f2eda5dd740 10 client.5070 fetch_fsmap learned FSMap version 18 2024-05-14T14:41:15.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.095+0000 7f2eda5dd740 1 -- 172.21.15.39:0/3084259733 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x555edfb3e6b0 con 0x555edfa333b0 2024-05-14T14:41:15.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.095+0000 7f2eabfff640 1 -- 172.21.15.39:0/3084259733 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ec8014b80 con 0x555edfa333b0 2024-05-14T14:41:15.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.095+0000 7f2eabfff640 1 -- 172.21.15.39:0/3084259733 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f2ec803c020 con 0x555edfa333b0 2024-05-14T14:41:15.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.095+0000 7f2eda5dd740 10 client.5070 fetch_fsmap finished waiting for FSMap version 18 2024-05-14T14:41:15.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.095+0000 7f2eda5dd740 10 client.5070 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-14T14:41:15.086 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.095+0000 7f2eda5dd740 20 client.5070 populate_metadata read hostname 'smithi039' 2024-05-14T14:41:15.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.095+0000 7f2eda5dd740 1 --2- 172.21.15.39:0/3084259733 >> [v2:172.21.15.62:6833/2640607791,v1:172.21.15.62:6835/2640607791] conn(0x555edfa1ae40 0x555edfe29c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:15.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.095+0000 7f2eda5dd740 4 client.5070 mds_command: new command op to 4905 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T14:41:15.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.095+0000 7f2eda5dd740 1 -- 172.21.15.39:0/3084259733 --> [v2:172.21.15.62:6833/2640607791,v1:172.21.15.62:6835/2640607791] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555edfce6760 con 0x555edfa1ae40 2024-05-14T14:41:15.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.095+0000 7f2ed0be7640 1 --2- 172.21.15.39:0/3084259733 >> [v2:172.21.15.62:6833/2640607791,v1:172.21.15.62:6835/2640607791] conn(0x555edfa1ae40 0x555edfe29c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:15.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.096+0000 7f2eabfff640 10 client.5070 ms_handle_connect on v2:172.21.15.62:6833/2640607791 2024-05-14T14:41:15.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.096+0000 7f2ed0be7640 1 --2- 172.21.15.39:0/3084259733 >> [v2:172.21.15.62:6833/2640607791,v1:172.21.15.62:6835/2640607791] conn(0x555edfa1ae40 0x555edfe29c90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98284c8e1ad532aa server_cookie=bb42d0e3d237db2e in_seq=0 out_seq=0 2024-05-14T14:41:15.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.096+0000 7f2eabfff640 1 -- 172.21.15.39:0/3084259733 <== mds.0 v2:172.21.15.62:6833/2640607791 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x555edfce6760 con 0x555edfa1ae40 2024-05-14T14:41:15.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.096+0000 7f2eabfff640 10 client.5070 handle_command_reply: tid=0 2024-05-14T14:41:15.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.096+0000 7f2eda5dd740 1 client.5070 shutdown 2024-05-14T14:41:15.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.097+0000 7f2eda5dd740 1 -- 172.21.15.39:0/3084259733 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555edfa333b0 msgr2=0x555edfe23710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:15.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.097+0000 7f2eda5dd740 1 --2- 172.21.15.39:0/3084259733 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555edfa333b0 0x555edfe23710 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8025040 tx=0x7f2ec8001510 comp rx=0 tx=0).stop 2024-05-14T14:41:15.087 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.097+0000 7f2eda5dd740 1 -- 172.21.15.39:0/3084259733 shutdown_connections 2024-05-14T14:41:15.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.097+0000 7f2eda5dd740 1 --2- 172.21.15.39:0/3084259733 >> [v2:172.21.15.62:6833/2640607791,v1:172.21.15.62:6835/2640607791] conn(0x555edfa1ae40 0x555edfe29c90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.097+0000 7f2eda5dd740 1 --2- 172.21.15.39:0/3084259733 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555edfa5c270 0x555edfe44b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.097+0000 7f2eda5dd740 1 --2- 172.21.15.39:0/3084259733 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x555edfa3b590 0x555edfe44650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.097+0000 7f2eabfff640 0 client.5070 ms_handle_reset on v2:172.21.15.62:6833/2640607791 2024-05-14T14:41:15.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.097+0000 7f2eda5dd740 1 --2- 172.21.15.39:0/3084259733 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555edfa333b0 0x555edfe23710 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.097+0000 7f2eda5dd740 1 -- 172.21.15.39:0/3084259733 >> 172.21.15.39:0/3084259733 conn(0x555edfa503c0 msgr2=0x555edfdfdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:15.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.097+0000 7f2eda5dd740 1 -- 172.21.15.39:0/3084259733 shutdown_connections 2024-05-14T14:41:15.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.097+0000 7f2eda5dd740 1 -- 172.21.15.39:0/3084259733 wait complete. 2024-05-14T14:41:15.088 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.097+0000 7f2eda5dd740 20 client.5070 trim_cache size 0 max 16384 2024-05-14T14:41:15.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.116+0000 7f2eda5dd740 1 Processor -- start 2024-05-14T14:41:15.100 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.116+0000 7f2eda5dd740 1 -- start start 2024-05-14T14:41:15.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.117+0000 7f2eda5dd740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555edfa333b0 0x555edfe44900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:15.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.117+0000 7f2eda5dd740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x555edfa3b590 0x555edfe460a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:15.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.117+0000 7f2eda5dd740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555edfa5c270 0x555edfe1d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:15.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.117+0000 7f2eda5dd740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f2ecc202d30 con 0x555edfa333b0 2024-05-14T14:41:15.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.117+0000 7f2eda5dd740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f2ecc202160 con 0x555edfa5c270 2024-05-14T14:41:15.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.117+0000 7f2eda5dd740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f2ecc2026e0 con 0x555edfa3b590 2024-05-14T14:41:15.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.118+0000 7f2ed13e8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555edfa333b0 0x555edfe44900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:15.103 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.118+0000 7f2ed13e8640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555edfa333b0 0x555edfe44900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41464/0 (socket says 172.21.15.39:41464) 2024-05-14T14:41:15.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.118+0000 7f2ed13e8640 1 -- 172.21.15.39:0/2190038599 learned_addr learned my addr 172.21.15.39:0/2190038599 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:41:15.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.118+0000 7f2ed13e8640 1 -- 172.21.15.39:0/2190038599 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x555edfa3b590 msgr2=0x555edfe460a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:15.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.118+0000 7f2ed13e8640 1 --2- 172.21.15.39:0/2190038599 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x555edfa3b590 0x555edfe460a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.118+0000 7f2ed13e8640 1 -- 172.21.15.39:0/2190038599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555edfa5c270 msgr2=0x555edfe1d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:15.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.118+0000 7f2ed13e8640 1 --2- 172.21.15.39:0/2190038599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555edfa5c270 0x555edfe1d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.118+0000 7f2ed13e8640 1 -- 172.21.15.39:0/2190038599 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555edfdf8df0 con 0x555edfa333b0 2024-05-14T14:41:15.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.118+0000 7f2ed13e8640 1 --2- 172.21.15.39:0/2190038599 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555edfa333b0 0x555edfe44900 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8003be0 tx=0x7f2ec802c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e2693f514f4679 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:15.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.118+0000 7f2eb67fc640 1 -- 172.21.15.39:0/2190038599 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec8041020 con 0x555edfa333b0 2024-05-14T14:41:15.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.118+0000 7f2eb67fc640 1 -- 172.21.15.39:0/2190038599 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ec8028040 con 0x555edfa333b0 2024-05-14T14:41:15.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.118+0000 7f2eb67fc640 1 -- 172.21.15.39:0/2190038599 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec8027070 con 0x555edfa333b0 2024-05-14T14:41:15.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.119+0000 7f2eda5dd740 1 -- 172.21.15.39:0/2190038599 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555edfa333b0 msgr2=0x555edfe44900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:15.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.119+0000 7f2eda5dd740 1 --2- 172.21.15.39:0/2190038599 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555edfa333b0 0x555edfe44900 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8003be0 tx=0x7f2ec802c000 comp rx=0 tx=0).stop 2024-05-14T14:41:15.104 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.119+0000 7f2eda5dd740 1 -- 172.21.15.39:0/2190038599 shutdown_connections 2024-05-14T14:41:15.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.119+0000 7f2eda5dd740 1 --2- 172.21.15.39:0/2190038599 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555edfa5c270 0x555edfe1d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.119+0000 7f2eda5dd740 1 --2- 172.21.15.39:0/2190038599 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x555edfa3b590 0x555edfe460a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.119+0000 7f2eda5dd740 1 --2- 172.21.15.39:0/2190038599 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555edfa333b0 0x555edfe44900 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.119+0000 7f2eda5dd740 1 -- 172.21.15.39:0/2190038599 >> 172.21.15.39:0/2190038599 conn(0x555edfa503c0 msgr2=0x555edfe45470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:15.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.119+0000 7f2eda5dd740 1 -- 172.21.15.39:0/2190038599 shutdown_connections 2024-05-14T14:41:15.105 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.119+0000 7f2eda5dd740 1 -- 172.21.15.39:0/2190038599 wait complete. 2024-05-14T14:41:15.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.120+0000 7f2eda5dd740 1 -- start start 2024-05-14T14:41:15.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.120+0000 7f2eda5dd740 1 Processor -- start 2024-05-14T14:41:15.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.121+0000 7f2eda5dd740 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x555edfa333b0 0x555edfec44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:15.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.121+0000 7f2eda5dd740 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555edfa3b590 0x555edfec4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:15.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.121+0000 7f2eda5dd740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555edfa5c270 0x555edfec4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:15.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.121+0000 7f2eda5dd740 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x555edfe1e810 con 0x555edfa3b590 2024-05-14T14:41:15.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.121+0000 7f2eda5dd740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x555edfe1e500 con 0x555edfa5c270 2024-05-14T14:41:15.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.121+0000 7f2eda5dd740 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x555edfe1f710 con 0x555edfa333b0 2024-05-14T14:41:15.110 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.121+0000 7f2eda5dd740 10 client.0 _ll_register_callbacks cb 0x7f2ec8025070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T14:41:15.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.122+0000 7f2ed0be7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555edfa3b590 0x555edfec4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:15.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.122+0000 7f2ed0be7640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555edfa3b590 0x555edfec4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41472/0 (socket says 172.21.15.39:41472) 2024-05-14T14:41:15.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.122+0000 7f2ed0be7640 1 -- 172.21.15.39:0/4091591219 learned_addr learned my addr 172.21.15.39:0/4091591219 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:41:15.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.122+0000 7f2ed1be9640 1 --2- 172.21.15.39:0/4091591219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555edfa5c270 0x555edfec4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:15.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.122+0000 7f2ed0be7640 1 -- 172.21.15.39:0/4091591219 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x555edfa333b0 msgr2=0x555edfec44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:15.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.122+0000 7f2ed13e8640 1 --2- 172.21.15.39:0/4091591219 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x555edfa333b0 0x555edfec44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:15.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.122+0000 7f2ed0be7640 1 --2- 172.21.15.39:0/4091591219 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x555edfa333b0 0x555edfec44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.122+0000 7f2ed0be7640 1 -- 172.21.15.39:0/4091591219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555edfa5c270 msgr2=0x555edfec4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:15.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.122+0000 7f2ed0be7640 1 --2- 172.21.15.39:0/4091591219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555edfa5c270 0x555edfec4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.122+0000 7f2ed0be7640 1 -- 172.21.15.39:0/4091591219 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555edfe1da30 con 0x555edfa3b590 2024-05-14T14:41:15.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.122+0000 7f2ed1be9640 1 --2- 172.21.15.39:0/4091591219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555edfa5c270 0x555edfec4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:41:15.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.122+0000 7f2ed0be7640 1 --2- 172.21.15.39:0/4091591219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555edfa3b590 0x555edfec4a20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc060270 tx=0x7f2ebc00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c769af5bb94bdffc server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:15.111 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.122+0000 7f2eabfff640 10 client.0 ms_handle_connect on v2:172.21.15.39:3300/0 2024-05-14T14:41:15.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.122+0000 7f2eabfff640 1 -- 172.21.15.39:0/4091591219 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc092020 con 0x555edfa3b590 2024-05-14T14:41:15.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.122+0000 7f2eabfff640 1 -- 172.21.15.39:0/4091591219 <== mon.0 v2:172.21.15.39:3300/0 2 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7f2ebc0972b0 con 0x555edfa3b590 2024-05-14T14:41:15.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.122+0000 7f2eda5dd740 1 -- 172.21.15.39:0/4091591219 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ec8028040 con 0x555edfa3b590 2024-05-14T14:41:15.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.122+0000 7f2eabfff640 1 -- 172.21.15.39:0/4091591219 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f2ebc080050 con 0x555edfa3b590 2024-05-14T14:41:15.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.122+0000 7f2eda5dd740 10 client.5076 fetch_fsmap learned FSMap version 18 2024-05-14T14:41:15.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.122+0000 7f2eda5dd740 1 -- 172.21.15.39:0/4091591219 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x555edfe46640 con 0x555edfa3b590 2024-05-14T14:41:15.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.123+0000 7f2eabfff640 1 -- 172.21.15.39:0/4091591219 <== mon.0 v2:172.21.15.39:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ec8028040 con 0x555edfa3b590 2024-05-14T14:41:15.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.123+0000 7f2eabfff640 1 -- 172.21.15.39:0/4091591219 <== mon.0 v2:172.21.15.39:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f2ebc095310 con 0x555edfa3b590 2024-05-14T14:41:15.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.123+0000 7f2eda5dd740 10 client.5076 fetch_fsmap finished waiting for FSMap version 18 2024-05-14T14:41:15.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.123+0000 7f2eda5dd740 10 client.5076 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-14T14:41:15.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.123+0000 7f2eda5dd740 20 client.5076 populate_metadata read hostname 'smithi039' 2024-05-14T14:41:15.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.123+0000 7f2eda5dd740 1 --2- 172.21.15.39:0/4091591219 >> [v2:172.21.15.62:6833/2640607791,v1:172.21.15.62:6835/2640607791] conn(0x555edfea9330 0x555edfea9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:15.112 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.123+0000 7f2eda5dd740 4 client.5076 mds_command: new command op to 4905 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T14:41:15.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.123+0000 7f2eda5dd740 1 -- 172.21.15.39:0/4091591219 --> [v2:172.21.15.62:6833/2640607791,v1:172.21.15.62:6835/2640607791] -- command(tid 0: {"prefix": "status"}) -- 0x555edfd704e0 con 0x555edfea9330 2024-05-14T14:41:15.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.123+0000 7f2ed13e8640 1 --2- 172.21.15.39:0/4091591219 >> [v2:172.21.15.62:6833/2640607791,v1:172.21.15.62:6835/2640607791] conn(0x555edfea9330 0x555edfea9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:15.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.123+0000 7f2ed13e8640 1 --2- 172.21.15.39:0/4091591219 >> [v2:172.21.15.62:6833/2640607791,v1:172.21.15.62:6835/2640607791] conn(0x555edfea9330 0x555edfea9740 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed16790f087570aa server_cookie=c355c7b6dc01771b in_seq=0 out_seq=0 2024-05-14T14:41:15.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.123+0000 7f2eabfff640 10 client.5076 ms_handle_connect on v2:172.21.15.62:6833/2640607791 2024-05-14T14:41:15.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.124+0000 7f2eabfff640 1 -- 172.21.15.39:0/4091591219 <== mds.0 v2:172.21.15.62:6833/2640607791 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x555edfd704e0 con 0x555edfea9330 2024-05-14T14:41:15.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.124+0000 7f2eabfff640 10 client.5076 handle_command_reply: tid=0 2024-05-14T14:41:15.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.124+0000 7f2eda5dd740 1 client.5076 shutdown 2024-05-14T14:41:15.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.124+0000 7f2eda5dd740 1 -- 172.21.15.39:0/4091591219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555edfa3b590 msgr2=0x555edfec4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:15.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.124+0000 7f2eda5dd740 1 --2- 172.21.15.39:0/4091591219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555edfa3b590 0x555edfec4a20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc060270 tx=0x7f2ebc00ced0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.124+0000 7f2eda5dd740 1 -- 172.21.15.39:0/4091591219 shutdown_connections 2024-05-14T14:41:15.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.124+0000 7f2eda5dd740 1 --2- 172.21.15.39:0/4091591219 >> [v2:172.21.15.62:6833/2640607791,v1:172.21.15.62:6835/2640607791] conn(0x555edfea9330 0x555edfea9740 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.113 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.124+0000 7f2eda5dd740 1 --2- 172.21.15.39:0/4091591219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x555edfa5c270 0x555edfec4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.124+0000 7f2eda5dd740 1 --2- 172.21.15.39:0/4091591219 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x555edfa3b590 0x555edfec4a20 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.124+0000 7f2eabfff640 0 client.5076 ms_handle_reset on v2:172.21.15.62:6833/2640607791 2024-05-14T14:41:15.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.124+0000 7f2eda5dd740 1 --2- 172.21.15.39:0/4091591219 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x555edfa333b0 0x555edfec44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.124+0000 7f2eda5dd740 1 -- 172.21.15.39:0/4091591219 >> 172.21.15.39:0/4091591219 conn(0x555edfa503c0 msgr2=0x555edfe45260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:15.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.124+0000 7f2eda5dd740 1 -- 172.21.15.39:0/4091591219 shutdown_connections 2024-05-14T14:41:15.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.124+0000 7f2eda5dd740 1 -- 172.21.15.39:0/4091591219 wait complete. 2024-05-14T14:41:15.114 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.124+0000 7f2eda5dd740 20 client.5076 trim_cache size 0 max 16384 2024-05-14T14:41:15.114 INFO:teuthology.orchestra.run.smithi039.stdout:{ 2024-05-14T14:41:15.114 INFO:teuthology.orchestra.run.smithi039.stdout: "cluster_fsid": "d7983fec-79c7-4991-b19c-1aecead64611", 2024-05-14T14:41:15.115 INFO:teuthology.orchestra.run.smithi039.stdout: "whoami": 0, 2024-05-14T14:41:15.115 INFO:teuthology.orchestra.run.smithi039.stdout: "id": 4905, 2024-05-14T14:41:15.115 INFO:teuthology.orchestra.run.smithi039.stdout: "want_state": "up:active", 2024-05-14T14:41:15.115 INFO:teuthology.orchestra.run.smithi039.stdout: "state": "up:active", 2024-05-14T14:41:15.115 INFO:teuthology.orchestra.run.smithi039.stdout: "fs_name": "cephfs", 2024-05-14T14:41:15.115 INFO:teuthology.orchestra.run.smithi039.stdout: "rank_uptime": 10.402520468000001, 2024-05-14T14:41:15.115 INFO:teuthology.orchestra.run.smithi039.stdout: "mdsmap_epoch": 18, 2024-05-14T14:41:15.115 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch": 36, 2024-05-14T14:41:15.115 INFO:teuthology.orchestra.run.smithi039.stdout: "osdmap_epoch_barrier": 36, 2024-05-14T14:41:15.115 INFO:teuthology.orchestra.run.smithi039.stdout: "uptime": 17.380030837 2024-05-14T14:41:15.115 INFO:teuthology.orchestra.run.smithi039.stdout:} 2024-05-14T14:41:15.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.125+0000 7f2ed364c640 1 -- 172.21.15.39:0/3791703468 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f2eb00762d0 msgr2=0x7f2eb00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:15.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.125+0000 7f2ed364c640 1 --2- 172.21.15.39:0/3791703468 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f2eb00762d0 0x7f2eb00787e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8007fd0 tx=0x7f2ec8009040 comp rx=0 tx=0).stop 2024-05-14T14:41:15.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.125+0000 7f2ed364c640 1 -- 172.21.15.39:0/3791703468 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ecc0cd2b0 msgr2=0x7f2ecc0ca600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:15.116 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.125+0000 7f2ed364c640 1 --2- 172.21.15.39:0/3791703468 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ecc0cd2b0 0x7f2ecc0ca600 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc00e700 tx=0x7f2ebc00ebc0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.125+0000 7f2ed364c640 1 -- 172.21.15.39:0/3791703468 shutdown_connections 2024-05-14T14:41:15.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.125+0000 7f2ed364c640 1 --2- 172.21.15.39:0/3791703468 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f2eb00762d0 0x7f2eb00787e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.125+0000 7f2ed364c640 1 --2- 172.21.15.39:0/3791703468 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f2ecc14ffb0 0x7f2ecc15c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.125+0000 7f2ed364c640 1 --2- 172.21.15.39:0/3791703468 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f2ecc0cd2b0 0x7f2ecc0ca600 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.125+0000 7f2ed364c640 1 --2- 172.21.15.39:0/3791703468 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2eb8005250 0x7f2ecc0cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.125+0000 7f2ed364c640 1 -- 172.21.15.39:0/3791703468 >> 172.21.15.39:0/3791703468 conn(0x7f2ecc06f270 msgr2=0x7f2ecc0d26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:15.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.125+0000 7f2ed364c640 1 -- 172.21.15.39:0/3791703468 shutdown_connections 2024-05-14T14:41:15.117 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.125+0000 7f2ed364c640 1 -- 172.21.15.39:0/3791703468 wait complete. 2024-05-14T14:41:15.120 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-14T14:41:15.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.251+0000 7ff7d4b40640 1 Processor -- start 2024-05-14T14:41:15.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.251+0000 7ff7d4b40640 1 -- start start 2024-05-14T14:41:15.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.252+0000 7ff7d4b40640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff7d00b4ec0 0x7ff7d01602d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:15.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.252+0000 7ff7d4b40640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff7d00d15f0 0x7ff7d006ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:15.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.252+0000 7ff7d4b40640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7d00d5840 con 0x7ff7d00d0ad0 2024-05-14T14:41:15.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.252+0000 7ff7d4b40640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7ff7d00d4d50 con 0x7ff7d00b4ec0 2024-05-14T14:41:15.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.252+0000 7ff7d4b40640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7ff7d006c840 con 0x7ff7d00d15f0 2024-05-14T14:41:15.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.253+0000 7ff7ce59c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff7d00b4ec0 0x7ff7d01602d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:15.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.253+0000 7ff7ced9d640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff7d00d15f0 0x7ff7d006ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:15.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.253+0000 7ff7c7fff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff7d00d0ad0 0x7ff7d00d0ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.39:47806/0 (socket says 172.21.15.39:47806) 2024-05-14T14:41:15.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.253+0000 7ff7c7fff640 1 -- 172.21.15.39:0/2051980595 learned_addr learned my addr 172.21.15.39:0/2051980595 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:41:15.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.253+0000 7ff7ce59c640 1 --2- 172.21.15.39:0/2051980595 >> v2:172.21.15.62:3300/0 conn(0x7ff7d00b4ec0 0x7ff7d01602d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.39:51142/0 (socket says 172.21.15.39:51142) 2024-05-14T14:41:15.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.253+0000 7ff7ce59c640 1 -- 172.21.15.39:0/2051980595 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff7d00d15f0 msgr2=0x7ff7d006ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:15.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.253+0000 7ff7ce59c640 1 --2- 172.21.15.39:0/2051980595 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff7d00d15f0 0x7ff7d006ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.253+0000 7ff7ce59c640 1 -- 172.21.15.39:0/2051980595 >> v1:172.21.15.62:6789/0 conn(0x7ff7d00d0ad0 legacy=0x7ff7d00d0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:15.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.253+0000 7ff7ce59c640 1 -- 172.21.15.39:0/2051980595 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7d00d4fa0 con 0x7ff7d00b4ec0 2024-05-14T14:41:15.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.254+0000 7ff7ce59c640 1 --2- 172.21.15.39:0/2051980595 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7d00b4ec0 0x7ff7d01602d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff7c00097a0 tx=0x7ff7c002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8054f392916c132 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:15.239 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.254+0000 7ff7cdd9b640 1 -- 172.21.15.39:0/2051980595 <== mon.1 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c0037070 con 0x7ff7d00b4ec0 2024-05-14T14:41:15.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.254+0000 7ff7cdd9b640 1 -- 172.21.15.39:0/2051980595 <== mon.1 v2:172.21.15.62:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7c0032440 con 0x7ff7d00b4ec0 2024-05-14T14:41:15.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.254+0000 7ff7cdd9b640 1 -- 172.21.15.39:0/2051980595 <== mon.1 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c0032810 con 0x7ff7d00b4ec0 2024-05-14T14:41:15.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.255+0000 7ff7d4b40640 1 -- 172.21.15.39:0/2051980595 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7d00b4ec0 msgr2=0x7ff7d01602d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:15.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.255+0000 7ff7d4b40640 1 --2- 172.21.15.39:0/2051980595 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7d00b4ec0 0x7ff7d01602d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff7c00097a0 tx=0x7ff7c002a180 comp rx=0 tx=0).stop 2024-05-14T14:41:15.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.255+0000 7ff7d4b40640 1 -- 172.21.15.39:0/2051980595 shutdown_connections 2024-05-14T14:41:15.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.255+0000 7ff7d4b40640 1 --2- 172.21.15.39:0/2051980595 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff7d00d15f0 0x7ff7d006ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.255+0000 7ff7d4b40640 1 --2- 172.21.15.39:0/2051980595 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7d00b4ec0 0x7ff7d01602d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.255+0000 7ff7d4b40640 1 -- 172.21.15.39:0/2051980595 >> 172.21.15.39:0/2051980595 conn(0x7ff7d006f270 msgr2=0x7ff7d00d5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:15.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.255+0000 7ff7d4b40640 1 -- 172.21.15.39:0/2051980595 shutdown_connections 2024-05-14T14:41:15.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.255+0000 7ff7d4b40640 1 -- 172.21.15.39:0/2051980595 wait complete. 2024-05-14T14:41:15.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.257+0000 7ff7d4b40640 1 Processor -- start 2024-05-14T14:41:15.241 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.257+0000 7ff7d4b40640 1 -- start start 2024-05-14T14:41:15.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.258+0000 7ff7d4b40640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff7d00b4ec0 0x7ff7d0162c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:15.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.258+0000 7ff7d4b40640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7d00d0ad0 0x7ff7d00bb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:15.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.258+0000 7ff7d4b40640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7d00d15f0 0x7ff7d00bb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:15.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.258+0000 7ff7d4b40640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7ff7d00b5480 con 0x7ff7d00d15f0 2024-05-14T14:41:15.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.258+0000 7ff7d4b40640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7ff7d00d5560 con 0x7ff7d00d0ad0 2024-05-14T14:41:15.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.258+0000 7ff7d4b40640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7ff7d006d210 con 0x7ff7d00b4ec0 2024-05-14T14:41:15.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.258+0000 7ff7ced9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7d00d15f0 0x7ff7d00bb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:15.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.258+0000 7ff7ced9d640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7d00d15f0 0x7ff7d00bb680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:41480/0 (socket says 172.21.15.39:41480) 2024-05-14T14:41:15.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.258+0000 7ff7ced9d640 1 -- 172.21.15.39:0/1766268991 learned_addr learned my addr 172.21.15.39:0/1766268991 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:41:15.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.258+0000 7ff7c7fff640 1 --2- 172.21.15.39:0/1766268991 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7d00d0ad0 0x7ff7d00bb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:15.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.258+0000 7ff7ce59c640 1 --2- 172.21.15.39:0/1766268991 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff7d00b4ec0 0x7ff7d0162c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:15.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.259+0000 7ff7ced9d640 1 -- 172.21.15.39:0/1766268991 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff7d00b4ec0 msgr2=0x7ff7d0162c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:15.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.259+0000 7ff7ced9d640 1 --2- 172.21.15.39:0/1766268991 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff7d00b4ec0 0x7ff7d0162c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.259+0000 7ff7ced9d640 1 -- 172.21.15.39:0/1766268991 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7d00d0ad0 msgr2=0x7ff7d00bb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:15.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.259+0000 7ff7ced9d640 1 --2- 172.21.15.39:0/1766268991 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7d00d0ad0 0x7ff7d00bb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.259+0000 7ff7ced9d640 1 -- 172.21.15.39:0/1766268991 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7d0161090 con 0x7ff7d00d15f0 2024-05-14T14:41:15.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.259+0000 7ff7ced9d640 1 --2- 172.21.15.39:0/1766268991 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7d00d15f0 0x7ff7d00bb680 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff7c800efc0 tx=0x7ff7c800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:15.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.259+0000 7ff7c6ffd640 1 -- 172.21.15.39:0/1766268991 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c8018020 con 0x7ff7d00d15f0 2024-05-14T14:41:15.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.259+0000 7ff7c6ffd640 1 -- 172.21.15.39:0/1766268991 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7c8014480 con 0x7ff7d00d15f0 2024-05-14T14:41:15.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.259+0000 7ff7d4b40640 1 -- 172.21.15.39:0/1766268991 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7d01f6a60 con 0x7ff7d00d15f0 2024-05-14T14:41:15.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.259+0000 7ff7c6ffd640 1 -- 172.21.15.39:0/1766268991 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c8009e60 con 0x7ff7d00d15f0 2024-05-14T14:41:15.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.259+0000 7ff7d4b40640 1 -- 172.21.15.39:0/1766268991 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7d01f7020 con 0x7ff7d00d15f0 2024-05-14T14:41:15.245 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.260+0000 7ff7d4b40640 1 -- 172.21.15.39:0/1766268991 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7d0161260 con 0x7ff7d00d15f0 2024-05-14T14:41:15.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.261+0000 7ff7c6ffd640 1 -- 172.21.15.39:0/1766268991 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7ff7c8005d10 con 0x7ff7d00d15f0 2024-05-14T14:41:15.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.262+0000 7ff7c6ffd640 1 --2- 172.21.15.39:0/1766268991 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7ff7b00762d0 0x7ff7b00787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:15.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.262+0000 7ff7c6ffd640 1 -- 172.21.15.39:0/1766268991 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7ff7c8098320 con 0x7ff7d00d15f0 2024-05-14T14:41:15.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.262+0000 7ff7ce59c640 1 --2- 172.21.15.39:0/1766268991 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7ff7b00762d0 0x7ff7b00787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:15.246 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.262+0000 7ff7ce59c640 1 --2- 172.21.15.39:0/1766268991 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7ff7b00762d0 0x7ff7b00787e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff7c0034000 tx=0x7ff7c002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:15.250 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.266+0000 7ff7c6ffd640 1 -- 172.21.15.39:0/1766268991 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7ff7c8022030 con 0x7ff7d00d15f0 2024-05-14T14:41:15.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.497+0000 7ff7d4b40640 1 -- 172.21.15.39:0/1766268991 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff7d00c9a10 con 0x7ff7d00d15f0 2024-05-14T14:41:15.481 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.497+0000 7ff7c6ffd640 1 -- 172.21.15.39:0/1766268991 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+73 (secure 0 0 0) 0x7ff7c8010040 con 0x7ff7d00d15f0 2024-05-14T14:41:15.481 INFO:teuthology.orchestra.run.smithi039.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-14T14:41:15.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.499+0000 7ff7d4b40640 1 -- 172.21.15.39:0/1766268991 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7ff7b00762d0 msgr2=0x7ff7b00787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:15.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.499+0000 7ff7d4b40640 1 --2- 172.21.15.39:0/1766268991 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7ff7b00762d0 0x7ff7b00787e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff7c0034000 tx=0x7ff7c002e000 comp rx=0 tx=0).stop 2024-05-14T14:41:15.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.499+0000 7ff7d4b40640 1 -- 172.21.15.39:0/1766268991 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7d00d15f0 msgr2=0x7ff7d00bb680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:15.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.499+0000 7ff7d4b40640 1 --2- 172.21.15.39:0/1766268991 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7d00d15f0 0x7ff7d00bb680 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff7c800efc0 tx=0x7ff7c800c490 comp rx=0 tx=0).stop 2024-05-14T14:41:15.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.499+0000 7ff7d4b40640 1 -- 172.21.15.39:0/1766268991 shutdown_connections 2024-05-14T14:41:15.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.499+0000 7ff7d4b40640 1 --2- 172.21.15.39:0/1766268991 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7ff7b00762d0 0x7ff7b00787e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.483 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.499+0000 7ff7d4b40640 1 --2- 172.21.15.39:0/1766268991 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7ff7d00d15f0 0x7ff7d00bb680 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.499+0000 7ff7d4b40640 1 --2- 172.21.15.39:0/1766268991 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff7d00d0ad0 0x7ff7d00bb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.499+0000 7ff7d4b40640 1 --2- 172.21.15.39:0/1766268991 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7ff7d00b4ec0 0x7ff7d0162c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:15.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.499+0000 7ff7d4b40640 1 -- 172.21.15.39:0/1766268991 >> 172.21.15.39:0/1766268991 conn(0x7ff7d006f270 msgr2=0x7ff7d00b9d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:15.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.499+0000 7ff7d4b40640 1 -- 172.21.15.39:0/1766268991 shutdown_connections 2024-05-14T14:41:15.484 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15.499+0000 7ff7d4b40640 1 -- 172.21.15.39:0/1766268991 wait complete. 2024-05-14T14:41:15.494 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-14T14:41:15.495 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-14T14:41:15.495 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi039.front.sepia.ceph.com 2024-05-14T14:41:15.495 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-14T14:41:15.495 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-14T14:41:15.495 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-14T14:41:15.495 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-05-14T14:41:15.495 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-14T14:41:15.495 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-14T14:41:15.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:41:15.495 DEBUG:teuthology.orchestra.run.smithi039:> ip addr 2024-05-14T14:41:15.512 INFO:teuthology.orchestra.run.smithi039.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-14T14:41:15.512 INFO:teuthology.orchestra.run.smithi039.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-14T14:41:15.512 INFO:teuthology.orchestra.run.smithi039.stdout: inet 127.0.0.1/8 scope host lo 2024-05-14T14:41:15.512 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:41:15.512 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 ::1/128 scope host 2024-05-14T14:41:15.512 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:41:15.512 INFO:teuthology.orchestra.run.smithi039.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T14:41:15.512 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c6 brd ff:ff:ff:ff:ff:ff 2024-05-14T14:41:15.512 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f0 2024-05-14T14:41:15.513 INFO:teuthology.orchestra.run.smithi039.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T14:41:15.513 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:6b:fe:c7 brd ff:ff:ff:ff:ff:ff 2024-05-14T14:41:15.513 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp7s0f1 2024-05-14T14:41:15.513 INFO:teuthology.orchestra.run.smithi039.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-14T14:41:15.513 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:70 brd ff:ff:ff:ff:ff:ff 2024-05-14T14:41:15.513 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f0 2024-05-14T14:41:15.513 INFO:teuthology.orchestra.run.smithi039.stdout: inet 172.21.15.39/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-05-14T14:41:15.513 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft 42660sec preferred_lft 42660sec 2024-05-14T14:41:15.513 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::ec4:7aff:febd:1370/64 scope link noprefixroute 2024-05-14T14:41:15.513 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:41:15.513 INFO:teuthology.orchestra.run.smithi039.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T14:41:15.513 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether 0c:c4:7a:bd:13:71 brd ff:ff:ff:ff:ff:ff 2024-05-14T14:41:15.513 INFO:teuthology.orchestra.run.smithi039.stdout: altname enp1s0f1 2024-05-14T14:41:15.513 INFO:teuthology.orchestra.run.smithi039.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-05-14T14:41:15.513 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether e2:d7:c3:91:1f:99 brd ff:ff:ff:ff:ff:ff 2024-05-14T14:41:15.514 INFO:teuthology.orchestra.run.smithi039.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-05-14T14:41:15.514 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:41:15.514 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::54b2:efff:fe0a:f860/64 scope link 2024-05-14T14:41:15.514 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:41:15.514 INFO:teuthology.orchestra.run.smithi039.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-14T14:41:15.514 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether e2:d7:c3:91:1f:99 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-14T14:41:15.514 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::e0d7:c3ff:fe91:1f99/64 scope link 2024-05-14T14:41:15.514 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:41:15.514 INFO:teuthology.orchestra.run.smithi039.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-05-14T14:41:15.514 INFO:teuthology.orchestra.run.smithi039.stdout: link/ether e6:fe:0d:21:ed:12 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-05-14T14:41:15.514 INFO:teuthology.orchestra.run.smithi039.stdout: inet6 fe80::e4fe:dff:fe21:ed12/64 scope link 2024-05-14T14:41:15.514 INFO:teuthology.orchestra.run.smithi039.stdout: valid_lft forever preferred_lft forever 2024-05-14T14:41:15.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:41:15.518 DEBUG:teuthology.orchestra.run.smithi039:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-14T14:41:15.576 INFO:teuthology.orchestra.run.smithi039.stdout:1 2024-05-14T14:41:15.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:41:15.578 DEBUG:teuthology.orchestra.run.smithi039:> route 2024-05-14T14:41:15.635 INFO:teuthology.orchestra.run.smithi039.stdout:Kernel IP routing table 2024-05-14T14:41:15.635 INFO:teuthology.orchestra.run.smithi039.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-14T14:41:15.635 INFO:teuthology.orchestra.run.smithi039.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-14T14:41:15.635 INFO:teuthology.orchestra.run.smithi039.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-14T14:41:15.635 INFO:teuthology.orchestra.run.smithi039.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-14T14:41:15.636 DEBUG:teuthology.orchestra.run.smithi039:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T14:41:15.636 DEBUG:teuthology.orchestra.run.smithi039:> set -e 2024-05-14T14:41:15.636 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-14T14:41:15.636 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-14T14:41:15.636 DEBUG:teuthology.orchestra.run.smithi039:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-14T14:41:15.636 DEBUG:teuthology.orchestra.run.smithi039:> ') 2024-05-14T14:41:15.726 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T14:41:15.759 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:41:15.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:41:15.766 DEBUG:teuthology.orchestra.run.smithi039:> ip netns list 2024-05-14T14:41:15.782 INFO:teuthology.orchestra.run.smithi039.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-05-14T14:41:15.782 INFO:teuthology.orchestra.run.smithi039.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-14T14:41:15.783 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-14T14:41:15.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:41:15.783 DEBUG:teuthology.orchestra.run.smithi039:> sudo ip link set brx.0 up 2024-05-14T14:41:15.849 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T14:41:15.849 DEBUG:teuthology.orchestra.run.smithi039:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-14T14:41:15.904 INFO:teuthology.orchestra.run.smithi039.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-14T14:41:15.905 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T14:41:15.905 DEBUG:teuthology.orchestra.run.smithi039:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-14T14:41:15.961 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-05-14T14:41:15.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:41:15.961 DEBUG:teuthology.orchestra.run.smithi039:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-14T14:41:16.056 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-14T14:41:16.056 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-14T14:41:16.065 INFO:teuthology.orchestra.run.smithi039.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-14T14:41:16.124 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-14T14:41:16.124 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: resolved to: "172.21.15.39:3300,172.21.15.62:3300,172.21.15.62:3301" 2024-05-14T14:41:16.124 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: trying mount with new device syntax: 0@d7983fec-79c7-4991-b19c-1aecead64611.cephfs=/ 2024-05-14T14:41:16.124 INFO:teuthology.orchestra.run.smithi039.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.39:3300/172.21.15.62:3300/172.21.15.62:3301" will pass to kernel 2024-05-14T14:41:16.126 INFO:teuthology.orchestra.run.smithi039.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-05-14T14:41:16.126 INFO:teuthology.orchestra.run.smithi039.stdout: You just mounted a file system that supports labels which does not 2024-05-14T14:41:16.126 INFO:teuthology.orchestra.run.smithi039.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-05-14T14:41:16.126 INFO:teuthology.orchestra.run.smithi039.stdout: applications will generate AVC messages and not be allowed access to 2024-05-14T14:41:16.126 INFO:teuthology.orchestra.run.smithi039.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-05-14T14:41:16.126 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-14T14:41:16.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:41:16.126 DEBUG:teuthology.orchestra.run.smithi039:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-14T14:41:16.153 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-14T14:41:16.247 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-14T14:41:16.255 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T14:41:16.260 INFO:teuthology.orchestra.run.smithi039.stdout:client5082 2024-05-14T14:41:16.261 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T14:41:16.261 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T14:41:16.277 DEBUG:teuthology.orchestra.run.smithi039:> mktemp -d --suffix=xfstests-dev 2024-05-14T14:41:16.333 INFO:teuthology.orchestra.run.smithi039.stdout:/tmp/tmp.BmtVWB36S6xfstests-dev 2024-05-14T14:41:16.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:41:16.333 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.BmtVWB36S6xfstests-dev) 2024-05-14T14:41:16.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:41:16.402 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.BmtVWB36S6xfstests-dev) 2024-05-14T14:41:16.462 INFO:teuthology.orchestra.run.smithi039.stderr:Cloning into '/tmp/tmp.BmtVWB36S6xfstests-dev'... 2024-05-14T14:41:17.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:41:17.212 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2024-05-14T14:41:17.275 DEBUG:teuthology.orchestra.run.smithi039:> mktemp -d --suffix=test 2024-05-14T14:41:17.333 INFO:teuthology.orchestra.run.smithi039.stdout:/tmp/tmp.kK5043bZVYtest 2024-05-14T14:41:17.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:41:17.334 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2024-05-14T14:41:17.392 DEBUG:teuthology.orchestra.run.smithi039:> mktemp -d --suffix=scratch 2024-05-14T14:41:17.448 INFO:teuthology.orchestra.run.smithi039.stdout:/tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:41:17.448 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9". 2024-05-14T14:41:17.448 DEBUG:teuthology.orchestra.run.smithi039:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs 2024-05-14T14:41:18.100 INFO:teuthology.orchestra.run.smithi039.stdout:Last metadata expiration check: 0:03:28 ago on Tue 14 May 2024 02:37:50 PM UTC. 2024-05-14T14:41:18.184 INFO:teuthology.orchestra.run.smithi039.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2024-05-14T14:41:18.184 INFO:teuthology.orchestra.run.smithi039.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2024-05-14T14:41:18.185 INFO:teuthology.orchestra.run.smithi039.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2024-05-14T14:41:18.186 INFO:teuthology.orchestra.run.smithi039.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2024-05-14T14:41:18.187 INFO:teuthology.orchestra.run.smithi039.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2024-05-14T14:41:18.189 INFO:teuthology.orchestra.run.smithi039.stdout:Package e2fsprogs-1.46.5-5.el9.x86_64 is already installed. 2024-05-14T14:41:18.190 INFO:teuthology.orchestra.run.smithi039.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2024-05-14T14:41:18.191 INFO:teuthology.orchestra.run.smithi039.stdout:Package gcc-11.4.1-3.el9.x86_64 is already installed. 2024-05-14T14:41:18.193 INFO:teuthology.orchestra.run.smithi039.stdout:Package git-2.43.0-1.el9.x86_64 is already installed. 2024-05-14T14:41:18.195 INFO:teuthology.orchestra.run.smithi039.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-14T14:41:18.196 INFO:teuthology.orchestra.run.smithi039.stdout:Package libaio-devel-0.3.111-13.el9.x86_64 is already installed. 2024-05-14T14:41:18.197 INFO:teuthology.orchestra.run.smithi039.stdout:Package libtool-2.4.6-45.el9.x86_64 is already installed. 2024-05-14T14:41:18.198 INFO:teuthology.orchestra.run.smithi039.stdout:Package libuuid-devel-2.37.4-18.el9.x86_64 is already installed. 2024-05-14T14:41:18.199 INFO:teuthology.orchestra.run.smithi039.stdout:Package lvm2-9:2.03.23-2.el9.x86_64 is already installed. 2024-05-14T14:41:18.200 INFO:teuthology.orchestra.run.smithi039.stdout:Package make-1:4.3-8.el9.x86_64 is already installed. 2024-05-14T14:41:18.201 INFO:teuthology.orchestra.run.smithi039.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2024-05-14T14:41:18.202 INFO:teuthology.orchestra.run.smithi039.stdout:Package python3-3.9.18-3.el9.x86_64 is already installed. 2024-05-14T14:41:18.202 INFO:teuthology.orchestra.run.smithi039.stdout:Package quota-1:4.06-6.el9.x86_64 is already installed. 2024-05-14T14:41:18.203 INFO:teuthology.orchestra.run.smithi039.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2024-05-14T14:41:18.206 INFO:teuthology.orchestra.run.smithi039.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-14T14:41:18.254 INFO:teuthology.orchestra.run.smithi039.stdout:Dependencies resolved. 2024-05-14T14:41:18.255 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2024-05-14T14:41:18.256 INFO:teuthology.orchestra.run.smithi039.stdout: Package Arch Version Repository Size 2024-05-14T14:41:18.256 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2024-05-14T14:41:18.256 INFO:teuthology.orchestra.run.smithi039.stdout:Installing: 2024-05-14T14:41:18.256 INFO:teuthology.orchestra.run.smithi039.stdout: dump x86_64 1:0.4-0.51.b47.el9 epel 88 k 2024-05-14T14:41:18.256 INFO:teuthology.orchestra.run.smithi039.stdout: fio x86_64 3.35-1.el9 appstream 6.2 M 2024-05-14T14:41:18.256 INFO:teuthology.orchestra.run.smithi039.stdout: gdbm-devel x86_64 1:1.23-1.el9 crb 81 k 2024-05-14T14:41:18.256 INFO:teuthology.orchestra.run.smithi039.stdout: indent x86_64 2.2.13-5.el9 epel 179 k 2024-05-14T14:41:18.256 INFO:teuthology.orchestra.run.smithi039.stdout: kernel-devel x86_64 5.14.0-446.el9 appstream 16 M 2024-05-14T14:41:18.256 INFO:teuthology.orchestra.run.smithi039.stdout: libcap-devel x86_64 2.48-9.el9 appstream 41 k 2024-05-14T14:41:18.256 INFO:teuthology.orchestra.run.smithi039.stdout: sqlite x86_64 3.34.1-7.el9 appstream 748 k 2024-05-14T14:41:18.256 INFO:teuthology.orchestra.run.smithi039.stdout: udftools x86_64 2.2-5.el9 appstream 149 k 2024-05-14T14:41:18.256 INFO:teuthology.orchestra.run.smithi039.stdout:Upgrading: 2024-05-14T14:41:18.256 INFO:teuthology.orchestra.run.smithi039.stdout: gdbm-libs x86_64 1:1.23-1.el9 baseos 56 k 2024-05-14T14:41:18.256 INFO:teuthology.orchestra.run.smithi039.stdout:Installing dependencies: 2024-05-14T14:41:18.257 INFO:teuthology.orchestra.run.smithi039.stdout: gdbm x86_64 1:1.23-1.el9 crb 153 k 2024-05-14T14:41:18.257 INFO:teuthology.orchestra.run.smithi039.stdout: libnbd x86_64 1.18.1-3.el9 appstream 166 k 2024-05-14T14:41:18.257 INFO:teuthology.orchestra.run.smithi039.stdout: rmt x86_64 2:1.6-6.el9 baseos 46 k 2024-05-14T14:41:18.257 INFO:teuthology.orchestra.run.smithi039.stdout:Installing weak dependencies: 2024-05-14T14:41:18.257 INFO:teuthology.orchestra.run.smithi039.stdout: fio-engine-http x86_64 3.35-1.el9 appstream 18 k 2024-05-14T14:41:18.257 INFO:teuthology.orchestra.run.smithi039.stdout: fio-engine-libaio x86_64 3.35-1.el9 appstream 16 k 2024-05-14T14:41:18.257 INFO:teuthology.orchestra.run.smithi039.stdout: fio-engine-nbd x86_64 3.35-1.el9 appstream 15 k 2024-05-14T14:41:18.257 INFO:teuthology.orchestra.run.smithi039.stdout: fio-engine-rados x86_64 3.35-1.el9 appstream 16 k 2024-05-14T14:41:18.257 INFO:teuthology.orchestra.run.smithi039.stdout: fio-engine-rbd x86_64 3.35-1.el9 appstream 16 k 2024-05-14T14:41:18.257 INFO:teuthology.orchestra.run.smithi039.stdout: fio-engine-rdma x86_64 3.35-1.el9 appstream 21 k 2024-05-14T14:41:18.257 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:41:18.257 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction Summary 2024-05-14T14:41:18.257 INFO:teuthology.orchestra.run.smithi039.stdout:================================================================================ 2024-05-14T14:41:18.258 INFO:teuthology.orchestra.run.smithi039.stdout:Install 17 Packages 2024-05-14T14:41:18.258 INFO:teuthology.orchestra.run.smithi039.stdout:Upgrade 1 Package 2024-05-14T14:41:18.258 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:41:18.258 INFO:teuthology.orchestra.run.smithi039.stdout:Total download size: 24 M 2024-05-14T14:41:18.258 INFO:teuthology.orchestra.run.smithi039.stdout:Downloading Packages: 2024-05-14T14:41:18.978 INFO:teuthology.orchestra.run.smithi039.stdout:(1/18): fio-engine-http-3.35-1.el9.x86_64.rpm 141 kB/s | 18 kB 00:00 2024-05-14T14:41:19.029 INFO:teuthology.orchestra.run.smithi039.stdout:(2/18): fio-engine-libaio-3.35-1.el9.x86_64.rpm 313 kB/s | 16 kB 00:00 2024-05-14T14:41:19.087 INFO:teuthology.orchestra.run.smithi039.stdout:(3/18): fio-engine-nbd-3.35-1.el9.x86_64.rpm 250 kB/s | 15 kB 00:00 2024-05-14T14:41:19.146 INFO:teuthology.orchestra.run.smithi039.stdout:(4/18): fio-engine-rados-3.35-1.el9.x86_64.rpm 308 kB/s | 16 kB 00:00 2024-05-14T14:41:19.196 INFO:teuthology.orchestra.run.smithi039.stdout:(5/18): fio-engine-rbd-3.35-1.el9.x86_64.rpm 324 kB/s | 16 kB 00:00 2024-05-14T14:41:19.247 INFO:teuthology.orchestra.run.smithi039.stdout:(6/18): fio-engine-rdma-3.35-1.el9.x86_64.rpm 412 kB/s | 21 kB 00:00 2024-05-14T14:41:19.472 INFO:teuthology.orchestra.run.smithi039.stdout:(7/18): rmt-1.6-6.el9.x86_64.rpm 74 kB/s | 46 kB 00:00 2024-05-14T14:41:19.581 INFO:teuthology.orchestra.run.smithi039.stdout:(8/18): libcap-devel-2.48-9.el9.x86_64.rpm 376 kB/s | 41 kB 00:00 2024-05-14T14:41:19.698 INFO:teuthology.orchestra.run.smithi039.stdout:(9/18): libnbd-1.18.1-3.el9.x86_64.rpm 1.4 MB/s | 166 kB 00:00 2024-05-14T14:41:19.850 INFO:teuthology.orchestra.run.smithi039.stdout:(10/18): fio-3.35-1.el9.x86_64.rpm 6.2 MB/s | 6.2 MB 00:00 2024-05-14T14:41:19.892 INFO:teuthology.orchestra.run.smithi039.stdout:(11/18): sqlite-3.34.1-7.el9.x86_64.rpm 3.8 MB/s | 748 kB 00:00 2024-05-14T14:41:20.017 INFO:teuthology.orchestra.run.smithi039.stdout:(12/18): udftools-2.2-5.el9.x86_64.rpm 895 kB/s | 149 kB 00:00 2024-05-14T14:41:20.634 INFO:teuthology.orchestra.run.smithi039.stdout:(13/18): gdbm-1.23-1.el9.x86_64.rpm 206 kB/s | 153 kB 00:00 2024-05-14T14:41:20.676 INFO:teuthology.orchestra.run.smithi039.stdout:(14/18): gdbm-devel-1.23-1.el9.x86_64.rpm 122 kB/s | 81 kB 00:00 2024-05-14T14:41:20.910 INFO:teuthology.orchestra.run.smithi039.stdout:(15/18): dump-0.4-0.51.b47.el9.x86_64.rpm 320 kB/s | 88 kB 00:00 2024-05-14T14:41:21.018 INFO:teuthology.orchestra.run.smithi039.stdout:(16/18): indent-2.2.13-5.el9.x86_64.rpm 525 kB/s | 179 kB 00:00 2024-05-14T14:41:21.452 INFO:teuthology.orchestra.run.smithi039.stdout:(17/18): kernel-devel-5.14.0-446.el9.x86_64.rpm 7.3 MB/s | 16 MB 00:02 2024-05-14T14:41:21.527 INFO:teuthology.orchestra.run.smithi039.stdout:(18/18): gdbm-libs-1.23-1.el9.x86_64.rpm 91 kB/s | 56 kB 00:00 2024-05-14T14:41:21.527 INFO:teuthology.orchestra.run.smithi039.stdout:-------------------------------------------------------------------------------- 2024-05-14T14:41:21.528 INFO:teuthology.orchestra.run.smithi039.stdout:Total 7.4 MB/s | 24 MB 00:03 2024-05-14T14:41:21.894 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction check 2024-05-14T14:41:21.956 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction check succeeded. 2024-05-14T14:41:21.956 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction test 2024-05-14T14:41:22.563 INFO:teuthology.orchestra.run.smithi039.stdout:Transaction test succeeded. 2024-05-14T14:41:22.563 INFO:teuthology.orchestra.run.smithi039.stdout:Running transaction 2024-05-14T14:41:23.656 INFO:teuthology.orchestra.run.smithi039.stdout: Preparing : 1/1 2024-05-14T14:41:23.735 INFO:teuthology.orchestra.run.smithi039.stdout: Upgrading : gdbm-libs-1:1.23-1.el9.x86_64 1/19 2024-05-14T14:41:23.780 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : gdbm-1:1.23-1.el9.x86_64 2/19 2024-05-14T14:41:23.807 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libnbd-1.18.1-3.el9.x86_64 3/19 2024-05-14T14:41:23.833 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 4/19 2024-05-14T14:41:23.858 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 5/19 2024-05-14T14:41:23.883 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 6/19 2024-05-14T14:41:23.909 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 7/19 2024-05-14T14:41:23.934 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 8/19 2024-05-14T14:41:24.094 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 9/19 2024-05-14T14:41:24.149 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : fio-3.35-1.el9.x86_64 10/19 2024-05-14T14:41:24.186 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : rmt-2:1.6-6.el9.x86_64 11/19 2024-05-14T14:41:24.216 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : dump-1:0.4-0.51.b47.el9.x86_64 12/19 2024-05-14T14:41:24.268 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : gdbm-devel-1:1.23-1.el9.x86_64 13/19 2024-05-14T14:41:24.311 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : indent-2.2.13-5.el9.x86_64 14/19 2024-05-14T14:41:24.359 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : udftools-2.2-5.el9.x86_64 15/19 2024-05-14T14:41:24.406 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : sqlite-3.34.1-7.el9.x86_64 16/19 2024-05-14T14:41:34.524 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : libcap-devel-2.48-9.el9.x86_64 17/19 2024-05-14T14:41:34.805 INFO:teuthology.orchestra.run.smithi039.stdout: Installing : kernel-devel-5.14.0-446.el9.x86_64 18/19 2024-05-14T14:41:42.429 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:41:42.432 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:41:46.137 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: kernel-devel-5.14.0-446.el9.x86_64 18/19 2024-05-14T14:41:46.228 INFO:teuthology.orchestra.run.smithi039.stdout: Cleanup : gdbm-libs-1:1.19-4.el9.x86_64 19/19 2024-05-14T14:41:48.369 INFO:teuthology.orchestra.run.smithi039.stdout: Running scriptlet: gdbm-libs-1:1.19-4.el9.x86_64 19/19 2024-05-14T14:41:48.369 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : rmt-2:1.6-6.el9.x86_64 1/19 2024-05-14T14:41:48.369 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : fio-3.35-1.el9.x86_64 2/19 2024-05-14T14:41:48.369 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 3/19 2024-05-14T14:41:48.369 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 4/19 2024-05-14T14:41:48.370 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 5/19 2024-05-14T14:41:48.370 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 6/19 2024-05-14T14:41:48.370 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 7/19 2024-05-14T14:41:48.370 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 8/19 2024-05-14T14:41:48.370 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : kernel-devel-5.14.0-446.el9.x86_64 9/19 2024-05-14T14:41:48.370 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libcap-devel-2.48-9.el9.x86_64 10/19 2024-05-14T14:41:48.370 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : libnbd-1.18.1-3.el9.x86_64 11/19 2024-05-14T14:41:48.370 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : sqlite-3.34.1-7.el9.x86_64 12/19 2024-05-14T14:41:48.370 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : udftools-2.2-5.el9.x86_64 13/19 2024-05-14T14:41:48.370 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : gdbm-1:1.23-1.el9.x86_64 14/19 2024-05-14T14:41:48.370 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : gdbm-devel-1:1.23-1.el9.x86_64 15/19 2024-05-14T14:41:48.370 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : dump-1:0.4-0.51.b47.el9.x86_64 16/19 2024-05-14T14:41:48.370 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : indent-2.2.13-5.el9.x86_64 17/19 2024-05-14T14:41:48.371 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : gdbm-libs-1:1.23-1.el9.x86_64 18/19 2024-05-14T14:41:48.804 INFO:teuthology.orchestra.run.smithi039.stdout: Verifying : gdbm-libs-1:1.19-4.el9.x86_64 19/19 2024-05-14T14:41:48.804 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:41:48.804 INFO:teuthology.orchestra.run.smithi039.stdout:Upgraded: 2024-05-14T14:41:48.804 INFO:teuthology.orchestra.run.smithi039.stdout: gdbm-libs-1:1.23-1.el9.x86_64 2024-05-14T14:41:48.804 INFO:teuthology.orchestra.run.smithi039.stdout:Installed: 2024-05-14T14:41:48.804 INFO:teuthology.orchestra.run.smithi039.stdout: dump-1:0.4-0.51.b47.el9.x86_64 fio-3.35-1.el9.x86_64 2024-05-14T14:41:48.804 INFO:teuthology.orchestra.run.smithi039.stdout: fio-engine-http-3.35-1.el9.x86_64 fio-engine-libaio-3.35-1.el9.x86_64 2024-05-14T14:41:48.804 INFO:teuthology.orchestra.run.smithi039.stdout: fio-engine-nbd-3.35-1.el9.x86_64 fio-engine-rados-3.35-1.el9.x86_64 2024-05-14T14:41:48.804 INFO:teuthology.orchestra.run.smithi039.stdout: fio-engine-rbd-3.35-1.el9.x86_64 fio-engine-rdma-3.35-1.el9.x86_64 2024-05-14T14:41:48.805 INFO:teuthology.orchestra.run.smithi039.stdout: gdbm-1:1.23-1.el9.x86_64 gdbm-devel-1:1.23-1.el9.x86_64 2024-05-14T14:41:48.805 INFO:teuthology.orchestra.run.smithi039.stdout: indent-2.2.13-5.el9.x86_64 kernel-devel-5.14.0-446.el9.x86_64 2024-05-14T14:41:48.805 INFO:teuthology.orchestra.run.smithi039.stdout: libcap-devel-2.48-9.el9.x86_64 libnbd-1.18.1-3.el9.x86_64 2024-05-14T14:41:48.805 INFO:teuthology.orchestra.run.smithi039.stdout: rmt-2:1.6-6.el9.x86_64 sqlite-3.34.1-7.el9.x86_64 2024-05-14T14:41:48.805 INFO:teuthology.orchestra.run.smithi039.stdout: udftools-2.2-5.el9.x86_64 2024-05-14T14:41:48.805 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:41:48.805 INFO:teuthology.orchestra.run.smithi039.stdout:Complete! 2024-05-14T14:41:49.265 DEBUG:teuthology.orchestra.run.smithi039:> sudo useradd -m fsgqa 2024-05-14T14:41:49.292 INFO:teuthology.orchestra.run.smithi039.stderr:useradd: user 'fsgqa' already exists 2024-05-14T14:41:49.293 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-05-14T14:41:49.294 DEBUG:teuthology.orchestra.run.smithi039:> sudo groupadd fsgqa 2024-05-14T14:41:49.360 INFO:teuthology.orchestra.run.smithi039.stderr:groupadd: group 'fsgqa' already exists 2024-05-14T14:41:49.362 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-05-14T14:41:49.362 DEBUG:teuthology.orchestra.run.smithi039:> sudo useradd fsgqa2 2024-05-14T14:41:50.139 DEBUG:teuthology.orchestra.run.smithi039:> sudo useradd 123456-fsgqa 2024-05-14T14:41:51.048 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2024-05-14T14:41:51.175 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.191+0000 7f1b79b1b640 1 Processor -- start 2024-05-14T14:41:51.176 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.191+0000 7f1b79b1b640 1 -- start start 2024-05-14T14:41:51.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.193+0000 7f1b79b1b640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1b7415c620 0x7f1b740b6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:51.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.193+0000 7f1b79b1b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1b740aff50 0x7f1b740b0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:51.178 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.193+0000 7f1b79b1b640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b740b49f0 con 0x7f1b7406cf30 2024-05-14T14:41:51.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.193+0000 7f1b79b1b640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f1b740b5320 con 0x7f1b7415c620 2024-05-14T14:41:51.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.193+0000 7f1b79b1b640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f1b740b4cd0 con 0x7f1b740aff50 2024-05-14T14:41:51.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.193+0000 7f1b737fe640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1b7415c620 0x7f1b740b6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:51.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.193+0000 7f1b72ffd640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f1b7406cf30 0x7f1b7406d340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:41790/0 (socket says 172.21.15.39:41790) 2024-05-14T14:41:51.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.193+0000 7f1b737fe640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f1b7415c620 0x7f1b740b6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60308/0 (socket says 172.21.15.39:60308) 2024-05-14T14:41:51.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.193+0000 7f1b72ffd640 1 -- 172.21.15.39:0/1533993065 learned_addr learned my addr 172.21.15.39:0/1533993065 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:41:51.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.193+0000 7f1b73fff640 1 --2- 172.21.15.39:0/1533993065 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1b740aff50 0x7f1b740b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:51.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.193+0000 7f1b737fe640 1 -- 172.21.15.39:0/1533993065 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1b740aff50 msgr2=0x7f1b740b0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:51.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.193+0000 7f1b737fe640 1 --2- 172.21.15.39:0/1533993065 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1b740aff50 0x7f1b740b0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:51.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.193+0000 7f1b737fe640 1 -- 172.21.15.39:0/1533993065 >> v1:172.21.15.39:6789/0 conn(0x7f1b7406cf30 legacy=0x7f1b7406d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:51.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.193+0000 7f1b737fe640 1 -- 172.21.15.39:0/1533993065 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b740b4fb0 con 0x7f1b7415c620 2024-05-14T14:41:51.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.193+0000 7f1b73fff640 1 --2- 172.21.15.39:0/1533993065 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1b740aff50 0x7f1b740b0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T14:41:51.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.194+0000 7f1b737fe640 1 --2- 172.21.15.39:0/1533993065 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b7415c620 0x7f1b740b6460 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1b640097a0 tx=0x7f1b6402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd0137ba41e26111 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:51.179 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.194+0000 7f1b727fc640 1 -- 172.21.15.39:0/1533993065 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b64037070 con 0x7f1b7415c620 2024-05-14T14:41:51.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.194+0000 7f1b727fc640 1 -- 172.21.15.39:0/1533993065 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b64032440 con 0x7f1b7415c620 2024-05-14T14:41:51.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.194+0000 7f1b727fc640 1 -- 172.21.15.39:0/1533993065 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b64032810 con 0x7f1b7415c620 2024-05-14T14:41:51.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.195+0000 7f1b79b1b640 1 -- 172.21.15.39:0/1533993065 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b7415c620 msgr2=0x7f1b740b6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:51.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.195+0000 7f1b79b1b640 1 --2- 172.21.15.39:0/1533993065 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b7415c620 0x7f1b740b6460 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1b640097a0 tx=0x7f1b6402a180 comp rx=0 tx=0).stop 2024-05-14T14:41:51.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.195+0000 7f1b79b1b640 1 -- 172.21.15.39:0/1533993065 shutdown_connections 2024-05-14T14:41:51.180 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.195+0000 7f1b79b1b640 1 --2- 172.21.15.39:0/1533993065 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1b740aff50 0x7f1b740b0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:51.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.195+0000 7f1b79b1b640 1 --2- 172.21.15.39:0/1533993065 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b7415c620 0x7f1b740b6460 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:51.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.195+0000 7f1b79b1b640 1 -- 172.21.15.39:0/1533993065 >> 172.21.15.39:0/1533993065 conn(0x7f1b740d1c80 msgr2=0x7f1b740d2090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:51.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.195+0000 7f1b79b1b640 1 -- 172.21.15.39:0/1533993065 shutdown_connections 2024-05-14T14:41:51.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.195+0000 7f1b79b1b640 1 -- 172.21.15.39:0/1533993065 wait complete. 2024-05-14T14:41:51.181 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.197+0000 7f1b79b1b640 1 Processor -- start 2024-05-14T14:41:51.182 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.198+0000 7f1b79b1b640 1 -- start start 2024-05-14T14:41:51.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.199+0000 7f1b79b1b640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b7406cf30 0x7f1b741f80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:51.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.199+0000 7f1b79b1b640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1b740aff50 0x7f1b7415abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:51.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.199+0000 7f1b79b1b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b7415c620 0x7f1b740b0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:51.184 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.199+0000 7f1b79b1b640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f1b740b5930 con 0x7f1b7406cf30 2024-05-14T14:41:51.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.199+0000 7f1b79b1b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f1b740b57b0 con 0x7f1b7415c620 2024-05-14T14:41:51.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.199+0000 7f1b79b1b640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f1b740b69a0 con 0x7f1b740aff50 2024-05-14T14:41:51.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.199+0000 7f1b737fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b7406cf30 0x7f1b741f80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:51.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.199+0000 7f1b737fe640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b7406cf30 0x7f1b741f80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60320/0 (socket says 172.21.15.39:60320) 2024-05-14T14:41:51.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.199+0000 7f1b737fe640 1 -- 172.21.15.39:0/3367723214 learned_addr learned my addr 172.21.15.39:0/3367723214 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:41:51.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.199+0000 7f1b73fff640 1 --2- 172.21.15.39:0/3367723214 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b7415c620 0x7f1b740b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:51.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.199+0000 7f1b737fe640 1 -- 172.21.15.39:0/3367723214 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1b740aff50 msgr2=0x7f1b7415abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:51.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.199+0000 7f1b737fe640 1 --2- 172.21.15.39:0/3367723214 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1b740aff50 0x7f1b7415abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:51.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.199+0000 7f1b737fe640 1 -- 172.21.15.39:0/3367723214 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b7415c620 msgr2=0x7f1b740b0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:51.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.199+0000 7f1b737fe640 1 --2- 172.21.15.39:0/3367723214 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b7415c620 0x7f1b740b0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:51.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.199+0000 7f1b737fe640 1 -- 172.21.15.39:0/3367723214 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b741f8b20 con 0x7f1b7406cf30 2024-05-14T14:41:51.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.200+0000 7f1b737fe640 1 --2- 172.21.15.39:0/3367723214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b7406cf30 0x7f1b741f80a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1b64035040 tx=0x7f1b640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:51.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.200+0000 7f1b5bfff640 1 -- 172.21.15.39:0/3367723214 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b64037040 con 0x7f1b7406cf30 2024-05-14T14:41:51.185 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.200+0000 7f1b5bfff640 1 -- 172.21.15.39:0/3367723214 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b64030770 con 0x7f1b7406cf30 2024-05-14T14:41:51.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.200+0000 7f1b79b1b640 1 -- 172.21.15.39:0/3367723214 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b741f8e00 con 0x7f1b7406cf30 2024-05-14T14:41:51.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.200+0000 7f1b5bfff640 1 -- 172.21.15.39:0/3367723214 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b64030b40 con 0x7f1b7406cf30 2024-05-14T14:41:51.186 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.200+0000 7f1b79b1b640 1 -- 172.21.15.39:0/3367723214 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b741f93c0 con 0x7f1b7406cf30 2024-05-14T14:41:51.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.201+0000 7f1b79b1b640 1 -- 172.21.15.39:0/3367723214 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b74076aa0 con 0x7f1b7406cf30 2024-05-14T14:41:51.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.202+0000 7f1b5bfff640 1 -- 172.21.15.39:0/3367723214 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f1b64044020 con 0x7f1b7406cf30 2024-05-14T14:41:51.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.202+0000 7f1b5bfff640 1 --2- 172.21.15.39:0/3367723214 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1b600762d0 0x7f1b600787e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:51.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.202+0000 7f1b5bfff640 1 -- 172.21.15.39:0/3367723214 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7f1b640b7d00 con 0x7f1b7406cf30 2024-05-14T14:41:51.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.202+0000 7f1b72ffd640 1 --2- 172.21.15.39:0/3367723214 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1b600762d0 0x7f1b600787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:51.187 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.203+0000 7f1b72ffd640 1 --2- 172.21.15.39:0/3367723214 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1b600762d0 0x7f1b600787e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1b68000f60 tx=0x7f1b68007a80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:51.191 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.207+0000 7f1b5bfff640 1 -- 172.21.15.39:0/3367723214 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f1b64032e20 con 0x7f1b7406cf30 2024-05-14T14:41:51.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.478+0000 7f1b79b1b640 1 -- 172.21.15.39:0/3367723214 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f1b740710b0 con 0x7f1b7406cf30 2024-05-14T14:41:51.463 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.478+0000 7f1b5bfff640 1 -- 172.21.15.39:0/3367723214 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+1277 (secure 0 0 0) 0x7f1b640813c0 con 0x7f1b7406cf30 2024-05-14T14:41:51.463 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:41:51.463 INFO:teuthology.orchestra.run.smithi039.stdout:{"epoch":1,"fsid":"d7983fec-79c7-4991-b19c-1aecead64611","modified":"2024-05-14T14:39:14.107016Z","created":"2024-05-14T14:39:14.107016Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.39:3300","nonce":0},{"type":"v1","addr":"172.21.15.39:6789","nonce":0}]},"addr":"172.21.15.39:6789/0","public_addr":"172.21.15.39:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3301","nonce":0},{"type":"v1","addr":"172.21.15.62:6790","nonce":0}]},"addr":"172.21.15.62:6790/0","public_addr":"172.21.15.62:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-05-14T14:41:51.463 INFO:teuthology.orchestra.run.smithi039.stderr:dumped monmap epoch 1 2024-05-14T14:41:51.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.481+0000 7f1b79b1b640 1 -- 172.21.15.39:0/3367723214 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1b600762d0 msgr2=0x7f1b600787e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:51.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.481+0000 7f1b79b1b640 1 --2- 172.21.15.39:0/3367723214 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1b600762d0 0x7f1b600787e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1b68000f60 tx=0x7f1b68007a80 comp rx=0 tx=0).stop 2024-05-14T14:41:51.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.481+0000 7f1b79b1b640 1 -- 172.21.15.39:0/3367723214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b7406cf30 msgr2=0x7f1b741f80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:51.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.481+0000 7f1b79b1b640 1 --2- 172.21.15.39:0/3367723214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b7406cf30 0x7f1b741f80a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1b64035040 tx=0x7f1b640046c0 comp rx=0 tx=0).stop 2024-05-14T14:41:51.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.481+0000 7f1b79b1b640 1 -- 172.21.15.39:0/3367723214 shutdown_connections 2024-05-14T14:41:51.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.481+0000 7f1b79b1b640 1 --2- 172.21.15.39:0/3367723214 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f1b600762d0 0x7f1b600787e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:51.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.481+0000 7f1b79b1b640 1 --2- 172.21.15.39:0/3367723214 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1b7415c620 0x7f1b740b0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:51.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.481+0000 7f1b79b1b640 1 --2- 172.21.15.39:0/3367723214 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f1b740aff50 0x7f1b7415abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:51.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.481+0000 7f1b79b1b640 1 --2- 172.21.15.39:0/3367723214 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f1b7406cf30 0x7f1b741f80a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:51.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.481+0000 7f1b79b1b640 1 -- 172.21.15.39:0/3367723214 >> 172.21.15.39:0/3367723214 conn(0x7f1b740d1c80 msgr2=0x7f1b740b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:51.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.481+0000 7f1b79b1b640 1 -- 172.21.15.39:0/3367723214 shutdown_connections 2024-05-14T14:41:51.466 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.481+0000 7f1b79b1b640 1 -- 172.21.15.39:0/3367723214 wait complete. 2024-05-14T14:41:51.479 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2024-05-14T14:41:51.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.612+0000 7f77452bd640 1 Processor -- start 2024-05-14T14:41:51.596 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.612+0000 7f77452bd640 1 -- start start 2024-05-14T14:41:51.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.613+0000 7f77452bd640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f77400ce470 0x7f774015e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:51.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.613+0000 7f77452bd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f77400d0870 0x7f77400d2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:51.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.613+0000 7f77452bd640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77400ce970 con 0x7f77400b6e90 2024-05-14T14:41:51.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.613+0000 7f77452bd640 1 -- --> v2:172.21.15.39:3300/0 -- mon_getmap magic: 0 -- 0x7f77400d24b0 con 0x7f77400ce470 2024-05-14T14:41:51.598 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.613+0000 7f77452bd640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 -- 0x7f77400cec50 con 0x7f77400d0870 2024-05-14T14:41:51.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.613+0000 7f773effd640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f77400ce470 0x7f774015e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:51.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.613+0000 7f773e7fc640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7f77400b6e90 0x7f77400d0160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:41800/0 (socket says 172.21.15.39:41800) 2024-05-14T14:41:51.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.613+0000 7f773e7fc640 1 -- 172.21.15.39:0/2244122006 learned_addr learned my addr 172.21.15.39:0/2244122006 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T14:41:51.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.613+0000 7f773effd640 1 --2- >> v2:172.21.15.39:3300/0 conn(0x7f77400ce470 0x7f774015e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60322/0 (socket says 172.21.15.39:60322) 2024-05-14T14:41:51.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.614+0000 7f773f7fe640 1 --2- 172.21.15.39:0/2244122006 >> v2:172.21.15.62:3300/0 conn(0x7f77400d0870 0x7f77400d2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:51.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.614+0000 7f773effd640 1 -- 172.21.15.39:0/2244122006 >> v2:172.21.15.62:3300/0 conn(0x7f77400d0870 msgr2=0x7f77400d2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T14:41:51.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.614+0000 7f773effd640 1 --2- 172.21.15.39:0/2244122006 >> v2:172.21.15.62:3300/0 conn(0x7f77400d0870 0x7f77400d2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:51.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.614+0000 7f773effd640 1 -- 172.21.15.39:0/2244122006 >> v1:172.21.15.39:6789/0 conn(0x7f77400b6e90 legacy=0x7f77400d0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:51.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.614+0000 7f773effd640 1 -- 172.21.15.39:0/2244122006 --> v2:172.21.15.39:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77400cef30 con 0x7f77400ce470 2024-05-14T14:41:51.599 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.614+0000 7f773dffb640 1 -- 172.21.15.39:0/2244122006 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4087886428 0 0) 0x7f77400ce970 con 0x7f77400b6e90 2024-05-14T14:41:51.600 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.614+0000 7f773effd640 1 --2- 172.21.15.39:0/2244122006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77400ce470 0x7f774015e030 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f77400ce1d0 tx=0x7f773002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92c7a1e6158fe096 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:51.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.615+0000 7f773dffb640 1 -- 172.21.15.39:0/2244122006 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7730037070 con 0x7f77400ce470 2024-05-14T14:41:51.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.615+0000 7f773dffb640 1 -- 172.21.15.39:0/2244122006 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7730032440 con 0x7f77400ce470 2024-05-14T14:41:51.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.615+0000 7f773dffb640 1 -- 172.21.15.39:0/2244122006 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f773002ae60 con 0x7f77400ce470 2024-05-14T14:41:51.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.615+0000 7f77452bd640 1 -- 172.21.15.39:0/2244122006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77400ce470 msgr2=0x7f774015e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:51.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.615+0000 7f77452bd640 1 --2- 172.21.15.39:0/2244122006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77400ce470 0x7f774015e030 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f77400ce1d0 tx=0x7f773002a110 comp rx=0 tx=0).stop 2024-05-14T14:41:51.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.615+0000 7f77452bd640 1 -- 172.21.15.39:0/2244122006 shutdown_connections 2024-05-14T14:41:51.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.615+0000 7f77452bd640 1 --2- 172.21.15.39:0/2244122006 >> v2:172.21.15.62:3300/0 conn(0x7f77400d0870 0x7f77400d2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:51.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.615+0000 7f77452bd640 1 --2- 172.21.15.39:0/2244122006 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77400ce470 0x7f774015e030 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:51.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.615+0000 7f77452bd640 1 -- 172.21.15.39:0/2244122006 >> 172.21.15.39:0/2244122006 conn(0x7f7740071660 msgr2=0x7f7740071a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:51.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.615+0000 7f77452bd640 1 -- 172.21.15.39:0/2244122006 shutdown_connections 2024-05-14T14:41:51.601 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.615+0000 7f77452bd640 1 -- 172.21.15.39:0/2244122006 wait complete. 2024-05-14T14:41:51.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.617+0000 7f77452bd640 1 Processor -- start 2024-05-14T14:41:51.602 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.617+0000 7f77452bd640 1 -- start start 2024-05-14T14:41:51.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.619+0000 7f77452bd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77400b6e90 0x7f77401557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:51.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.619+0000 7f77452bd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77400ce470 0x7f7740154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:51.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.619+0000 7f77452bd640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77400d0870 0x7f77400cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:51.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.619+0000 7f77452bd640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7f77400d0f20 con 0x7f77400b6e90 2024-05-14T14:41:51.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.619+0000 7f77452bd640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7f77400d0da0 con 0x7f77400ce470 2024-05-14T14:41:51.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.619+0000 7f77452bd640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7f7740161c50 con 0x7f77400d0870 2024-05-14T14:41:51.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.619+0000 7f773effd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77400b6e90 0x7f77401557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:51.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.619+0000 7f773effd640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77400b6e90 0x7f77401557e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:60332/0 (socket says 172.21.15.39:60332) 2024-05-14T14:41:51.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.619+0000 7f773effd640 1 -- 172.21.15.39:0/1480002131 learned_addr learned my addr 172.21.15.39:0/1480002131 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T14:41:51.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.619+0000 7f773f7fe640 1 --2- 172.21.15.39:0/1480002131 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77400d0870 0x7f77400cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:51.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.619+0000 7f773e7fc640 1 --2- 172.21.15.39:0/1480002131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77400ce470 0x7f7740154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:51.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.619+0000 7f773effd640 1 -- 172.21.15.39:0/1480002131 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77400d0870 msgr2=0x7f77400cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:51.605 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.619+0000 7f773effd640 1 --2- 172.21.15.39:0/1480002131 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77400d0870 0x7f77400cccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:51.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.619+0000 7f773effd640 1 -- 172.21.15.39:0/1480002131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77400ce470 msgr2=0x7f7740154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:51.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.619+0000 7f773effd640 1 --2- 172.21.15.39:0/1480002131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77400ce470 0x7f7740154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:51.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.619+0000 7f773effd640 1 -- 172.21.15.39:0/1480002131 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f774015e330 con 0x7f77400b6e90 2024-05-14T14:41:51.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.619+0000 7f773e7fc640 1 --2- 172.21.15.39:0/1480002131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77400ce470 0x7f7740154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T14:41:51.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.619+0000 7f773effd640 1 --2- 172.21.15.39:0/1480002131 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77400b6e90 0x7f77401557e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7730009890 tx=0x7f77300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:51.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.619+0000 7f77277fe640 1 -- 172.21.15.39:0/1480002131 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7730037040 con 0x7f77400b6e90 2024-05-14T14:41:51.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.619+0000 7f77277fe640 1 -- 172.21.15.39:0/1480002131 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7730042070 con 0x7f77400b6e90 2024-05-14T14:41:51.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.619+0000 7f77452bd640 1 -- 172.21.15.39:0/1480002131 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f774015e830 con 0x7f77400b6e90 2024-05-14T14:41:51.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.620+0000 7f77277fe640 1 -- 172.21.15.39:0/1480002131 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7730030bd0 con 0x7f77400b6e90 2024-05-14T14:41:51.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.620+0000 7f77452bd640 1 -- 172.21.15.39:0/1480002131 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f774015edf0 con 0x7f77400b6e90 2024-05-14T14:41:51.606 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.620+0000 7f77452bd640 1 -- 172.21.15.39:0/1480002131 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7740076aa0 con 0x7f77400b6e90 2024-05-14T14:41:51.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.621+0000 7f77277fe640 1 -- 172.21.15.39:0/1480002131 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7f7730047460 con 0x7f77400b6e90 2024-05-14T14:41:51.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.622+0000 7f77277fe640 1 --2- 172.21.15.39:0/1480002131 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f772c076300 0x7f772c078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T14:41:51.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.622+0000 7f77277fe640 1 -- 172.21.15.39:0/1480002131 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7f77300b8150 con 0x7f77400b6e90 2024-05-14T14:41:51.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.622+0000 7f773e7fc640 1 --2- 172.21.15.39:0/1480002131 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f772c076300 0x7f772c078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T14:41:51.607 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.622+0000 7f773e7fc640 1 --2- 172.21.15.39:0/1480002131 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f772c076300 0x7f772c078810 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f774015ccf0 tx=0x7f7734005bb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T14:41:51.610 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.626+0000 7f77277fe640 1 -- 172.21.15.39:0/1480002131 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7f773004c020 con 0x7f77400b6e90 2024-05-14T14:41:51.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.893+0000 7f77452bd640 1 -- 172.21.15.39:0/1480002131 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) -- 0x7f77400d1d40 con 0x7f77400b6e90 2024-05-14T14:41:51.878 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.894+0000 7f77277fe640 1 -- 172.21.15.39:0/1480002131 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v12) ==== 92+0+63 (secure 0 0 0) 0x7f7730032e20 con 0x7f77400b6e90 2024-05-14T14:41:51.878 INFO:teuthology.orchestra.run.smithi039.stdout:[client.admin] 2024-05-14T14:41:51.878 INFO:teuthology.orchestra.run.smithi039.stdout: key = AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== 2024-05-14T14:41:51.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.896+0000 7f77452bd640 1 -- 172.21.15.39:0/1480002131 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f772c076300 msgr2=0x7f772c078810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:51.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.896+0000 7f77452bd640 1 --2- 172.21.15.39:0/1480002131 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f772c076300 0x7f772c078810 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f774015ccf0 tx=0x7f7734005bb0 comp rx=0 tx=0).stop 2024-05-14T14:41:51.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.896+0000 7f77452bd640 1 -- 172.21.15.39:0/1480002131 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77400b6e90 msgr2=0x7f77401557e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T14:41:51.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.896+0000 7f77452bd640 1 --2- 172.21.15.39:0/1480002131 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77400b6e90 0x7f77401557e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7730009890 tx=0x7f77300046c0 comp rx=0 tx=0).stop 2024-05-14T14:41:51.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.896+0000 7f77452bd640 1 -- 172.21.15.39:0/1480002131 shutdown_connections 2024-05-14T14:41:51.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.896+0000 7f77452bd640 1 --2- 172.21.15.39:0/1480002131 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7f772c076300 0x7f772c078810 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:51.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.896+0000 7f77452bd640 1 --2- 172.21.15.39:0/1480002131 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7f77400d0870 0x7f77400cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:51.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.896+0000 7f77452bd640 1 --2- 172.21.15.39:0/1480002131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77400ce470 0x7f7740154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:51.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.896+0000 7f77452bd640 1 --2- 172.21.15.39:0/1480002131 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7f77400b6e90 0x7f77401557e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T14:41:51.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.896+0000 7f77452bd640 1 -- 172.21.15.39:0/1480002131 >> 172.21.15.39:0/1480002131 conn(0x7f7740071660 msgr2=0x7f77400d0160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T14:41:51.881 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.896+0000 7f77452bd640 1 -- 172.21.15.39:0/1480002131 shutdown_connections 2024-05-14T14:41:51.882 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T14:41:51.896+0000 7f77452bd640 1 -- 172.21.15.39:0/1480002131 wait complete. 2024-05-14T14:41:51.893 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T14:41:51.893 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/tmp/tmp.BmtVWB36S6xfstests-dev/local.config 2024-05-14T14:41:51.919 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.39:6789:/test export TEST_DIR=/tmp/tmp.kK5043bZVYtest export SCRATCH_DEV=172.21.15.39:6789:/scratch export SCRATCH_MNT=/tmp/tmp.gzlHp5CthUscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A==" 2024-05-14T14:41:51.919 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T14:41:51.919 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/tmp/tmp.BmtVWB36S6xfstests-dev/ceph.exclude 2024-05-14T14:41:51.986 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo make) 2024-05-14T14:41:52.062 INFO:teuthology.orchestra.run.smithi039.stdout:libtoolize -cfi 2024-05-14T14:41:52.473 INFO:teuthology.orchestra.run.smithi039.stdout:libtoolize: putting auxiliary files in '.'. 2024-05-14T14:41:52.473 INFO:teuthology.orchestra.run.smithi039.stdout:libtoolize: copying file './config.guess' 2024-05-14T14:41:52.476 INFO:teuthology.orchestra.run.smithi039.stdout:libtoolize: copying file './config.sub' 2024-05-14T14:41:52.480 INFO:teuthology.orchestra.run.smithi039.stdout:libtoolize: copying file './install-sh' 2024-05-14T14:41:52.484 INFO:teuthology.orchestra.run.smithi039.stdout:libtoolize: copying file './ltmain.sh' 2024-05-14T14:41:52.507 INFO:teuthology.orchestra.run.smithi039.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-05-14T14:41:52.508 INFO:teuthology.orchestra.run.smithi039.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-05-14T14:41:52.512 INFO:teuthology.orchestra.run.smithi039.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-05-14T14:41:52.517 INFO:teuthology.orchestra.run.smithi039.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-05-14T14:41:52.521 INFO:teuthology.orchestra.run.smithi039.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-05-14T14:41:52.526 INFO:teuthology.orchestra.run.smithi039.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-05-14T14:41:52.533 INFO:teuthology.orchestra.run.smithi039.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-05-14T14:41:52.534 INFO:teuthology.orchestra.run.smithi039.stdout:cp include/install-sh . 2024-05-14T14:41:52.535 INFO:teuthology.orchestra.run.smithi039.stdout:aclocal -I m4 2024-05-14T14:41:53.558 INFO:teuthology.orchestra.run.smithi039.stdout:autoheader 2024-05-14T14:41:53.861 INFO:teuthology.orchestra.run.smithi039.stdout:autoconf 2024-05-14T14:41:54.038 INFO:teuthology.orchestra.run.smithi039.stdout:./configure \ 2024-05-14T14:41:54.038 INFO:teuthology.orchestra.run.smithi039.stdout: --libexecdir=/usr/lib \ 2024-05-14T14:41:54.038 INFO:teuthology.orchestra.run.smithi039.stdout: --exec_prefix=/var/lib 2024-05-14T14:41:54.449 INFO:teuthology.orchestra.run.smithi039.stdout:checking build system type... x86_64-pc-linux-gnu 2024-05-14T14:41:54.449 INFO:teuthology.orchestra.run.smithi039.stdout:checking host system type... x86_64-pc-linux-gnu 2024-05-14T14:41:54.450 INFO:teuthology.orchestra.run.smithi039.stdout:checking how to print strings... printf 2024-05-14T14:41:54.451 INFO:teuthology.orchestra.run.smithi039.stdout:checking for gcc... gcc 2024-05-14T14:41:54.586 INFO:teuthology.orchestra.run.smithi039.stdout:checking whether the C compiler works... yes 2024-05-14T14:41:54.586 INFO:teuthology.orchestra.run.smithi039.stdout:checking for C compiler default output file name... a.out 2024-05-14T14:41:54.614 INFO:teuthology.orchestra.run.smithi039.stdout:checking for suffix of executables... 2024-05-14T14:41:54.702 INFO:teuthology.orchestra.run.smithi039.stdout:checking whether we are cross compiling... no 2024-05-14T14:41:54.720 INFO:teuthology.orchestra.run.smithi039.stdout:checking for suffix of object files... o 2024-05-14T14:41:54.736 INFO:teuthology.orchestra.run.smithi039.stdout:checking whether we are using the GNU C compiler... yes 2024-05-14T14:41:54.752 INFO:teuthology.orchestra.run.smithi039.stdout:checking whether gcc accepts -g... yes 2024-05-14T14:41:54.808 INFO:teuthology.orchestra.run.smithi039.stdout:checking for gcc option to accept ISO C89... none needed 2024-05-14T14:41:54.810 INFO:teuthology.orchestra.run.smithi039.stdout:checking for a sed that does not truncate output... /bin/sed 2024-05-14T14:41:54.812 INFO:teuthology.orchestra.run.smithi039.stdout:checking for grep that handles long lines and -e... /bin/grep 2024-05-14T14:41:54.813 INFO:teuthology.orchestra.run.smithi039.stdout:checking for egrep... /bin/grep -E 2024-05-14T14:41:54.815 INFO:teuthology.orchestra.run.smithi039.stdout:checking for fgrep... /bin/grep -F 2024-05-14T14:41:54.818 INFO:teuthology.orchestra.run.smithi039.stdout:checking for ld used by gcc... /bin/ld 2024-05-14T14:41:54.820 INFO:teuthology.orchestra.run.smithi039.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2024-05-14T14:41:54.831 INFO:teuthology.orchestra.run.smithi039.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2024-05-14T14:41:55.701 INFO:teuthology.orchestra.run.smithi039.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2024-05-14T14:41:55.701 INFO:teuthology.orchestra.run.smithi039.stdout:checking whether ln -s works... yes 2024-05-14T14:41:55.714 INFO:teuthology.orchestra.run.smithi039.stdout:checking the maximum length of command line arguments... 1572864 2024-05-14T14:41:55.718 INFO:teuthology.orchestra.run.smithi039.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-05-14T14:41:55.718 INFO:teuthology.orchestra.run.smithi039.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-05-14T14:41:55.718 INFO:teuthology.orchestra.run.smithi039.stdout:checking for /bin/ld option to reload object files... -r 2024-05-14T14:41:55.718 INFO:teuthology.orchestra.run.smithi039.stdout:checking for objdump... objdump 2024-05-14T14:41:55.718 INFO:teuthology.orchestra.run.smithi039.stdout:checking how to recognize dependent libraries... pass_all 2024-05-14T14:41:55.719 INFO:teuthology.orchestra.run.smithi039.stdout:checking for dlltool... no 2024-05-14T14:41:55.719 INFO:teuthology.orchestra.run.smithi039.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-05-14T14:41:55.719 INFO:teuthology.orchestra.run.smithi039.stdout:checking for ar... ar 2024-05-14T14:41:55.763 INFO:teuthology.orchestra.run.smithi039.stdout:checking for archiver @FILE support... @ 2024-05-14T14:41:55.763 INFO:teuthology.orchestra.run.smithi039.stdout:checking for strip... strip 2024-05-14T14:41:55.763 INFO:teuthology.orchestra.run.smithi039.stdout:checking for ranlib... ranlib 2024-05-14T14:41:55.763 INFO:teuthology.orchestra.run.smithi039.stdout:checking for gawk... gawk 2024-05-14T14:41:55.830 INFO:teuthology.orchestra.run.smithi039.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2024-05-14T14:41:55.831 INFO:teuthology.orchestra.run.smithi039.stdout:checking for sysroot... no 2024-05-14T14:41:55.834 INFO:teuthology.orchestra.run.smithi039.stdout:checking for a working dd... /bin/dd 2024-05-14T14:41:55.837 INFO:teuthology.orchestra.run.smithi039.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2024-05-14T14:41:55.850 INFO:teuthology.orchestra.run.smithi039.stdout:checking for mt... no 2024-05-14T14:41:55.852 INFO:teuthology.orchestra.run.smithi039.stdout:checking if : is a manifest tool... no 2024-05-14T14:41:55.908 INFO:teuthology.orchestra.run.smithi039.stdout:checking how to run the C preprocessor... gcc -E 2024-05-14T14:41:56.065 INFO:teuthology.orchestra.run.smithi039.stdout:checking for ANSI C header files... yes 2024-05-14T14:41:56.087 INFO:teuthology.orchestra.run.smithi039.stdout:checking for sys/types.h... yes 2024-05-14T14:41:56.112 INFO:teuthology.orchestra.run.smithi039.stdout:checking for sys/stat.h... yes 2024-05-14T14:41:56.137 INFO:teuthology.orchestra.run.smithi039.stdout:checking for stdlib.h... yes 2024-05-14T14:41:56.163 INFO:teuthology.orchestra.run.smithi039.stdout:checking for string.h... yes 2024-05-14T14:41:56.190 INFO:teuthology.orchestra.run.smithi039.stdout:checking for memory.h... yes 2024-05-14T14:41:56.215 INFO:teuthology.orchestra.run.smithi039.stdout:checking for strings.h... yes 2024-05-14T14:41:56.244 INFO:teuthology.orchestra.run.smithi039.stdout:checking for inttypes.h... yes 2024-05-14T14:41:56.270 INFO:teuthology.orchestra.run.smithi039.stdout:checking for stdint.h... yes 2024-05-14T14:41:56.300 INFO:teuthology.orchestra.run.smithi039.stdout:checking for unistd.h... yes 2024-05-14T14:41:56.327 INFO:teuthology.orchestra.run.smithi039.stdout:checking for dlfcn.h... yes 2024-05-14T14:41:56.330 INFO:teuthology.orchestra.run.smithi039.stdout:checking for objdir... .libs 2024-05-14T14:41:56.395 INFO:teuthology.orchestra.run.smithi039.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-05-14T14:41:56.396 INFO:teuthology.orchestra.run.smithi039.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-05-14T14:41:56.413 INFO:teuthology.orchestra.run.smithi039.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-05-14T14:41:56.442 INFO:teuthology.orchestra.run.smithi039.stdout:checking if gcc static flag -static works... no 2024-05-14T14:41:56.464 INFO:teuthology.orchestra.run.smithi039.stdout:checking if gcc supports -c -o file.o... yes 2024-05-14T14:41:56.464 INFO:teuthology.orchestra.run.smithi039.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-05-14T14:41:56.471 INFO:teuthology.orchestra.run.smithi039.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-05-14T14:41:56.498 INFO:teuthology.orchestra.run.smithi039.stdout:checking whether -lc should be explicitly linked in... no 2024-05-14T14:41:56.558 INFO:teuthology.orchestra.run.smithi039.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-05-14T14:41:56.558 INFO:teuthology.orchestra.run.smithi039.stdout:checking how to hardcode library paths into programs... immediate 2024-05-14T14:41:56.559 INFO:teuthology.orchestra.run.smithi039.stdout:checking whether stripping libraries is possible... yes 2024-05-14T14:41:56.559 INFO:teuthology.orchestra.run.smithi039.stdout:checking if libtool supports shared libraries... yes 2024-05-14T14:41:56.559 INFO:teuthology.orchestra.run.smithi039.stdout:checking whether to build shared libraries... yes 2024-05-14T14:41:56.559 INFO:teuthology.orchestra.run.smithi039.stdout:checking whether to build static libraries... yes 2024-05-14T14:41:56.565 INFO:teuthology.orchestra.run.smithi039.stdout:checking for gcc... (cached) gcc 2024-05-14T14:41:56.582 INFO:teuthology.orchestra.run.smithi039.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-05-14T14:41:56.582 INFO:teuthology.orchestra.run.smithi039.stdout:checking whether gcc accepts -g... (cached) yes 2024-05-14T14:41:56.582 INFO:teuthology.orchestra.run.smithi039.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-05-14T14:41:56.582 INFO:teuthology.orchestra.run.smithi039.stdout:checking for gmake... /usr/bin/gmake 2024-05-14T14:41:56.582 INFO:teuthology.orchestra.run.smithi039.stderr:./configure: line 12082: test: $(SHELL): binary operator expected 2024-05-14T14:41:56.583 INFO:teuthology.orchestra.run.smithi039.stdout:checking for tar... /bin/tar 2024-05-14T14:41:56.583 INFO:teuthology.orchestra.run.smithi039.stdout:checking for gzip... /bin/gzip 2024-05-14T14:41:56.602 INFO:teuthology.orchestra.run.smithi039.stdout:checking whether gcc -MM is supported... yes 2024-05-14T14:41:56.602 INFO:teuthology.orchestra.run.smithi039.stdout:checking for sort... /bin/sort 2024-05-14T14:41:56.602 INFO:teuthology.orchestra.run.smithi039.stdout:checking whether ln -s works... yes 2024-05-14T14:41:56.602 INFO:teuthology.orchestra.run.smithi039.stdout:checking for rpm... /bin/rpm 2024-05-14T14:41:56.605 INFO:teuthology.orchestra.run.smithi039.stdout:checking for rpmbuild... no 2024-05-14T14:41:56.631 INFO:teuthology.orchestra.run.smithi039.stdout:checking assert.h usability... yes 2024-05-14T14:41:56.640 INFO:teuthology.orchestra.run.smithi039.stdout:checking assert.h presence... yes 2024-05-14T14:41:56.640 INFO:teuthology.orchestra.run.smithi039.stdout:checking for assert.h... yes 2024-05-14T14:41:56.668 INFO:teuthology.orchestra.run.smithi039.stdout:checking bstring.h usability... no 2024-05-14T14:41:56.679 INFO:teuthology.orchestra.run.smithi039.stdout:checking bstring.h presence... no 2024-05-14T14:41:56.679 INFO:teuthology.orchestra.run.smithi039.stdout:checking for bstring.h... no 2024-05-14T14:41:56.706 INFO:teuthology.orchestra.run.smithi039.stdout:checking libgen.h usability... yes 2024-05-14T14:41:56.715 INFO:teuthology.orchestra.run.smithi039.stdout:checking libgen.h presence... yes 2024-05-14T14:41:56.715 INFO:teuthology.orchestra.run.smithi039.stdout:checking for libgen.h... yes 2024-05-14T14:41:56.745 INFO:teuthology.orchestra.run.smithi039.stdout:checking dirent.h usability... yes 2024-05-14T14:41:56.755 INFO:teuthology.orchestra.run.smithi039.stdout:checking dirent.h presence... yes 2024-05-14T14:41:56.755 INFO:teuthology.orchestra.run.smithi039.stdout:checking for dirent.h... yes 2024-05-14T14:41:56.808 INFO:teuthology.orchestra.run.smithi039.stdout:checking errno.h usability... yes 2024-05-14T14:41:56.817 INFO:teuthology.orchestra.run.smithi039.stdout:checking errno.h presence... yes 2024-05-14T14:41:56.817 INFO:teuthology.orchestra.run.smithi039.stdout:checking for errno.h... yes 2024-05-14T14:41:56.846 INFO:teuthology.orchestra.run.smithi039.stdout:checking malloc.h usability... yes 2024-05-14T14:41:56.856 INFO:teuthology.orchestra.run.smithi039.stdout:checking malloc.h presence... yes 2024-05-14T14:41:56.856 INFO:teuthology.orchestra.run.smithi039.stdout:checking for malloc.h... yes 2024-05-14T14:41:56.884 INFO:teuthology.orchestra.run.smithi039.stdout:checking uuid.h usability... no 2024-05-14T14:41:56.895 INFO:teuthology.orchestra.run.smithi039.stdout:checking uuid.h presence... no 2024-05-14T14:41:56.895 INFO:teuthology.orchestra.run.smithi039.stdout:checking for uuid.h... no 2024-05-14T14:41:56.924 INFO:teuthology.orchestra.run.smithi039.stdout:checking uuid/uuid.h usability... yes 2024-05-14T14:41:56.935 INFO:teuthology.orchestra.run.smithi039.stdout:checking uuid/uuid.h presence... yes 2024-05-14T14:41:56.935 INFO:teuthology.orchestra.run.smithi039.stdout:checking for uuid/uuid.h... yes 2024-05-14T14:41:56.963 INFO:teuthology.orchestra.run.smithi039.stdout:checking sys/uuid.h usability... no 2024-05-14T14:41:56.974 INFO:teuthology.orchestra.run.smithi039.stdout:checking sys/uuid.h presence... no 2024-05-14T14:41:56.975 INFO:teuthology.orchestra.run.smithi039.stdout:checking for sys/uuid.h... no 2024-05-14T14:41:57.002 INFO:teuthology.orchestra.run.smithi039.stdout:checking sys/file.h usability... yes 2024-05-14T14:41:57.011 INFO:teuthology.orchestra.run.smithi039.stdout:checking sys/file.h presence... yes 2024-05-14T14:41:57.011 INFO:teuthology.orchestra.run.smithi039.stdout:checking for sys/file.h... yes 2024-05-14T14:41:57.040 INFO:teuthology.orchestra.run.smithi039.stdout:checking sys/fcntl.h usability... yes 2024-05-14T14:41:57.050 INFO:teuthology.orchestra.run.smithi039.stdout:checking sys/fcntl.h presence... yes 2024-05-14T14:41:57.050 INFO:teuthology.orchestra.run.smithi039.stdout:checking for sys/fcntl.h... yes 2024-05-14T14:41:57.078 INFO:teuthology.orchestra.run.smithi039.stdout:checking sys/syssgi.h usability... no 2024-05-14T14:41:57.089 INFO:teuthology.orchestra.run.smithi039.stdout:checking sys/syssgi.h presence... no 2024-05-14T14:41:57.089 INFO:teuthology.orchestra.run.smithi039.stdout:checking for sys/syssgi.h... no 2024-05-14T14:41:57.131 INFO:teuthology.orchestra.run.smithi039.stdout:checking sys/param.h usability... yes 2024-05-14T14:41:57.143 INFO:teuthology.orchestra.run.smithi039.stdout:checking sys/param.h presence... yes 2024-05-14T14:41:57.143 INFO:teuthology.orchestra.run.smithi039.stdout:checking for sys/param.h... yes 2024-05-14T14:41:57.148 INFO:teuthology.orchestra.run.smithi039.stdout:checking for sys/stat.h... (cached) yes 2024-05-14T14:41:57.177 INFO:teuthology.orchestra.run.smithi039.stdout:checking sys/statvfs.h usability... yes 2024-05-14T14:41:57.186 INFO:teuthology.orchestra.run.smithi039.stdout:checking sys/statvfs.h presence... yes 2024-05-14T14:41:57.186 INFO:teuthology.orchestra.run.smithi039.stdout:checking for sys/statvfs.h... yes 2024-05-14T14:41:57.214 INFO:teuthology.orchestra.run.smithi039.stdout:checking sys/time.h usability... yes 2024-05-14T14:41:57.224 INFO:teuthology.orchestra.run.smithi039.stdout:checking sys/time.h presence... yes 2024-05-14T14:41:57.224 INFO:teuthology.orchestra.run.smithi039.stdout:checking for sys/time.h... yes 2024-05-14T14:41:57.261 INFO:teuthology.orchestra.run.smithi039.stdout:checking sys/ioctl.h usability... yes 2024-05-14T14:41:57.270 INFO:teuthology.orchestra.run.smithi039.stdout:checking sys/ioctl.h presence... yes 2024-05-14T14:41:57.270 INFO:teuthology.orchestra.run.smithi039.stdout:checking for sys/ioctl.h... yes 2024-05-14T14:41:57.306 INFO:teuthology.orchestra.run.smithi039.stdout:checking sys/wait.h usability... yes 2024-05-14T14:41:57.317 INFO:teuthology.orchestra.run.smithi039.stdout:checking sys/wait.h presence... yes 2024-05-14T14:41:57.317 INFO:teuthology.orchestra.run.smithi039.stdout:checking for sys/wait.h... yes 2024-05-14T14:41:57.322 INFO:teuthology.orchestra.run.smithi039.stdout:checking for sys/types.h... (cached) yes 2024-05-14T14:41:57.326 INFO:teuthology.orchestra.run.smithi039.stdout:checking for strings.h... (cached) yes 2024-05-14T14:41:57.355 INFO:teuthology.orchestra.run.smithi039.stdout:checking err.h usability... yes 2024-05-14T14:41:57.364 INFO:teuthology.orchestra.run.smithi039.stdout:checking err.h presence... yes 2024-05-14T14:41:57.364 INFO:teuthology.orchestra.run.smithi039.stdout:checking for err.h... yes 2024-05-14T14:41:57.399 INFO:teuthology.orchestra.run.smithi039.stdout:checking linux/falloc.h usability... yes 2024-05-14T14:41:57.407 INFO:teuthology.orchestra.run.smithi039.stdout:checking linux/falloc.h presence... yes 2024-05-14T14:41:57.407 INFO:teuthology.orchestra.run.smithi039.stdout:checking for linux/falloc.h... yes 2024-05-14T14:41:57.436 INFO:teuthology.orchestra.run.smithi039.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-05-14T14:41:57.447 INFO:teuthology.orchestra.run.smithi039.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-05-14T14:41:57.447 INFO:teuthology.orchestra.run.smithi039.stdout:checking for sys/fs/xfs_fsops.h... no 2024-05-14T14:41:57.472 INFO:teuthology.orchestra.run.smithi039.stdout:checking sys/fs/xfs_itable.h usability... no 2024-05-14T14:41:57.484 INFO:teuthology.orchestra.run.smithi039.stdout:checking sys/fs/xfs_itable.h presence... no 2024-05-14T14:41:57.484 INFO:teuthology.orchestra.run.smithi039.stdout:checking for sys/fs/xfs_itable.h... no 2024-05-14T14:41:57.509 INFO:teuthology.orchestra.run.smithi039.stdout:checking xfs/platform_defs.h usability... no 2024-05-14T14:41:57.520 INFO:teuthology.orchestra.run.smithi039.stdout:checking xfs/platform_defs.h presence... no 2024-05-14T14:41:57.520 INFO:teuthology.orchestra.run.smithi039.stdout:checking for xfs/platform_defs.h... no 2024-05-14T14:41:57.545 INFO:teuthology.orchestra.run.smithi039.stdout:checking btrfs/ioctl.h usability... no 2024-05-14T14:41:57.557 INFO:teuthology.orchestra.run.smithi039.stdout:checking btrfs/ioctl.h presence... no 2024-05-14T14:41:57.557 INFO:teuthology.orchestra.run.smithi039.stdout:checking for btrfs/ioctl.h... no 2024-05-14T14:41:57.582 INFO:teuthology.orchestra.run.smithi039.stdout:checking cifs/ioctl.h usability... no 2024-05-14T14:41:57.594 INFO:teuthology.orchestra.run.smithi039.stdout:checking cifs/ioctl.h presence... no 2024-05-14T14:41:57.594 INFO:teuthology.orchestra.run.smithi039.stdout:checking for cifs/ioctl.h... no 2024-05-14T14:41:57.631 INFO:teuthology.orchestra.run.smithi039.stdout:checking sys/mman.h usability... yes 2024-05-14T14:41:57.640 INFO:teuthology.orchestra.run.smithi039.stdout:checking sys/mman.h presence... yes 2024-05-14T14:41:57.640 INFO:teuthology.orchestra.run.smithi039.stdout:checking for sys/mman.h... yes 2024-05-14T14:41:57.668 INFO:teuthology.orchestra.run.smithi039.stdout:checking linux/ext4.h usability... no 2024-05-14T14:41:57.679 INFO:teuthology.orchestra.run.smithi039.stdout:checking linux/ext4.h presence... no 2024-05-14T14:41:57.680 INFO:teuthology.orchestra.run.smithi039.stdout:checking for linux/ext4.h... no 2024-05-14T14:41:57.692 INFO:teuthology.orchestra.run.smithi039.stdout:checking for xfs/xfs_log_format.h... no 2024-05-14T14:41:57.739 INFO:teuthology.orchestra.run.smithi039.stdout:checking for uuid_compare... no 2024-05-14T14:41:57.771 INFO:teuthology.orchestra.run.smithi039.stdout:checking for uuid_compare in -luuid... yes 2024-05-14T14:41:57.829 INFO:teuthology.orchestra.run.smithi039.stdout:checking for xfs/xfs.h... yes 2024-05-14T14:41:57.843 INFO:teuthology.orchestra.run.smithi039.stdout:checking for xfs/libxfs.h... no 2024-05-14T14:41:57.859 INFO:teuthology.orchestra.run.smithi039.stdout:checking whether xlog_assign_lsn is declared... no 2024-05-14T14:41:57.890 INFO:teuthology.orchestra.run.smithi039.stdout:checking for xfs/xqm.h... yes 2024-05-14T14:41:57.941 INFO:teuthology.orchestra.run.smithi039.stdout:checking xfsctl from xfs/xfs.h... ok 2024-05-14T14:41:57.966 INFO:teuthology.orchestra.run.smithi039.stdout:checking xfs/handle.h usability... yes 2024-05-14T14:41:57.974 INFO:teuthology.orchestra.run.smithi039.stdout:checking xfs/handle.h presence... yes 2024-05-14T14:41:57.974 INFO:teuthology.orchestra.run.smithi039.stdout:checking for xfs/handle.h... yes 2024-05-14T14:41:58.017 INFO:teuthology.orchestra.run.smithi039.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-05-14T14:41:58.069 INFO:teuthology.orchestra.run.smithi039.stdout:checking sys/acl.h usability... yes 2024-05-14T14:41:58.079 INFO:teuthology.orchestra.run.smithi039.stdout:checking sys/acl.h presence... yes 2024-05-14T14:41:58.080 INFO:teuthology.orchestra.run.smithi039.stdout:checking for sys/acl.h... yes 2024-05-14T14:41:58.202 INFO:teuthology.orchestra.run.smithi039.stdout:checking acl/libacl.h usability... yes 2024-05-14T14:41:58.212 INFO:teuthology.orchestra.run.smithi039.stdout:checking acl/libacl.h presence... yes 2024-05-14T14:41:58.212 INFO:teuthology.orchestra.run.smithi039.stdout:checking for acl/libacl.h... yes 2024-05-14T14:41:58.246 INFO:teuthology.orchestra.run.smithi039.stdout:checking for acl_init in -lacl... yes 2024-05-14T14:41:58.270 INFO:teuthology.orchestra.run.smithi039.stdout:checking gdbm-ndbm.h usability... no 2024-05-14T14:41:58.282 INFO:teuthology.orchestra.run.smithi039.stdout:checking gdbm-ndbm.h presence... no 2024-05-14T14:41:58.282 INFO:teuthology.orchestra.run.smithi039.stdout:checking for gdbm-ndbm.h... no 2024-05-14T14:41:58.306 INFO:teuthology.orchestra.run.smithi039.stdout:checking gdbm/ndbm.h usability... yes 2024-05-14T14:41:58.318 INFO:teuthology.orchestra.run.smithi039.stdout:checking gdbm/ndbm.h presence... yes 2024-05-14T14:41:58.318 INFO:teuthology.orchestra.run.smithi039.stdout:checking for gdbm/ndbm.h... yes 2024-05-14T14:41:58.354 INFO:teuthology.orchestra.run.smithi039.stdout:checking for dbm_open in -lgdbm... no 2024-05-14T14:41:58.391 INFO:teuthology.orchestra.run.smithi039.stdout:checking for dbm_fetch in -lgdbm... no 2024-05-14T14:41:58.428 INFO:teuthology.orchestra.run.smithi039.stdout:checking for dbm_store in -lgdbm... no 2024-05-14T14:41:58.464 INFO:teuthology.orchestra.run.smithi039.stdout:checking for dbm_close in -lgdbm... no 2024-05-14T14:41:58.497 INFO:teuthology.orchestra.run.smithi039.stdout:checking for dbm_open in -lgdbm_compat... yes 2024-05-14T14:41:58.530 INFO:teuthology.orchestra.run.smithi039.stdout:checking for dbm_fetch in -lgdbm_compat... yes 2024-05-14T14:41:58.563 INFO:teuthology.orchestra.run.smithi039.stdout:checking for dbm_store in -lgdbm_compat... yes 2024-05-14T14:41:58.597 INFO:teuthology.orchestra.run.smithi039.stdout:checking for dbm_close in -lgdbm_compat... yes 2024-05-14T14:41:58.622 INFO:teuthology.orchestra.run.smithi039.stdout:checking libaio.h usability... yes 2024-05-14T14:41:58.633 INFO:teuthology.orchestra.run.smithi039.stdout:checking libaio.h presence... yes 2024-05-14T14:41:58.633 INFO:teuthology.orchestra.run.smithi039.stdout:checking for libaio.h... yes 2024-05-14T14:41:58.657 INFO:teuthology.orchestra.run.smithi039.stdout:checking liburing.h usability... no 2024-05-14T14:41:58.668 INFO:teuthology.orchestra.run.smithi039.stdout:checking liburing.h presence... no 2024-05-14T14:41:58.669 INFO:teuthology.orchestra.run.smithi039.stdout:checking for liburing.h... no 2024-05-14T14:41:58.702 INFO:teuthology.orchestra.run.smithi039.stdout:checking sys/capability.h usability... yes 2024-05-14T14:41:58.713 INFO:teuthology.orchestra.run.smithi039.stdout:checking sys/capability.h presence... yes 2024-05-14T14:41:58.713 INFO:teuthology.orchestra.run.smithi039.stdout:checking for sys/capability.h... yes 2024-05-14T14:41:58.738 INFO:teuthology.orchestra.run.smithi039.stdout:checking linux/fiemap.h usability... yes 2024-05-14T14:41:58.746 INFO:teuthology.orchestra.run.smithi039.stdout:checking linux/fiemap.h presence... yes 2024-05-14T14:41:58.746 INFO:teuthology.orchestra.run.smithi039.stdout:checking for linux/fiemap.h... yes 2024-05-14T14:41:58.781 INFO:teuthology.orchestra.run.smithi039.stdout:checking for fallocate... yes 2024-05-14T14:41:58.819 INFO:teuthology.orchestra.run.smithi039.stdout:checking for open_by_handle_at... yes 2024-05-14T14:41:58.845 INFO:teuthology.orchestra.run.smithi039.stdout:checking linux/fs.h usability... yes 2024-05-14T14:41:58.854 INFO:teuthology.orchestra.run.smithi039.stdout:checking linux/fs.h presence... yes 2024-05-14T14:41:58.854 INFO:teuthology.orchestra.run.smithi039.stdout:checking for linux/fs.h... yes 2024-05-14T14:41:58.877 INFO:teuthology.orchestra.run.smithi039.stdout:checking btrfsutil.h usability... no 2024-05-14T14:41:58.888 INFO:teuthology.orchestra.run.smithi039.stdout:checking btrfsutil.h presence... no 2024-05-14T14:41:58.888 INFO:teuthology.orchestra.run.smithi039.stdout:checking for btrfsutil.h... no 2024-05-14T14:41:58.926 INFO:teuthology.orchestra.run.smithi039.stdout:checking for copy_file_range... yes 2024-05-14T14:41:58.964 INFO:teuthology.orchestra.run.smithi039.stdout:checking for SEEK_DATA... yes 2024-05-14T14:41:59.015 INFO:teuthology.orchestra.run.smithi039.stdout:checking for BMV_OF_SHARED... yes 2024-05-14T14:41:59.054 INFO:teuthology.orchestra.run.smithi039.stdout:checking for nftw... yes 2024-05-14T14:41:59.101 INFO:teuthology.orchestra.run.smithi039.stdout:checking for RLIMIT_NOFILE... yes 2024-05-14T14:41:59.135 INFO:teuthology.orchestra.run.smithi039.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2024-05-14T14:41:59.170 INFO:teuthology.orchestra.run.smithi039.stdout:checking for FICLONE... yes 2024-05-14T14:41:59.205 INFO:teuthology.orchestra.run.smithi039.stdout:checking for renameat2... yes 2024-05-14T14:41:59.240 INFO:teuthology.orchestra.run.smithi039.stdout:checking for reallocarray... yes 2024-05-14T14:41:59.273 INFO:teuthology.orchestra.run.smithi039.stdout:checking for struct mount_attr... yes 2024-05-14T14:41:59.308 INFO:teuthology.orchestra.run.smithi039.stdout:checking for struct btrfs_qgroup_limit... yes 2024-05-14T14:41:59.342 INFO:teuthology.orchestra.run.smithi039.stdout:checking for struct btrfs_qgroup_inherit... yes 2024-05-14T14:41:59.377 INFO:teuthology.orchestra.run.smithi039.stdout:checking for struct btrfs_ioctl_vol_args... yes 2024-05-14T14:41:59.412 INFO:teuthology.orchestra.run.smithi039.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2024-05-14T14:41:59.447 INFO:teuthology.orchestra.run.smithi039.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2024-05-14T14:41:59.482 INFO:teuthology.orchestra.run.smithi039.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2024-05-14T14:41:59.516 INFO:teuthology.orchestra.run.smithi039.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2024-05-14T14:41:59.543 INFO:teuthology.orchestra.run.smithi039.stdout:checking linux/btrfs.h usability... yes 2024-05-14T14:41:59.552 INFO:teuthology.orchestra.run.smithi039.stdout:checking linux/btrfs.h presence... yes 2024-05-14T14:41:59.552 INFO:teuthology.orchestra.run.smithi039.stdout:checking for linux/btrfs.h... yes 2024-05-14T14:41:59.583 INFO:teuthology.orchestra.run.smithi039.stdout:checking linux/btrfs_tree.h usability... yes 2024-05-14T14:41:59.593 INFO:teuthology.orchestra.run.smithi039.stdout:checking linux/btrfs_tree.h presence... yes 2024-05-14T14:41:59.593 INFO:teuthology.orchestra.run.smithi039.stdout:checking for linux/btrfs_tree.h... yes 2024-05-14T14:41:59.615 INFO:teuthology.orchestra.run.smithi039.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2024-05-14T14:41:59.638 INFO:teuthology.orchestra.run.smithi039.stdout:checking whether BTRFS_IOC_SNAP_DESTROY_V2 is declared... yes 2024-05-14T14:41:59.654 INFO:teuthology.orchestra.run.smithi039.stdout:configure: creating ./config.status 2024-05-14T14:41:59.964 INFO:teuthology.orchestra.run.smithi039.stdout:config.status: creating include/builddefs 2024-05-14T14:41:59.975 INFO:teuthology.orchestra.run.smithi039.stdout:config.status: creating include/config.h 2024-05-14T14:41:59.983 INFO:teuthology.orchestra.run.smithi039.stdout:config.status: executing libtool commands 2024-05-14T14:42:00.023 INFO:teuthology.orchestra.run.smithi039.stdout:Building include 2024-05-14T14:42:00.027 INFO:teuthology.orchestra.run.smithi039.stdout:Building lib 2024-05-14T14:42:00.030 INFO:teuthology.orchestra.run.smithi039.stdout: [LTDEP] 2024-05-14T14:42:00.178 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] dataascii.lo 2024-05-14T14:42:00.299 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] databin.lo 2024-05-14T14:42:00.439 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] datapid.lo 2024-05-14T14:42:00.538 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] file_lock.lo 2024-05-14T14:42:00.677 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] forker.lo 2024-05-14T14:42:00.805 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] pattern.lo 2024-05-14T14:42:00.920 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] open_flags.lo 2024-05-14T14:42:01.052 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] random_range.lo 2024-05-14T14:42:01.269 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] string_to_tokens.lo 2024-05-14T14:42:01.366 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] str_to_bytes.lo 2024-05-14T14:42:01.506 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] tlibio.lo 2024-05-14T14:42:01.731 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] write_log.lo 2024-05-14T14:42:01.960 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] random.lo 2024-05-14T14:42:02.060 INFO:teuthology.orchestra.run.smithi039.stdout: [LD] 2024-05-14T14:42:02.140 INFO:teuthology.orchestra.run.smithi039.stdout:Building ltp 2024-05-14T14:42:02.143 INFO:teuthology.orchestra.run.smithi039.stdout: [DEP] 2024-05-14T14:42:02.292 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] doio 2024-05-14T14:42:02.923 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] fsstress 2024-05-14T14:42:04.310 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] fsx 2024-05-14T14:42:05.015 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] growfiles 2024-05-14T14:42:05.492 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] iogen 2024-05-14T14:42:05.842 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] aio-stress 2024-05-14T14:42:06.238 INFO:teuthology.orchestra.run.smithi039.stdout:Building src 2024-05-14T14:42:06.244 INFO:teuthology.orchestra.run.smithi039.stdout: [DEP] 2024-05-14T14:42:08.052 INFO:teuthology.orchestra.run.smithi039.stdout: [DEP] 2024-05-14T14:42:08.085 INFO:teuthology.orchestra.run.smithi039.stdout: [DEP] 2024-05-14T14:42:08.092 INFO:teuthology.orchestra.run.smithi039.stdout: [DEP] 2024-05-14T14:42:08.313 INFO:teuthology.orchestra.run.smithi039.stdout: [DEP] 2024-05-14T14:42:08.336 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] dirstress 2024-05-14T14:42:08.549 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] fill 2024-05-14T14:42:08.686 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] fill2 2024-05-14T14:42:08.896 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] getpagesize 2024-05-14T14:42:09.015 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] holes 2024-05-14T14:42:09.189 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] lstat64 2024-05-14T14:42:09.353 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] nametest 2024-05-14T14:42:09.573 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] permname 2024-05-14T14:42:09.752 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] randholes 2024-05-14T14:42:09.978 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] runas 2024-05-14T14:42:10.134 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] truncfile 2024-05-14T14:42:10.293 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] usemem 2024-05-14T14:42:10.426 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] mmapcat 2024-05-14T14:42:10.556 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] append_reader 2024-05-14T14:42:10.690 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] append_writer 2024-05-14T14:42:10.823 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] dirperf 2024-05-14T14:42:11.029 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] metaperf 2024-05-14T14:42:11.286 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] devzero 2024-05-14T14:42:11.442 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] feature 2024-05-14T14:42:11.635 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] alloc 2024-05-14T14:42:11.823 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] fault 2024-05-14T14:42:11.969 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] fstest 2024-05-14T14:42:12.185 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_access_root 2024-05-14T14:42:12.321 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] godown 2024-05-14T14:42:12.470 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] resvtest 2024-05-14T14:42:12.493 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:42:12.496 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:42:12.636 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] writemod 2024-05-14T14:42:12.763 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] writev_on_pagefault 2024-05-14T14:42:12.906 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] makeextents 2024-05-14T14:42:13.066 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] itrash 2024-05-14T14:42:13.201 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] rename 2024-05-14T14:42:13.325 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] multi_open_unlink 2024-05-14T14:42:13.471 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] unwritten_sync 2024-05-14T14:42:13.631 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] genhashnames 2024-05-14T14:42:13.801 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_holes 2024-05-14T14:42:13.931 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_mmap_writev 2024-05-14T14:42:14.061 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_truncate_cmtime 2024-05-14T14:42:14.201 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] dirhash_collide 2024-05-14T14:42:14.375 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_rename_overwrite 2024-05-14T14:42:14.500 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] holetest 2024-05-14T14:42:14.708 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_truncate_self 2024-05-14T14:42:14.833 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] af_unix 2024-05-14T14:42:14.968 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_mmap_stale_pmd 2024-05-14T14:42:15.103 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_mmap_cow_race 2024-05-14T14:42:15.249 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_mmap_fallocate 2024-05-14T14:42:15.381 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] fsync-err 2024-05-14T14:42:15.546 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_mmap_write_ro 2024-05-14T14:42:15.680 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_ext4_dax_journal_corruption 2024-05-14T14:42:15.821 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_ext4_dax_inline_corruption 2024-05-14T14:42:15.957 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_ofd_locks 2024-05-14T14:42:16.132 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_mmap_collision 2024-05-14T14:42:16.311 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] mmap-write-concurrent 2024-05-14T14:42:16.461 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_get_file_time 2024-05-14T14:42:16.589 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_create_short_dirs 2024-05-14T14:42:16.741 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_create_long_dirs 2024-05-14T14:42:16.888 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_enospc 2024-05-14T14:42:17.059 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_mmap_writev_overlap 2024-05-14T14:42:17.210 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] checkpoint_journal 2024-05-14T14:42:17.347 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] mmap-rw-fault 2024-05-14T14:42:17.511 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] allocstale 2024-05-14T14:42:17.660 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_mmap_cow_memory_failure 2024-05-14T14:42:17.810 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] fake-dump-rootino 2024-05-14T14:42:17.943 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] dio-buf-fault 2024-05-14T14:42:18.078 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] rewinddir-test 2024-05-14T14:42:18.230 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] readdir-while-renames 2024-05-14T14:42:18.376 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] xfsctl 2024-05-14T14:42:18.544 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] bstat 2024-05-14T14:42:18.731 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_mtab 2024-05-14T14:42:18.898 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] getdevicesize 2024-05-14T14:42:19.023 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] preallo_rw_pattern_reader 2024-05-14T14:42:19.163 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] preallo_rw_pattern_writer 2024-05-14T14:42:19.302 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] ftrunc 2024-05-14T14:42:19.434 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] trunc 2024-05-14T14:42:19.579 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] fs_perms 2024-05-14T14:42:19.725 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] testx 2024-05-14T14:42:19.840 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] looptest 2024-05-14T14:42:20.014 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] locktest 2024-05-14T14:42:20.296 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] unwritten_mmap 2024-05-14T14:42:20.440 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] bulkstat_unlink_test 2024-05-14T14:42:20.620 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] deduperace 2024-05-14T14:42:20.794 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] bulkstat_unlink_test_modified 2024-05-14T14:42:20.974 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_dir_offset 2024-05-14T14:42:21.102 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_futimens 2024-05-14T14:42:21.225 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_immutable 2024-05-14T14:42:21.809 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] stale_handle 2024-05-14T14:42:21.960 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] pwrite_mmap_blocked 2024-05-14T14:42:22.101 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_dir_offset2 2024-05-14T14:42:22.274 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] seek_sanity_test 2024-05-14T14:42:22.687 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] seek_copy_test 2024-05-14T14:42:22.844 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_readdir_1 2024-05-14T14:42:22.975 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_readdir_2 2024-05-14T14:42:23.108 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] fsync-tester 2024-05-14T14:42:23.337 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] nsexec 2024-05-14T14:42:23.495 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] cloner 2024-05-14T14:42:23.659 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] renameat2 2024-05-14T14:42:23.809 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_getcwd 2024-05-14T14:42:23.950 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] e4compact 2024-05-14T14:42:24.132 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] test-nextquota 2024-05-14T14:42:24.298 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] punch-alternating 2024-05-14T14:42:24.450 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] attr-list-by-handle-cursor-test 2024-05-14T14:42:24.597 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] listxattr 2024-05-14T14:42:24.730 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] dio-interleaved 2024-05-14T14:42:24.872 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_dir_type 2024-05-14T14:42:25.010 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] dio-invalidate-cache 2024-05-14T14:42:25.194 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] stat_test 2024-05-14T14:42:25.468 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_encrypted_d_revalidate 2024-05-14T14:42:25.614 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] attr_replace_test 2024-05-14T14:42:25.761 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] swapon 2024-05-14T14:42:25.907 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] mkswap 2024-05-14T14:42:26.042 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_attr_corruption 2024-05-14T14:42:26.176 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_open_tmpfiles 2024-05-14T14:42:26.335 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] fscrypt-crypt-util 2024-05-14T14:42:26.955 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] bulkstat_null_ocount 2024-05-14T14:42:27.096 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] splice-test 2024-05-14T14:42:27.258 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] chprojid_fail 2024-05-14T14:42:27.401 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] detached_mounts_propagation 2024-05-14T14:42:27.567 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] ext4_resize 2024-05-14T14:42:27.699 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_readdir_3 2024-05-14T14:42:27.875 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] splice2pipe 2024-05-14T14:42:28.020 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] uuid_ioctl 2024-05-14T14:42:28.157 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_snapshot_deleted_subvolume 2024-05-14T14:42:28.302 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] fiemap-fault 2024-05-14T14:42:28.441 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] fiemap-tester 2024-05-14T14:42:28.683 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_stripealign 2024-05-14T14:42:28.820 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] open_by_handle 2024-05-14T14:42:29.050 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] dbtest 2024-05-14T14:42:29.277 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_mmap_dio 2024-05-14T14:42:29.419 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] xfsfind 2024-05-14T14:42:29.597 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] t_reflink_read_race 2024-05-14T14:42:29.770 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] fssum 2024-05-14T14:42:30.182 INFO:teuthology.orchestra.run.smithi039.stdout:Building log-writes 2024-05-14T14:42:30.187 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] replay-log 2024-05-14T14:42:30.499 INFO:teuthology.orchestra.run.smithi039.stdout:Building perf 2024-05-14T14:42:30.502 INFO:teuthology.orchestra.run.smithi039.stdout:Building aio-dio-regress 2024-05-14T14:42:30.508 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] aiocp 2024-05-14T14:42:30.715 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] aio-dio-append-write-fallocate-race 2024-05-14T14:42:30.865 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] aio-dio-append-write-read-race 2024-05-14T14:42:31.024 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] aio-dio-cow-race 2024-05-14T14:42:31.159 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] aio-dio-cycle-write 2024-05-14T14:42:31.324 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] aio-dio-eof-race 2024-05-14T14:42:31.488 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] aio-dio-extend-stat 2024-05-14T14:42:31.633 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] aio-dio-fcntl-race 2024-05-14T14:42:31.779 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] aio-dio-hole-filling-race 2024-05-14T14:42:31.910 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] aio-dio-invalidate-failure 2024-05-14T14:42:32.052 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] aio-dio-invalidate-readahead 2024-05-14T14:42:32.199 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] aiodio_sparse2 2024-05-14T14:42:32.397 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] aio-dio-subblock-eof-read 2024-05-14T14:42:32.522 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] aio-dio-write-verify 2024-05-14T14:42:32.699 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2024-05-14T14:42:32.818 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2024-05-14T14:42:32.935 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] aio-last-ref-held-by-io 2024-05-14T14:42:33.090 INFO:teuthology.orchestra.run.smithi039.stdout:Building vfs 2024-05-14T14:42:33.096 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] vfstest 2024-05-14T14:42:36.568 INFO:teuthology.orchestra.run.smithi039.stdout: [CC] mount-idmapped 2024-05-14T14:42:36.921 INFO:teuthology.orchestra.run.smithi039.stdout:Building m4 2024-05-14T14:42:36.925 INFO:teuthology.orchestra.run.smithi039.stdout:Building common 2024-05-14T14:42:36.928 INFO:teuthology.orchestra.run.smithi039.stdout:Building tests 2024-05-14T14:42:36.934 INFO:teuthology.orchestra.run.smithi039.stdout:Building btrfs 2024-05-14T14:42:36.941 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/btrfs/group.list 2024-05-14T14:42:37.005 INFO:teuthology.orchestra.run.smithi039.stdout:Building ceph 2024-05-14T14:42:37.010 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/ceph/group.list 2024-05-14T14:42:37.026 INFO:teuthology.orchestra.run.smithi039.stdout:Building cifs 2024-05-14T14:42:37.031 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/cifs/group.list 2024-05-14T14:42:37.045 INFO:teuthology.orchestra.run.smithi039.stdout:Building ext4 2024-05-14T14:42:37.050 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/ext4/group.list 2024-05-14T14:42:37.091 INFO:teuthology.orchestra.run.smithi039.stdout:Building f2fs 2024-05-14T14:42:37.096 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/f2fs/group.list 2024-05-14T14:42:37.115 INFO:teuthology.orchestra.run.smithi039.stdout:Building generic 2024-05-14T14:42:37.122 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/generic/group.list 2024-05-14T14:42:37.227 INFO:teuthology.orchestra.run.smithi039.stdout:Building nfs 2024-05-14T14:42:37.233 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/nfs/group.list 2024-05-14T14:42:37.248 INFO:teuthology.orchestra.run.smithi039.stdout:Building ocfs2 2024-05-14T14:42:37.253 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/ocfs2/group.list 2024-05-14T14:42:37.268 INFO:teuthology.orchestra.run.smithi039.stdout:Building overlay 2024-05-14T14:42:37.273 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/overlay/group.list 2024-05-14T14:42:37.316 INFO:teuthology.orchestra.run.smithi039.stdout:Building perf 2024-05-14T14:42:37.321 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/perf/group.list 2024-05-14T14:42:37.334 INFO:teuthology.orchestra.run.smithi039.stdout:Building selftest 2024-05-14T14:42:37.339 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/selftest/group.list 2024-05-14T14:42:37.352 INFO:teuthology.orchestra.run.smithi039.stdout:Building shared 2024-05-14T14:42:37.358 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/shared/group.list 2024-05-14T14:42:37.376 INFO:teuthology.orchestra.run.smithi039.stdout:Building tmpfs 2024-05-14T14:42:37.381 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/tmpfs/group.list 2024-05-14T14:42:37.396 INFO:teuthology.orchestra.run.smithi039.stdout:Building udf 2024-05-14T14:42:37.401 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/udf/group.list 2024-05-14T14:42:37.413 INFO:teuthology.orchestra.run.smithi039.stdout:Building xfs 2024-05-14T14:42:37.420 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/xfs/group.list 2024-05-14T14:42:37.525 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo make install) 2024-05-14T14:42:37.564 INFO:teuthology.orchestra.run.smithi039.stdout:Building include 2024-05-14T14:42:37.568 INFO:teuthology.orchestra.run.smithi039.stdout:Building lib 2024-05-14T14:42:37.572 INFO:teuthology.orchestra.run.smithi039.stdout:Building ltp 2024-05-14T14:42:37.576 INFO:teuthology.orchestra.run.smithi039.stdout:Building src 2024-05-14T14:42:37.612 INFO:teuthology.orchestra.run.smithi039.stdout:Building log-writes 2024-05-14T14:42:37.615 INFO:teuthology.orchestra.run.smithi039.stdout:Building perf 2024-05-14T14:42:37.619 INFO:teuthology.orchestra.run.smithi039.stdout:Building aio-dio-regress 2024-05-14T14:42:37.623 INFO:teuthology.orchestra.run.smithi039.stdout:Building vfs 2024-05-14T14:42:37.627 INFO:teuthology.orchestra.run.smithi039.stdout:Building m4 2024-05-14T14:42:37.631 INFO:teuthology.orchestra.run.smithi039.stdout:Building common 2024-05-14T14:42:37.634 INFO:teuthology.orchestra.run.smithi039.stdout:Building tests 2024-05-14T14:42:37.640 INFO:teuthology.orchestra.run.smithi039.stdout:Building btrfs 2024-05-14T14:42:37.646 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/btrfs/group.list 2024-05-14T14:42:37.711 INFO:teuthology.orchestra.run.smithi039.stdout:Building ceph 2024-05-14T14:42:37.717 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/ceph/group.list 2024-05-14T14:42:37.732 INFO:teuthology.orchestra.run.smithi039.stdout:Building cifs 2024-05-14T14:42:37.738 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/cifs/group.list 2024-05-14T14:42:37.751 INFO:teuthology.orchestra.run.smithi039.stdout:Building ext4 2024-05-14T14:42:37.756 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/ext4/group.list 2024-05-14T14:42:37.797 INFO:teuthology.orchestra.run.smithi039.stdout:Building f2fs 2024-05-14T14:42:37.803 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/f2fs/group.list 2024-05-14T14:42:37.821 INFO:teuthology.orchestra.run.smithi039.stdout:Building generic 2024-05-14T14:42:37.828 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/generic/group.list 2024-05-14T14:42:37.932 INFO:teuthology.orchestra.run.smithi039.stdout:Building nfs 2024-05-14T14:42:37.937 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/nfs/group.list 2024-05-14T14:42:37.953 INFO:teuthology.orchestra.run.smithi039.stdout:Building ocfs2 2024-05-14T14:42:37.958 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/ocfs2/group.list 2024-05-14T14:42:37.972 INFO:teuthology.orchestra.run.smithi039.stdout:Building overlay 2024-05-14T14:42:37.978 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/overlay/group.list 2024-05-14T14:42:38.020 INFO:teuthology.orchestra.run.smithi039.stdout:Building perf 2024-05-14T14:42:38.025 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/perf/group.list 2024-05-14T14:42:38.038 INFO:teuthology.orchestra.run.smithi039.stdout:Building selftest 2024-05-14T14:42:38.043 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/selftest/group.list 2024-05-14T14:42:38.056 INFO:teuthology.orchestra.run.smithi039.stdout:Building shared 2024-05-14T14:42:38.061 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/shared/group.list 2024-05-14T14:42:38.080 INFO:teuthology.orchestra.run.smithi039.stdout:Building tmpfs 2024-05-14T14:42:38.085 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/tmpfs/group.list 2024-05-14T14:42:38.100 INFO:teuthology.orchestra.run.smithi039.stdout:Building udf 2024-05-14T14:42:38.105 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/udf/group.list 2024-05-14T14:42:38.117 INFO:teuthology.orchestra.run.smithi039.stdout:Building xfs 2024-05-14T14:42:38.124 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/xfs/group.list 2024-05-14T14:42:38.226 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2024-05-14T14:42:38.227 INFO:teuthology.orchestra.run.smithi039.stdout:gmake[1]: Nothing to be done for 'install'. 2024-05-14T14:42:38.227 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2024-05-14T14:42:38.230 INFO:teuthology.orchestra.run.smithi039.stdout:gmake[1]: Nothing to be done for 'install'. 2024-05-14T14:42:38.230 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2024-05-14T14:42:38.232 INFO:teuthology.orchestra.run.smithi039.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2024-05-14T14:42:38.241 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2024-05-14T14:42:38.313 INFO:teuthology.orchestra.run.smithi039.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2024-05-14T14:42:38.322 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2024-05-14T14:42:38.340 INFO:teuthology.orchestra.run.smithi039.stdout:Building log-writes 2024-05-14T14:42:38.344 INFO:teuthology.orchestra.run.smithi039.stdout:Building perf 2024-05-14T14:42:38.347 INFO:teuthology.orchestra.run.smithi039.stdout:Building aio-dio-regress 2024-05-14T14:42:38.351 INFO:teuthology.orchestra.run.smithi039.stdout:Building vfs 2024-05-14T14:42:38.354 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake -C log-writes install 2024-05-14T14:42:38.356 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2024-05-14T14:42:38.365 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2024-05-14T14:42:38.374 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake -C perf install 2024-05-14T14:42:38.376 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2024-05-14T14:42:38.385 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2024-05-14T14:42:38.408 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake -C aio-dio-regress install 2024-05-14T14:42:38.410 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2024-05-14T14:42:38.419 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2024-05-14T14:42:38.471 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake -C vfs install 2024-05-14T14:42:38.473 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2024-05-14T14:42:38.482 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2024-05-14T14:42:38.494 INFO:teuthology.orchestra.run.smithi039.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2024-05-14T14:42:38.503 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test readdir-while-renames xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl t_snapshot_deleted_subvolume fiemap-fault fiemap-tester t_stripealign open_by_handle dbtest t_mmap_dio xfsfind t_reflink_read_race fssum /var/lib/xfstests/src 2024-05-14T14:42:39.744 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2024-05-14T14:42:39.844 INFO:teuthology.orchestra.run.smithi039.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2024-05-14T14:42:39.869 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2024-05-14T14:42:39.871 INFO:teuthology.orchestra.run.smithi039.stdout:gmake[1]: Nothing to be done for 'install'. 2024-05-14T14:42:39.871 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2024-05-14T14:42:39.872 INFO:teuthology.orchestra.run.smithi039.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2024-05-14T14:42:39.881 INFO:teuthology.orchestra.run.smithi039.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2024-05-14T14:42:40.020 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2024-05-14T14:42:40.022 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.BmtVWB36S6xfstests-dev/tests/btrfs/ install 2024-05-14T14:42:40.025 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/btrfs/group.list 2024-05-14T14:42:40.091 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2024-05-14T14:42:40.100 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 313 314 315 316 317 318 320 330 /var/lib/xfstests/tests/btrfs 2024-05-14T14:42:40.966 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2024-05-14T14:42:40.975 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 313.out 314.out 315.out 316.out 317.out 318.out 320.out 330.out /var/lib/xfstests/tests/btrfs 2024-05-14T14:42:41.842 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.BmtVWB36S6xfstests-dev/tests/ceph/ install 2024-05-14T14:42:41.845 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/ceph/group.list 2024-05-14T14:42:41.859 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2024-05-14T14:42:41.868 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2024-05-14T14:42:41.888 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2024-05-14T14:42:41.897 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2024-05-14T14:42:41.917 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.BmtVWB36S6xfstests-dev/tests/cifs/ install 2024-05-14T14:42:41.919 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/cifs/group.list 2024-05-14T14:42:41.932 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2024-05-14T14:42:41.941 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2024-05-14T14:42:41.950 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2024-05-14T14:42:41.959 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2024-05-14T14:42:41.968 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.BmtVWB36S6xfstests-dev/tests/ext4/ install 2024-05-14T14:42:41.971 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/ext4/group.list 2024-05-14T14:42:42.011 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2024-05-14T14:42:42.020 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2024-05-14T14:42:42.208 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2024-05-14T14:42:42.217 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2024-05-14T14:42:42.415 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.BmtVWB36S6xfstests-dev/tests/f2fs/ install 2024-05-14T14:42:42.418 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/f2fs/group.list 2024-05-14T14:42:42.435 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2024-05-14T14:42:42.444 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2024-05-14T14:42:42.456 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2024-05-14T14:42:42.465 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2024-05-14T14:42:42.477 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.BmtVWB36S6xfstests-dev/tests/generic/ install 2024-05-14T14:42:42.480 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/generic/group.list 2024-05-14T14:42:42.549 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:42:42.552 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:42:42.586 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2024-05-14T14:42:42.595 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 741 742 743 744 /var/lib/xfstests/tests/generic 2024-05-14T14:42:44.619 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2024-05-14T14:42:44.628 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 741.out 742.out 743.out 744.out /var/lib/xfstests/tests/generic 2024-05-14T14:42:46.678 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.BmtVWB36S6xfstests-dev/tests/nfs/ install 2024-05-14T14:42:46.681 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/nfs/group.list 2024-05-14T14:42:46.695 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2024-05-14T14:42:46.704 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2024-05-14T14:42:46.713 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2024-05-14T14:42:46.722 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2024-05-14T14:42:46.731 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.BmtVWB36S6xfstests-dev/tests/ocfs2/ install 2024-05-14T14:42:46.734 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/ocfs2/group.list 2024-05-14T14:42:46.747 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2024-05-14T14:42:46.756 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2024-05-14T14:42:46.765 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2024-05-14T14:42:46.774 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2024-05-14T14:42:46.783 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.BmtVWB36S6xfstests-dev/tests/overlay/ install 2024-05-14T14:42:46.786 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/overlay/group.list 2024-05-14T14:42:46.828 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2024-05-14T14:42:46.838 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2024-05-14T14:42:47.126 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2024-05-14T14:42:47.135 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2024-05-14T14:42:47.424 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.BmtVWB36S6xfstests-dev/tests/perf/ install 2024-05-14T14:42:47.426 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/perf/group.list 2024-05-14T14:42:47.437 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2024-05-14T14:42:47.446 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2024-05-14T14:42:47.455 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2024-05-14T14:42:47.464 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2024-05-14T14:42:47.473 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.BmtVWB36S6xfstests-dev/tests/selftest/ install 2024-05-14T14:42:47.476 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/selftest/group.list 2024-05-14T14:42:47.488 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2024-05-14T14:42:47.497 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2024-05-14T14:42:47.519 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2024-05-14T14:42:47.528 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2024-05-14T14:42:47.550 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.BmtVWB36S6xfstests-dev/tests/shared/ install 2024-05-14T14:42:47.553 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/shared/group.list 2024-05-14T14:42:47.571 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2024-05-14T14:42:47.581 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2024-05-14T14:42:47.595 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2024-05-14T14:42:47.604 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2024-05-14T14:42:47.619 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.BmtVWB36S6xfstests-dev/tests/tmpfs/ install 2024-05-14T14:42:47.622 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/tmpfs/group.list 2024-05-14T14:42:47.635 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2024-05-14T14:42:47.644 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2024-05-14T14:42:47.653 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2024-05-14T14:42:47.662 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2024-05-14T14:42:47.671 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.BmtVWB36S6xfstests-dev/tests/udf/ install 2024-05-14T14:42:47.674 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/udf/group.list 2024-05-14T14:42:47.685 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2024-05-14T14:42:47.694 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2024-05-14T14:42:47.703 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2024-05-14T14:42:47.713 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2024-05-14T14:42:47.722 INFO:teuthology.orchestra.run.smithi039.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.BmtVWB36S6xfstests-dev/tests/xfs/ install 2024-05-14T14:42:47.725 INFO:teuthology.orchestra.run.smithi039.stdout: [GROUP] /tmp/tmp.BmtVWB36S6xfstests-dev/tests/xfs/group.list 2024-05-14T14:42:47.830 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2024-05-14T14:42:47.839 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 612 613 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2024-05-14T14:42:49.739 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2024-05-14T14:42:49.748 INFO:teuthology.orchestra.run.smithi039.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 612.out 613.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2024-05-14T14:42:51.675 INFO:teuthology.orchestra.run.smithi039.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2024-05-14T14:42:51.684 INFO:teuthology.orchestra.run.smithi039.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2024-05-14T14:42:51.693 INFO:teuthology.orchestra.run.smithi039.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2024-05-14T14:42:51.705 INFO:teuthology.orchestra.run.smithi039.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2024-05-14T14:42:51.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T14:42:51.714 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec ls tests/generic) 2024-05-14T14:42:51.731 INFO:teuthology.orchestra.run.smithi039.stdout:001 2024-05-14T14:42:51.731 INFO:teuthology.orchestra.run.smithi039.stdout:001.out 2024-05-14T14:42:51.731 INFO:teuthology.orchestra.run.smithi039.stdout:002 2024-05-14T14:42:51.731 INFO:teuthology.orchestra.run.smithi039.stdout:002.out 2024-05-14T14:42:51.731 INFO:teuthology.orchestra.run.smithi039.stdout:003 2024-05-14T14:42:51.731 INFO:teuthology.orchestra.run.smithi039.stdout:003.out 2024-05-14T14:42:51.731 INFO:teuthology.orchestra.run.smithi039.stdout:004 2024-05-14T14:42:51.731 INFO:teuthology.orchestra.run.smithi039.stdout:004.out 2024-05-14T14:42:51.731 INFO:teuthology.orchestra.run.smithi039.stdout:005 2024-05-14T14:42:51.732 INFO:teuthology.orchestra.run.smithi039.stdout:005.out 2024-05-14T14:42:51.732 INFO:teuthology.orchestra.run.smithi039.stdout:006 2024-05-14T14:42:51.732 INFO:teuthology.orchestra.run.smithi039.stdout:006.out 2024-05-14T14:42:51.732 INFO:teuthology.orchestra.run.smithi039.stdout:007 2024-05-14T14:42:51.732 INFO:teuthology.orchestra.run.smithi039.stdout:007.out 2024-05-14T14:42:51.732 INFO:teuthology.orchestra.run.smithi039.stdout:008 2024-05-14T14:42:51.732 INFO:teuthology.orchestra.run.smithi039.stdout:008.out 2024-05-14T14:42:51.732 INFO:teuthology.orchestra.run.smithi039.stdout:009 2024-05-14T14:42:51.732 INFO:teuthology.orchestra.run.smithi039.stdout:009.out 2024-05-14T14:42:51.732 INFO:teuthology.orchestra.run.smithi039.stdout:010 2024-05-14T14:42:51.732 INFO:teuthology.orchestra.run.smithi039.stdout:010.out 2024-05-14T14:42:51.732 INFO:teuthology.orchestra.run.smithi039.stdout:011 2024-05-14T14:42:51.732 INFO:teuthology.orchestra.run.smithi039.stdout:011.out 2024-05-14T14:42:51.732 INFO:teuthology.orchestra.run.smithi039.stdout:012 2024-05-14T14:42:51.732 INFO:teuthology.orchestra.run.smithi039.stdout:012.out 2024-05-14T14:42:51.733 INFO:teuthology.orchestra.run.smithi039.stdout:013 2024-05-14T14:42:51.733 INFO:teuthology.orchestra.run.smithi039.stdout:013.out 2024-05-14T14:42:51.733 INFO:teuthology.orchestra.run.smithi039.stdout:014 2024-05-14T14:42:51.733 INFO:teuthology.orchestra.run.smithi039.stdout:014.out 2024-05-14T14:42:51.733 INFO:teuthology.orchestra.run.smithi039.stdout:015 2024-05-14T14:42:51.733 INFO:teuthology.orchestra.run.smithi039.stdout:015.out 2024-05-14T14:42:51.733 INFO:teuthology.orchestra.run.smithi039.stdout:016 2024-05-14T14:42:51.733 INFO:teuthology.orchestra.run.smithi039.stdout:016.out 2024-05-14T14:42:51.733 INFO:teuthology.orchestra.run.smithi039.stdout:017 2024-05-14T14:42:51.733 INFO:teuthology.orchestra.run.smithi039.stdout:017.out 2024-05-14T14:42:51.733 INFO:teuthology.orchestra.run.smithi039.stdout:018 2024-05-14T14:42:51.733 INFO:teuthology.orchestra.run.smithi039.stdout:018.out 2024-05-14T14:42:51.733 INFO:teuthology.orchestra.run.smithi039.stdout:019 2024-05-14T14:42:51.733 INFO:teuthology.orchestra.run.smithi039.stdout:019.out 2024-05-14T14:42:51.733 INFO:teuthology.orchestra.run.smithi039.stdout:020 2024-05-14T14:42:51.734 INFO:teuthology.orchestra.run.smithi039.stdout:020.out 2024-05-14T14:42:51.734 INFO:teuthology.orchestra.run.smithi039.stdout:021 2024-05-14T14:42:51.734 INFO:teuthology.orchestra.run.smithi039.stdout:021.out 2024-05-14T14:42:51.734 INFO:teuthology.orchestra.run.smithi039.stdout:022 2024-05-14T14:42:51.734 INFO:teuthology.orchestra.run.smithi039.stdout:022.out 2024-05-14T14:42:51.734 INFO:teuthology.orchestra.run.smithi039.stdout:023 2024-05-14T14:42:51.734 INFO:teuthology.orchestra.run.smithi039.stdout:023.out 2024-05-14T14:42:51.734 INFO:teuthology.orchestra.run.smithi039.stdout:024 2024-05-14T14:42:51.734 INFO:teuthology.orchestra.run.smithi039.stdout:024.out 2024-05-14T14:42:51.734 INFO:teuthology.orchestra.run.smithi039.stdout:025 2024-05-14T14:42:51.734 INFO:teuthology.orchestra.run.smithi039.stdout:025.out 2024-05-14T14:42:51.734 INFO:teuthology.orchestra.run.smithi039.stdout:026 2024-05-14T14:42:51.734 INFO:teuthology.orchestra.run.smithi039.stdout:026.out 2024-05-14T14:42:51.734 INFO:teuthology.orchestra.run.smithi039.stdout:027 2024-05-14T14:42:51.734 INFO:teuthology.orchestra.run.smithi039.stdout:027.out 2024-05-14T14:42:51.735 INFO:teuthology.orchestra.run.smithi039.stdout:028 2024-05-14T14:42:51.735 INFO:teuthology.orchestra.run.smithi039.stdout:028.out 2024-05-14T14:42:51.735 INFO:teuthology.orchestra.run.smithi039.stdout:029 2024-05-14T14:42:51.735 INFO:teuthology.orchestra.run.smithi039.stdout:029.out 2024-05-14T14:42:51.735 INFO:teuthology.orchestra.run.smithi039.stdout:030 2024-05-14T14:42:51.735 INFO:teuthology.orchestra.run.smithi039.stdout:030.out 2024-05-14T14:42:51.735 INFO:teuthology.orchestra.run.smithi039.stdout:031 2024-05-14T14:42:51.735 INFO:teuthology.orchestra.run.smithi039.stdout:031.out 2024-05-14T14:42:51.735 INFO:teuthology.orchestra.run.smithi039.stdout:032 2024-05-14T14:42:51.735 INFO:teuthology.orchestra.run.smithi039.stdout:032.out 2024-05-14T14:42:51.735 INFO:teuthology.orchestra.run.smithi039.stdout:033 2024-05-14T14:42:51.735 INFO:teuthology.orchestra.run.smithi039.stdout:033.out 2024-05-14T14:42:51.735 INFO:teuthology.orchestra.run.smithi039.stdout:034 2024-05-14T14:42:51.735 INFO:teuthology.orchestra.run.smithi039.stdout:034.out 2024-05-14T14:42:51.735 INFO:teuthology.orchestra.run.smithi039.stdout:035 2024-05-14T14:42:51.736 INFO:teuthology.orchestra.run.smithi039.stdout:035.cfg 2024-05-14T14:42:51.736 INFO:teuthology.orchestra.run.smithi039.stdout:035.out.default 2024-05-14T14:42:51.736 INFO:teuthology.orchestra.run.smithi039.stdout:035.out.nfs 2024-05-14T14:42:51.736 INFO:teuthology.orchestra.run.smithi039.stdout:036 2024-05-14T14:42:51.736 INFO:teuthology.orchestra.run.smithi039.stdout:036.out 2024-05-14T14:42:51.736 INFO:teuthology.orchestra.run.smithi039.stdout:037 2024-05-14T14:42:51.736 INFO:teuthology.orchestra.run.smithi039.stdout:037.out 2024-05-14T14:42:51.736 INFO:teuthology.orchestra.run.smithi039.stdout:038 2024-05-14T14:42:51.736 INFO:teuthology.orchestra.run.smithi039.stdout:038.out 2024-05-14T14:42:51.736 INFO:teuthology.orchestra.run.smithi039.stdout:039 2024-05-14T14:42:51.736 INFO:teuthology.orchestra.run.smithi039.stdout:039.out 2024-05-14T14:42:51.736 INFO:teuthology.orchestra.run.smithi039.stdout:040 2024-05-14T14:42:51.736 INFO:teuthology.orchestra.run.smithi039.stdout:040.out 2024-05-14T14:42:51.736 INFO:teuthology.orchestra.run.smithi039.stdout:041 2024-05-14T14:42:51.736 INFO:teuthology.orchestra.run.smithi039.stdout:041.out 2024-05-14T14:42:51.737 INFO:teuthology.orchestra.run.smithi039.stdout:042 2024-05-14T14:42:51.737 INFO:teuthology.orchestra.run.smithi039.stdout:042.out 2024-05-14T14:42:51.737 INFO:teuthology.orchestra.run.smithi039.stdout:043 2024-05-14T14:42:51.737 INFO:teuthology.orchestra.run.smithi039.stdout:043.out 2024-05-14T14:42:51.737 INFO:teuthology.orchestra.run.smithi039.stdout:044 2024-05-14T14:42:51.737 INFO:teuthology.orchestra.run.smithi039.stdout:044.out 2024-05-14T14:42:51.737 INFO:teuthology.orchestra.run.smithi039.stdout:045 2024-05-14T14:42:51.737 INFO:teuthology.orchestra.run.smithi039.stdout:045.out 2024-05-14T14:42:51.737 INFO:teuthology.orchestra.run.smithi039.stdout:046 2024-05-14T14:42:51.737 INFO:teuthology.orchestra.run.smithi039.stdout:046.out 2024-05-14T14:42:51.737 INFO:teuthology.orchestra.run.smithi039.stdout:047 2024-05-14T14:42:51.737 INFO:teuthology.orchestra.run.smithi039.stdout:047.out 2024-05-14T14:42:51.737 INFO:teuthology.orchestra.run.smithi039.stdout:048 2024-05-14T14:42:51.737 INFO:teuthology.orchestra.run.smithi039.stdout:048.out 2024-05-14T14:42:51.737 INFO:teuthology.orchestra.run.smithi039.stdout:049 2024-05-14T14:42:51.738 INFO:teuthology.orchestra.run.smithi039.stdout:049.out 2024-05-14T14:42:51.738 INFO:teuthology.orchestra.run.smithi039.stdout:050 2024-05-14T14:42:51.738 INFO:teuthology.orchestra.run.smithi039.stdout:050.cfg 2024-05-14T14:42:51.738 INFO:teuthology.orchestra.run.smithi039.stdout:050.out.default 2024-05-14T14:42:51.738 INFO:teuthology.orchestra.run.smithi039.stdout:050.out.nojournal 2024-05-14T14:42:51.738 INFO:teuthology.orchestra.run.smithi039.stdout:050.out.xfsquota 2024-05-14T14:42:51.738 INFO:teuthology.orchestra.run.smithi039.stdout:051 2024-05-14T14:42:51.738 INFO:teuthology.orchestra.run.smithi039.stdout:051.out 2024-05-14T14:42:51.738 INFO:teuthology.orchestra.run.smithi039.stdout:052 2024-05-14T14:42:51.738 INFO:teuthology.orchestra.run.smithi039.stdout:052.out 2024-05-14T14:42:51.738 INFO:teuthology.orchestra.run.smithi039.stdout:053 2024-05-14T14:42:51.738 INFO:teuthology.orchestra.run.smithi039.stdout:053.out 2024-05-14T14:42:51.738 INFO:teuthology.orchestra.run.smithi039.stdout:054 2024-05-14T14:42:51.738 INFO:teuthology.orchestra.run.smithi039.stdout:054.out 2024-05-14T14:42:51.739 INFO:teuthology.orchestra.run.smithi039.stdout:055 2024-05-14T14:42:51.739 INFO:teuthology.orchestra.run.smithi039.stdout:055.out 2024-05-14T14:42:51.739 INFO:teuthology.orchestra.run.smithi039.stdout:056 2024-05-14T14:42:51.739 INFO:teuthology.orchestra.run.smithi039.stdout:056.out 2024-05-14T14:42:51.739 INFO:teuthology.orchestra.run.smithi039.stdout:057 2024-05-14T14:42:51.739 INFO:teuthology.orchestra.run.smithi039.stdout:057.out 2024-05-14T14:42:51.739 INFO:teuthology.orchestra.run.smithi039.stdout:058 2024-05-14T14:42:51.739 INFO:teuthology.orchestra.run.smithi039.stdout:058.out 2024-05-14T14:42:51.739 INFO:teuthology.orchestra.run.smithi039.stdout:059 2024-05-14T14:42:51.739 INFO:teuthology.orchestra.run.smithi039.stdout:059.out 2024-05-14T14:42:51.739 INFO:teuthology.orchestra.run.smithi039.stdout:060 2024-05-14T14:42:51.739 INFO:teuthology.orchestra.run.smithi039.stdout:060.out 2024-05-14T14:42:51.739 INFO:teuthology.orchestra.run.smithi039.stdout:061 2024-05-14T14:42:51.739 INFO:teuthology.orchestra.run.smithi039.stdout:061.out 2024-05-14T14:42:51.739 INFO:teuthology.orchestra.run.smithi039.stdout:062 2024-05-14T14:42:51.740 INFO:teuthology.orchestra.run.smithi039.stdout:062.out 2024-05-14T14:42:51.740 INFO:teuthology.orchestra.run.smithi039.stdout:063 2024-05-14T14:42:51.740 INFO:teuthology.orchestra.run.smithi039.stdout:063.out 2024-05-14T14:42:51.740 INFO:teuthology.orchestra.run.smithi039.stdout:064 2024-05-14T14:42:51.740 INFO:teuthology.orchestra.run.smithi039.stdout:064.out 2024-05-14T14:42:51.740 INFO:teuthology.orchestra.run.smithi039.stdout:065 2024-05-14T14:42:51.740 INFO:teuthology.orchestra.run.smithi039.stdout:065.out 2024-05-14T14:42:51.740 INFO:teuthology.orchestra.run.smithi039.stdout:066 2024-05-14T14:42:51.740 INFO:teuthology.orchestra.run.smithi039.stdout:066.out 2024-05-14T14:42:51.740 INFO:teuthology.orchestra.run.smithi039.stdout:067 2024-05-14T14:42:51.740 INFO:teuthology.orchestra.run.smithi039.stdout:067.out 2024-05-14T14:42:51.740 INFO:teuthology.orchestra.run.smithi039.stdout:068 2024-05-14T14:42:51.740 INFO:teuthology.orchestra.run.smithi039.stdout:068.out 2024-05-14T14:42:51.740 INFO:teuthology.orchestra.run.smithi039.stdout:069 2024-05-14T14:42:51.740 INFO:teuthology.orchestra.run.smithi039.stdout:069.out 2024-05-14T14:42:51.741 INFO:teuthology.orchestra.run.smithi039.stdout:070 2024-05-14T14:42:51.741 INFO:teuthology.orchestra.run.smithi039.stdout:070.out 2024-05-14T14:42:51.741 INFO:teuthology.orchestra.run.smithi039.stdout:071 2024-05-14T14:42:51.741 INFO:teuthology.orchestra.run.smithi039.stdout:071.out 2024-05-14T14:42:51.741 INFO:teuthology.orchestra.run.smithi039.stdout:072 2024-05-14T14:42:51.741 INFO:teuthology.orchestra.run.smithi039.stdout:072.out 2024-05-14T14:42:51.741 INFO:teuthology.orchestra.run.smithi039.stdout:073 2024-05-14T14:42:51.741 INFO:teuthology.orchestra.run.smithi039.stdout:073.out 2024-05-14T14:42:51.741 INFO:teuthology.orchestra.run.smithi039.stdout:074 2024-05-14T14:42:51.741 INFO:teuthology.orchestra.run.smithi039.stdout:074.out 2024-05-14T14:42:51.741 INFO:teuthology.orchestra.run.smithi039.stdout:075 2024-05-14T14:42:51.741 INFO:teuthology.orchestra.run.smithi039.stdout:075.out 2024-05-14T14:42:51.741 INFO:teuthology.orchestra.run.smithi039.stdout:076 2024-05-14T14:42:51.741 INFO:teuthology.orchestra.run.smithi039.stdout:076.out 2024-05-14T14:42:51.741 INFO:teuthology.orchestra.run.smithi039.stdout:077 2024-05-14T14:42:51.741 INFO:teuthology.orchestra.run.smithi039.stdout:077.out 2024-05-14T14:42:51.742 INFO:teuthology.orchestra.run.smithi039.stdout:078 2024-05-14T14:42:51.742 INFO:teuthology.orchestra.run.smithi039.stdout:078.out 2024-05-14T14:42:51.742 INFO:teuthology.orchestra.run.smithi039.stdout:079 2024-05-14T14:42:51.742 INFO:teuthology.orchestra.run.smithi039.stdout:079.out 2024-05-14T14:42:51.742 INFO:teuthology.orchestra.run.smithi039.stdout:080 2024-05-14T14:42:51.742 INFO:teuthology.orchestra.run.smithi039.stdout:080.out 2024-05-14T14:42:51.742 INFO:teuthology.orchestra.run.smithi039.stdout:081 2024-05-14T14:42:51.742 INFO:teuthology.orchestra.run.smithi039.stdout:081.out 2024-05-14T14:42:51.742 INFO:teuthology.orchestra.run.smithi039.stdout:082 2024-05-14T14:42:51.742 INFO:teuthology.orchestra.run.smithi039.stdout:082.out 2024-05-14T14:42:51.742 INFO:teuthology.orchestra.run.smithi039.stdout:083 2024-05-14T14:42:51.742 INFO:teuthology.orchestra.run.smithi039.stdout:083.out 2024-05-14T14:42:51.742 INFO:teuthology.orchestra.run.smithi039.stdout:084 2024-05-14T14:42:51.742 INFO:teuthology.orchestra.run.smithi039.stdout:084.out 2024-05-14T14:42:51.743 INFO:teuthology.orchestra.run.smithi039.stdout:085 2024-05-14T14:42:51.743 INFO:teuthology.orchestra.run.smithi039.stdout:085.out 2024-05-14T14:42:51.743 INFO:teuthology.orchestra.run.smithi039.stdout:086 2024-05-14T14:42:51.743 INFO:teuthology.orchestra.run.smithi039.stdout:086.out 2024-05-14T14:42:51.743 INFO:teuthology.orchestra.run.smithi039.stdout:087 2024-05-14T14:42:51.743 INFO:teuthology.orchestra.run.smithi039.stdout:087.out 2024-05-14T14:42:51.743 INFO:teuthology.orchestra.run.smithi039.stdout:088 2024-05-14T14:42:51.743 INFO:teuthology.orchestra.run.smithi039.stdout:088.out 2024-05-14T14:42:51.743 INFO:teuthology.orchestra.run.smithi039.stdout:089 2024-05-14T14:42:51.743 INFO:teuthology.orchestra.run.smithi039.stdout:089.out 2024-05-14T14:42:51.743 INFO:teuthology.orchestra.run.smithi039.stdout:090 2024-05-14T14:42:51.743 INFO:teuthology.orchestra.run.smithi039.stdout:090.out 2024-05-14T14:42:51.743 INFO:teuthology.orchestra.run.smithi039.stdout:091 2024-05-14T14:42:51.743 INFO:teuthology.orchestra.run.smithi039.stdout:091.out 2024-05-14T14:42:51.744 INFO:teuthology.orchestra.run.smithi039.stdout:092 2024-05-14T14:42:51.744 INFO:teuthology.orchestra.run.smithi039.stdout:092.out 2024-05-14T14:42:51.744 INFO:teuthology.orchestra.run.smithi039.stdout:093 2024-05-14T14:42:51.744 INFO:teuthology.orchestra.run.smithi039.stdout:093.out 2024-05-14T14:42:51.744 INFO:teuthology.orchestra.run.smithi039.stdout:094 2024-05-14T14:42:51.744 INFO:teuthology.orchestra.run.smithi039.stdout:094.out 2024-05-14T14:42:51.744 INFO:teuthology.orchestra.run.smithi039.stdout:095 2024-05-14T14:42:51.744 INFO:teuthology.orchestra.run.smithi039.stdout:095.out 2024-05-14T14:42:51.744 INFO:teuthology.orchestra.run.smithi039.stdout:096 2024-05-14T14:42:51.744 INFO:teuthology.orchestra.run.smithi039.stdout:096.out 2024-05-14T14:42:51.744 INFO:teuthology.orchestra.run.smithi039.stdout:097 2024-05-14T14:42:51.744 INFO:teuthology.orchestra.run.smithi039.stdout:097.out 2024-05-14T14:42:51.744 INFO:teuthology.orchestra.run.smithi039.stdout:098 2024-05-14T14:42:51.744 INFO:teuthology.orchestra.run.smithi039.stdout:098.out 2024-05-14T14:42:51.744 INFO:teuthology.orchestra.run.smithi039.stdout:099 2024-05-14T14:42:51.745 INFO:teuthology.orchestra.run.smithi039.stdout:099.out 2024-05-14T14:42:51.745 INFO:teuthology.orchestra.run.smithi039.stdout:100 2024-05-14T14:42:51.745 INFO:teuthology.orchestra.run.smithi039.stdout:100.out 2024-05-14T14:42:51.745 INFO:teuthology.orchestra.run.smithi039.stdout:101 2024-05-14T14:42:51.745 INFO:teuthology.orchestra.run.smithi039.stdout:101.out 2024-05-14T14:42:51.745 INFO:teuthology.orchestra.run.smithi039.stdout:102 2024-05-14T14:42:51.745 INFO:teuthology.orchestra.run.smithi039.stdout:102.out 2024-05-14T14:42:51.745 INFO:teuthology.orchestra.run.smithi039.stdout:103 2024-05-14T14:42:51.745 INFO:teuthology.orchestra.run.smithi039.stdout:103.out 2024-05-14T14:42:51.745 INFO:teuthology.orchestra.run.smithi039.stdout:104 2024-05-14T14:42:51.745 INFO:teuthology.orchestra.run.smithi039.stdout:104.out 2024-05-14T14:42:51.745 INFO:teuthology.orchestra.run.smithi039.stdout:105 2024-05-14T14:42:51.745 INFO:teuthology.orchestra.run.smithi039.stdout:105.out 2024-05-14T14:42:51.745 INFO:teuthology.orchestra.run.smithi039.stdout:106 2024-05-14T14:42:51.745 INFO:teuthology.orchestra.run.smithi039.stdout:106.out 2024-05-14T14:42:51.746 INFO:teuthology.orchestra.run.smithi039.stdout:107 2024-05-14T14:42:51.746 INFO:teuthology.orchestra.run.smithi039.stdout:107.out 2024-05-14T14:42:51.746 INFO:teuthology.orchestra.run.smithi039.stdout:108 2024-05-14T14:42:51.746 INFO:teuthology.orchestra.run.smithi039.stdout:108.out 2024-05-14T14:42:51.746 INFO:teuthology.orchestra.run.smithi039.stdout:109 2024-05-14T14:42:51.746 INFO:teuthology.orchestra.run.smithi039.stdout:109.out 2024-05-14T14:42:51.746 INFO:teuthology.orchestra.run.smithi039.stdout:110 2024-05-14T14:42:51.746 INFO:teuthology.orchestra.run.smithi039.stdout:110.out 2024-05-14T14:42:51.746 INFO:teuthology.orchestra.run.smithi039.stdout:111 2024-05-14T14:42:51.746 INFO:teuthology.orchestra.run.smithi039.stdout:111.out 2024-05-14T14:42:51.746 INFO:teuthology.orchestra.run.smithi039.stdout:112 2024-05-14T14:42:51.746 INFO:teuthology.orchestra.run.smithi039.stdout:112.out 2024-05-14T14:42:51.746 INFO:teuthology.orchestra.run.smithi039.stdout:113 2024-05-14T14:42:51.746 INFO:teuthology.orchestra.run.smithi039.stdout:113.out 2024-05-14T14:42:51.747 INFO:teuthology.orchestra.run.smithi039.stdout:114 2024-05-14T14:42:51.747 INFO:teuthology.orchestra.run.smithi039.stdout:114.out 2024-05-14T14:42:51.747 INFO:teuthology.orchestra.run.smithi039.stdout:115 2024-05-14T14:42:51.747 INFO:teuthology.orchestra.run.smithi039.stdout:115.out 2024-05-14T14:42:51.747 INFO:teuthology.orchestra.run.smithi039.stdout:116 2024-05-14T14:42:51.747 INFO:teuthology.orchestra.run.smithi039.stdout:116.out 2024-05-14T14:42:51.747 INFO:teuthology.orchestra.run.smithi039.stdout:117 2024-05-14T14:42:51.747 INFO:teuthology.orchestra.run.smithi039.stdout:117.out 2024-05-14T14:42:51.747 INFO:teuthology.orchestra.run.smithi039.stdout:118 2024-05-14T14:42:51.747 INFO:teuthology.orchestra.run.smithi039.stdout:118.out 2024-05-14T14:42:51.747 INFO:teuthology.orchestra.run.smithi039.stdout:119 2024-05-14T14:42:51.747 INFO:teuthology.orchestra.run.smithi039.stdout:119.out 2024-05-14T14:42:51.747 INFO:teuthology.orchestra.run.smithi039.stdout:120 2024-05-14T14:42:51.747 INFO:teuthology.orchestra.run.smithi039.stdout:120.out 2024-05-14T14:42:51.748 INFO:teuthology.orchestra.run.smithi039.stdout:121 2024-05-14T14:42:51.748 INFO:teuthology.orchestra.run.smithi039.stdout:121.out 2024-05-14T14:42:51.748 INFO:teuthology.orchestra.run.smithi039.stdout:122 2024-05-14T14:42:51.748 INFO:teuthology.orchestra.run.smithi039.stdout:122.out 2024-05-14T14:42:51.748 INFO:teuthology.orchestra.run.smithi039.stdout:123 2024-05-14T14:42:51.748 INFO:teuthology.orchestra.run.smithi039.stdout:123.out 2024-05-14T14:42:51.748 INFO:teuthology.orchestra.run.smithi039.stdout:124 2024-05-14T14:42:51.748 INFO:teuthology.orchestra.run.smithi039.stdout:124.out 2024-05-14T14:42:51.748 INFO:teuthology.orchestra.run.smithi039.stdout:125 2024-05-14T14:42:51.748 INFO:teuthology.orchestra.run.smithi039.stdout:125.out 2024-05-14T14:42:51.748 INFO:teuthology.orchestra.run.smithi039.stdout:126 2024-05-14T14:42:51.748 INFO:teuthology.orchestra.run.smithi039.stdout:126.out 2024-05-14T14:42:51.748 INFO:teuthology.orchestra.run.smithi039.stdout:127 2024-05-14T14:42:51.748 INFO:teuthology.orchestra.run.smithi039.stdout:127.out 2024-05-14T14:42:51.748 INFO:teuthology.orchestra.run.smithi039.stdout:128 2024-05-14T14:42:51.748 INFO:teuthology.orchestra.run.smithi039.stdout:128.out 2024-05-14T14:42:51.749 INFO:teuthology.orchestra.run.smithi039.stdout:129 2024-05-14T14:42:51.749 INFO:teuthology.orchestra.run.smithi039.stdout:129.out 2024-05-14T14:42:51.749 INFO:teuthology.orchestra.run.smithi039.stdout:130 2024-05-14T14:42:51.749 INFO:teuthology.orchestra.run.smithi039.stdout:130.out 2024-05-14T14:42:51.749 INFO:teuthology.orchestra.run.smithi039.stdout:131 2024-05-14T14:42:51.749 INFO:teuthology.orchestra.run.smithi039.stdout:131.out 2024-05-14T14:42:51.749 INFO:teuthology.orchestra.run.smithi039.stdout:132 2024-05-14T14:42:51.749 INFO:teuthology.orchestra.run.smithi039.stdout:132.out 2024-05-14T14:42:51.749 INFO:teuthology.orchestra.run.smithi039.stdout:133 2024-05-14T14:42:51.749 INFO:teuthology.orchestra.run.smithi039.stdout:133.out 2024-05-14T14:42:51.749 INFO:teuthology.orchestra.run.smithi039.stdout:134 2024-05-14T14:42:51.749 INFO:teuthology.orchestra.run.smithi039.stdout:134.out 2024-05-14T14:42:51.749 INFO:teuthology.orchestra.run.smithi039.stdout:135 2024-05-14T14:42:51.749 INFO:teuthology.orchestra.run.smithi039.stdout:135.out 2024-05-14T14:42:51.749 INFO:teuthology.orchestra.run.smithi039.stdout:136 2024-05-14T14:42:51.750 INFO:teuthology.orchestra.run.smithi039.stdout:136.out 2024-05-14T14:42:51.750 INFO:teuthology.orchestra.run.smithi039.stdout:137 2024-05-14T14:42:51.750 INFO:teuthology.orchestra.run.smithi039.stdout:137.out 2024-05-14T14:42:51.750 INFO:teuthology.orchestra.run.smithi039.stdout:138 2024-05-14T14:42:51.750 INFO:teuthology.orchestra.run.smithi039.stdout:138.out 2024-05-14T14:42:51.750 INFO:teuthology.orchestra.run.smithi039.stdout:139 2024-05-14T14:42:51.750 INFO:teuthology.orchestra.run.smithi039.stdout:139.out 2024-05-14T14:42:51.750 INFO:teuthology.orchestra.run.smithi039.stdout:140 2024-05-14T14:42:51.750 INFO:teuthology.orchestra.run.smithi039.stdout:140.out 2024-05-14T14:42:51.750 INFO:teuthology.orchestra.run.smithi039.stdout:141 2024-05-14T14:42:51.750 INFO:teuthology.orchestra.run.smithi039.stdout:141.out 2024-05-14T14:42:51.750 INFO:teuthology.orchestra.run.smithi039.stdout:142 2024-05-14T14:42:51.750 INFO:teuthology.orchestra.run.smithi039.stdout:142.out 2024-05-14T14:42:51.750 INFO:teuthology.orchestra.run.smithi039.stdout:143 2024-05-14T14:42:51.750 INFO:teuthology.orchestra.run.smithi039.stdout:143.out 2024-05-14T14:42:51.751 INFO:teuthology.orchestra.run.smithi039.stdout:144 2024-05-14T14:42:51.751 INFO:teuthology.orchestra.run.smithi039.stdout:144.out 2024-05-14T14:42:51.751 INFO:teuthology.orchestra.run.smithi039.stdout:145 2024-05-14T14:42:51.751 INFO:teuthology.orchestra.run.smithi039.stdout:145.out 2024-05-14T14:42:51.751 INFO:teuthology.orchestra.run.smithi039.stdout:146 2024-05-14T14:42:51.751 INFO:teuthology.orchestra.run.smithi039.stdout:146.out 2024-05-14T14:42:51.751 INFO:teuthology.orchestra.run.smithi039.stdout:147 2024-05-14T14:42:51.751 INFO:teuthology.orchestra.run.smithi039.stdout:147.out 2024-05-14T14:42:51.751 INFO:teuthology.orchestra.run.smithi039.stdout:148 2024-05-14T14:42:51.751 INFO:teuthology.orchestra.run.smithi039.stdout:148.out 2024-05-14T14:42:51.751 INFO:teuthology.orchestra.run.smithi039.stdout:149 2024-05-14T14:42:51.751 INFO:teuthology.orchestra.run.smithi039.stdout:149.out 2024-05-14T14:42:51.751 INFO:teuthology.orchestra.run.smithi039.stdout:150 2024-05-14T14:42:51.751 INFO:teuthology.orchestra.run.smithi039.stdout:150.out 2024-05-14T14:42:51.751 INFO:teuthology.orchestra.run.smithi039.stdout:151 2024-05-14T14:42:51.751 INFO:teuthology.orchestra.run.smithi039.stdout:151.out 2024-05-14T14:42:51.751 INFO:teuthology.orchestra.run.smithi039.stdout:152 2024-05-14T14:42:51.752 INFO:teuthology.orchestra.run.smithi039.stdout:152.out 2024-05-14T14:42:51.752 INFO:teuthology.orchestra.run.smithi039.stdout:153 2024-05-14T14:42:51.752 INFO:teuthology.orchestra.run.smithi039.stdout:153.out 2024-05-14T14:42:51.752 INFO:teuthology.orchestra.run.smithi039.stdout:154 2024-05-14T14:42:51.752 INFO:teuthology.orchestra.run.smithi039.stdout:154.out 2024-05-14T14:42:51.752 INFO:teuthology.orchestra.run.smithi039.stdout:155 2024-05-14T14:42:51.752 INFO:teuthology.orchestra.run.smithi039.stdout:155.out 2024-05-14T14:42:51.752 INFO:teuthology.orchestra.run.smithi039.stdout:156 2024-05-14T14:42:51.752 INFO:teuthology.orchestra.run.smithi039.stdout:156.out 2024-05-14T14:42:51.752 INFO:teuthology.orchestra.run.smithi039.stdout:157 2024-05-14T14:42:51.752 INFO:teuthology.orchestra.run.smithi039.stdout:157.out 2024-05-14T14:42:51.752 INFO:teuthology.orchestra.run.smithi039.stdout:158 2024-05-14T14:42:51.752 INFO:teuthology.orchestra.run.smithi039.stdout:158.out 2024-05-14T14:42:51.752 INFO:teuthology.orchestra.run.smithi039.stdout:159 2024-05-14T14:42:51.752 INFO:teuthology.orchestra.run.smithi039.stdout:159.out 2024-05-14T14:42:51.752 INFO:teuthology.orchestra.run.smithi039.stdout:160 2024-05-14T14:42:51.753 INFO:teuthology.orchestra.run.smithi039.stdout:160.out 2024-05-14T14:42:51.753 INFO:teuthology.orchestra.run.smithi039.stdout:161 2024-05-14T14:42:51.753 INFO:teuthology.orchestra.run.smithi039.stdout:161.out 2024-05-14T14:42:51.753 INFO:teuthology.orchestra.run.smithi039.stdout:162 2024-05-14T14:42:51.753 INFO:teuthology.orchestra.run.smithi039.stdout:162.out 2024-05-14T14:42:51.753 INFO:teuthology.orchestra.run.smithi039.stdout:163 2024-05-14T14:42:51.753 INFO:teuthology.orchestra.run.smithi039.stdout:163.out 2024-05-14T14:42:51.753 INFO:teuthology.orchestra.run.smithi039.stdout:164 2024-05-14T14:42:51.753 INFO:teuthology.orchestra.run.smithi039.stdout:164.out 2024-05-14T14:42:51.753 INFO:teuthology.orchestra.run.smithi039.stdout:165 2024-05-14T14:42:51.753 INFO:teuthology.orchestra.run.smithi039.stdout:165.out 2024-05-14T14:42:51.753 INFO:teuthology.orchestra.run.smithi039.stdout:166 2024-05-14T14:42:51.753 INFO:teuthology.orchestra.run.smithi039.stdout:166.out 2024-05-14T14:42:51.753 INFO:teuthology.orchestra.run.smithi039.stdout:167 2024-05-14T14:42:51.753 INFO:teuthology.orchestra.run.smithi039.stdout:167.out 2024-05-14T14:42:51.753 INFO:teuthology.orchestra.run.smithi039.stdout:168 2024-05-14T14:42:51.753 INFO:teuthology.orchestra.run.smithi039.stdout:168.out 2024-05-14T14:42:51.754 INFO:teuthology.orchestra.run.smithi039.stdout:169 2024-05-14T14:42:51.754 INFO:teuthology.orchestra.run.smithi039.stdout:169.out 2024-05-14T14:42:51.754 INFO:teuthology.orchestra.run.smithi039.stdout:170 2024-05-14T14:42:51.754 INFO:teuthology.orchestra.run.smithi039.stdout:170.out 2024-05-14T14:42:51.754 INFO:teuthology.orchestra.run.smithi039.stdout:171 2024-05-14T14:42:51.754 INFO:teuthology.orchestra.run.smithi039.stdout:171.out 2024-05-14T14:42:51.754 INFO:teuthology.orchestra.run.smithi039.stdout:172 2024-05-14T14:42:51.754 INFO:teuthology.orchestra.run.smithi039.stdout:172.out 2024-05-14T14:42:51.754 INFO:teuthology.orchestra.run.smithi039.stdout:173 2024-05-14T14:42:51.754 INFO:teuthology.orchestra.run.smithi039.stdout:173.out 2024-05-14T14:42:51.754 INFO:teuthology.orchestra.run.smithi039.stdout:174 2024-05-14T14:42:51.754 INFO:teuthology.orchestra.run.smithi039.stdout:174.out 2024-05-14T14:42:51.754 INFO:teuthology.orchestra.run.smithi039.stdout:175 2024-05-14T14:42:51.754 INFO:teuthology.orchestra.run.smithi039.stdout:175.out 2024-05-14T14:42:51.754 INFO:teuthology.orchestra.run.smithi039.stdout:176 2024-05-14T14:42:51.755 INFO:teuthology.orchestra.run.smithi039.stdout:176.out 2024-05-14T14:42:51.755 INFO:teuthology.orchestra.run.smithi039.stdout:177 2024-05-14T14:42:51.755 INFO:teuthology.orchestra.run.smithi039.stdout:177.out 2024-05-14T14:42:51.755 INFO:teuthology.orchestra.run.smithi039.stdout:178 2024-05-14T14:42:51.755 INFO:teuthology.orchestra.run.smithi039.stdout:178.out 2024-05-14T14:42:51.755 INFO:teuthology.orchestra.run.smithi039.stdout:179 2024-05-14T14:42:51.755 INFO:teuthology.orchestra.run.smithi039.stdout:179.out 2024-05-14T14:42:51.755 INFO:teuthology.orchestra.run.smithi039.stdout:180 2024-05-14T14:42:51.755 INFO:teuthology.orchestra.run.smithi039.stdout:180.out 2024-05-14T14:42:51.755 INFO:teuthology.orchestra.run.smithi039.stdout:181 2024-05-14T14:42:51.755 INFO:teuthology.orchestra.run.smithi039.stdout:181.out 2024-05-14T14:42:51.755 INFO:teuthology.orchestra.run.smithi039.stdout:182 2024-05-14T14:42:51.755 INFO:teuthology.orchestra.run.smithi039.stdout:182.out 2024-05-14T14:42:51.755 INFO:teuthology.orchestra.run.smithi039.stdout:183 2024-05-14T14:42:51.755 INFO:teuthology.orchestra.run.smithi039.stdout:183.out 2024-05-14T14:42:51.755 INFO:teuthology.orchestra.run.smithi039.stdout:184 2024-05-14T14:42:51.756 INFO:teuthology.orchestra.run.smithi039.stdout:184.out 2024-05-14T14:42:51.756 INFO:teuthology.orchestra.run.smithi039.stdout:185 2024-05-14T14:42:51.756 INFO:teuthology.orchestra.run.smithi039.stdout:185.out 2024-05-14T14:42:51.756 INFO:teuthology.orchestra.run.smithi039.stdout:186 2024-05-14T14:42:51.756 INFO:teuthology.orchestra.run.smithi039.stdout:186.out 2024-05-14T14:42:51.756 INFO:teuthology.orchestra.run.smithi039.stdout:187 2024-05-14T14:42:51.756 INFO:teuthology.orchestra.run.smithi039.stdout:187.out 2024-05-14T14:42:51.756 INFO:teuthology.orchestra.run.smithi039.stdout:188 2024-05-14T14:42:51.756 INFO:teuthology.orchestra.run.smithi039.stdout:188.out 2024-05-14T14:42:51.756 INFO:teuthology.orchestra.run.smithi039.stdout:189 2024-05-14T14:42:51.756 INFO:teuthology.orchestra.run.smithi039.stdout:189.out 2024-05-14T14:42:51.756 INFO:teuthology.orchestra.run.smithi039.stdout:190 2024-05-14T14:42:51.756 INFO:teuthology.orchestra.run.smithi039.stdout:190.out 2024-05-14T14:42:51.756 INFO:teuthology.orchestra.run.smithi039.stdout:191 2024-05-14T14:42:51.756 INFO:teuthology.orchestra.run.smithi039.stdout:191.out 2024-05-14T14:42:51.756 INFO:teuthology.orchestra.run.smithi039.stdout:192 2024-05-14T14:42:51.756 INFO:teuthology.orchestra.run.smithi039.stdout:192.out 2024-05-14T14:42:51.757 INFO:teuthology.orchestra.run.smithi039.stdout:193 2024-05-14T14:42:51.757 INFO:teuthology.orchestra.run.smithi039.stdout:193.out 2024-05-14T14:42:51.757 INFO:teuthology.orchestra.run.smithi039.stdout:194 2024-05-14T14:42:51.757 INFO:teuthology.orchestra.run.smithi039.stdout:194.out 2024-05-14T14:42:51.757 INFO:teuthology.orchestra.run.smithi039.stdout:195 2024-05-14T14:42:51.757 INFO:teuthology.orchestra.run.smithi039.stdout:195.out 2024-05-14T14:42:51.757 INFO:teuthology.orchestra.run.smithi039.stdout:196 2024-05-14T14:42:51.757 INFO:teuthology.orchestra.run.smithi039.stdout:196.out 2024-05-14T14:42:51.757 INFO:teuthology.orchestra.run.smithi039.stdout:197 2024-05-14T14:42:51.757 INFO:teuthology.orchestra.run.smithi039.stdout:197.out 2024-05-14T14:42:51.757 INFO:teuthology.orchestra.run.smithi039.stdout:198 2024-05-14T14:42:51.757 INFO:teuthology.orchestra.run.smithi039.stdout:198.out 2024-05-14T14:42:51.757 INFO:teuthology.orchestra.run.smithi039.stdout:199 2024-05-14T14:42:51.757 INFO:teuthology.orchestra.run.smithi039.stdout:199.out 2024-05-14T14:42:51.758 INFO:teuthology.orchestra.run.smithi039.stdout:200 2024-05-14T14:42:51.758 INFO:teuthology.orchestra.run.smithi039.stdout:200.out 2024-05-14T14:42:51.758 INFO:teuthology.orchestra.run.smithi039.stdout:201 2024-05-14T14:42:51.758 INFO:teuthology.orchestra.run.smithi039.stdout:201.out 2024-05-14T14:42:51.758 INFO:teuthology.orchestra.run.smithi039.stdout:202 2024-05-14T14:42:51.758 INFO:teuthology.orchestra.run.smithi039.stdout:202.out 2024-05-14T14:42:51.758 INFO:teuthology.orchestra.run.smithi039.stdout:203 2024-05-14T14:42:51.758 INFO:teuthology.orchestra.run.smithi039.stdout:203.out 2024-05-14T14:42:51.758 INFO:teuthology.orchestra.run.smithi039.stdout:204 2024-05-14T14:42:51.758 INFO:teuthology.orchestra.run.smithi039.stdout:204.out 2024-05-14T14:42:51.758 INFO:teuthology.orchestra.run.smithi039.stdout:205 2024-05-14T14:42:51.758 INFO:teuthology.orchestra.run.smithi039.stdout:205.out 2024-05-14T14:42:51.758 INFO:teuthology.orchestra.run.smithi039.stdout:206 2024-05-14T14:42:51.758 INFO:teuthology.orchestra.run.smithi039.stdout:206.out 2024-05-14T14:42:51.758 INFO:teuthology.orchestra.run.smithi039.stdout:207 2024-05-14T14:42:51.759 INFO:teuthology.orchestra.run.smithi039.stdout:207.out 2024-05-14T14:42:51.759 INFO:teuthology.orchestra.run.smithi039.stdout:208 2024-05-14T14:42:51.759 INFO:teuthology.orchestra.run.smithi039.stdout:208.out 2024-05-14T14:42:51.759 INFO:teuthology.orchestra.run.smithi039.stdout:209 2024-05-14T14:42:51.759 INFO:teuthology.orchestra.run.smithi039.stdout:209.out 2024-05-14T14:42:51.759 INFO:teuthology.orchestra.run.smithi039.stdout:210 2024-05-14T14:42:51.759 INFO:teuthology.orchestra.run.smithi039.stdout:210.out 2024-05-14T14:42:51.759 INFO:teuthology.orchestra.run.smithi039.stdout:211 2024-05-14T14:42:51.759 INFO:teuthology.orchestra.run.smithi039.stdout:211.out 2024-05-14T14:42:51.759 INFO:teuthology.orchestra.run.smithi039.stdout:212 2024-05-14T14:42:51.759 INFO:teuthology.orchestra.run.smithi039.stdout:212.out 2024-05-14T14:42:51.759 INFO:teuthology.orchestra.run.smithi039.stdout:213 2024-05-14T14:42:51.759 INFO:teuthology.orchestra.run.smithi039.stdout:213.out 2024-05-14T14:42:51.759 INFO:teuthology.orchestra.run.smithi039.stdout:214 2024-05-14T14:42:51.759 INFO:teuthology.orchestra.run.smithi039.stdout:214.out 2024-05-14T14:42:51.759 INFO:teuthology.orchestra.run.smithi039.stdout:215 2024-05-14T14:42:51.760 INFO:teuthology.orchestra.run.smithi039.stdout:215.out 2024-05-14T14:42:51.760 INFO:teuthology.orchestra.run.smithi039.stdout:216 2024-05-14T14:42:51.760 INFO:teuthology.orchestra.run.smithi039.stdout:216.out 2024-05-14T14:42:51.760 INFO:teuthology.orchestra.run.smithi039.stdout:217 2024-05-14T14:42:51.760 INFO:teuthology.orchestra.run.smithi039.stdout:217.out 2024-05-14T14:42:51.760 INFO:teuthology.orchestra.run.smithi039.stdout:218 2024-05-14T14:42:51.760 INFO:teuthology.orchestra.run.smithi039.stdout:218.out 2024-05-14T14:42:51.760 INFO:teuthology.orchestra.run.smithi039.stdout:219 2024-05-14T14:42:51.760 INFO:teuthology.orchestra.run.smithi039.stdout:219.out 2024-05-14T14:42:51.760 INFO:teuthology.orchestra.run.smithi039.stdout:220 2024-05-14T14:42:51.760 INFO:teuthology.orchestra.run.smithi039.stdout:220.out 2024-05-14T14:42:51.760 INFO:teuthology.orchestra.run.smithi039.stdout:221 2024-05-14T14:42:51.760 INFO:teuthology.orchestra.run.smithi039.stdout:221.out 2024-05-14T14:42:51.760 INFO:teuthology.orchestra.run.smithi039.stdout:222 2024-05-14T14:42:51.760 INFO:teuthology.orchestra.run.smithi039.stdout:222.out 2024-05-14T14:42:51.760 INFO:teuthology.orchestra.run.smithi039.stdout:223 2024-05-14T14:42:51.761 INFO:teuthology.orchestra.run.smithi039.stdout:223.out 2024-05-14T14:42:51.761 INFO:teuthology.orchestra.run.smithi039.stdout:224 2024-05-14T14:42:51.761 INFO:teuthology.orchestra.run.smithi039.stdout:224.out 2024-05-14T14:42:51.761 INFO:teuthology.orchestra.run.smithi039.stdout:225 2024-05-14T14:42:51.761 INFO:teuthology.orchestra.run.smithi039.stdout:225.out 2024-05-14T14:42:51.761 INFO:teuthology.orchestra.run.smithi039.stdout:226 2024-05-14T14:42:51.761 INFO:teuthology.orchestra.run.smithi039.stdout:226.out 2024-05-14T14:42:51.761 INFO:teuthology.orchestra.run.smithi039.stdout:227 2024-05-14T14:42:51.761 INFO:teuthology.orchestra.run.smithi039.stdout:227.out 2024-05-14T14:42:51.761 INFO:teuthology.orchestra.run.smithi039.stdout:228 2024-05-14T14:42:51.761 INFO:teuthology.orchestra.run.smithi039.stdout:228.out 2024-05-14T14:42:51.761 INFO:teuthology.orchestra.run.smithi039.stdout:229 2024-05-14T14:42:51.761 INFO:teuthology.orchestra.run.smithi039.stdout:229.out 2024-05-14T14:42:51.761 INFO:teuthology.orchestra.run.smithi039.stdout:230 2024-05-14T14:42:51.761 INFO:teuthology.orchestra.run.smithi039.stdout:230.out 2024-05-14T14:42:51.761 INFO:teuthology.orchestra.run.smithi039.stdout:231 2024-05-14T14:42:51.762 INFO:teuthology.orchestra.run.smithi039.stdout:231.out 2024-05-14T14:42:51.762 INFO:teuthology.orchestra.run.smithi039.stdout:232 2024-05-14T14:42:51.762 INFO:teuthology.orchestra.run.smithi039.stdout:232.out 2024-05-14T14:42:51.762 INFO:teuthology.orchestra.run.smithi039.stdout:233 2024-05-14T14:42:51.762 INFO:teuthology.orchestra.run.smithi039.stdout:233.out 2024-05-14T14:42:51.762 INFO:teuthology.orchestra.run.smithi039.stdout:234 2024-05-14T14:42:51.762 INFO:teuthology.orchestra.run.smithi039.stdout:234.out 2024-05-14T14:42:51.762 INFO:teuthology.orchestra.run.smithi039.stdout:235 2024-05-14T14:42:51.762 INFO:teuthology.orchestra.run.smithi039.stdout:235.out 2024-05-14T14:42:51.762 INFO:teuthology.orchestra.run.smithi039.stdout:236 2024-05-14T14:42:51.762 INFO:teuthology.orchestra.run.smithi039.stdout:236.out 2024-05-14T14:42:51.762 INFO:teuthology.orchestra.run.smithi039.stdout:237 2024-05-14T14:42:51.762 INFO:teuthology.orchestra.run.smithi039.stdout:237.out 2024-05-14T14:42:51.762 INFO:teuthology.orchestra.run.smithi039.stdout:238 2024-05-14T14:42:51.762 INFO:teuthology.orchestra.run.smithi039.stdout:238.out 2024-05-14T14:42:51.763 INFO:teuthology.orchestra.run.smithi039.stdout:239 2024-05-14T14:42:51.763 INFO:teuthology.orchestra.run.smithi039.stdout:239.out 2024-05-14T14:42:51.763 INFO:teuthology.orchestra.run.smithi039.stdout:240 2024-05-14T14:42:51.763 INFO:teuthology.orchestra.run.smithi039.stdout:240.out 2024-05-14T14:42:51.763 INFO:teuthology.orchestra.run.smithi039.stdout:241 2024-05-14T14:42:51.763 INFO:teuthology.orchestra.run.smithi039.stdout:241.out 2024-05-14T14:42:51.763 INFO:teuthology.orchestra.run.smithi039.stdout:242 2024-05-14T14:42:51.763 INFO:teuthology.orchestra.run.smithi039.stdout:242.out 2024-05-14T14:42:51.763 INFO:teuthology.orchestra.run.smithi039.stdout:243 2024-05-14T14:42:51.763 INFO:teuthology.orchestra.run.smithi039.stdout:243.out 2024-05-14T14:42:51.763 INFO:teuthology.orchestra.run.smithi039.stdout:244 2024-05-14T14:42:51.763 INFO:teuthology.orchestra.run.smithi039.stdout:244.out 2024-05-14T14:42:51.763 INFO:teuthology.orchestra.run.smithi039.stdout:245 2024-05-14T14:42:51.763 INFO:teuthology.orchestra.run.smithi039.stdout:245.out 2024-05-14T14:42:51.763 INFO:teuthology.orchestra.run.smithi039.stdout:246 2024-05-14T14:42:51.763 INFO:teuthology.orchestra.run.smithi039.stdout:246.out 2024-05-14T14:42:51.764 INFO:teuthology.orchestra.run.smithi039.stdout:247 2024-05-14T14:42:51.764 INFO:teuthology.orchestra.run.smithi039.stdout:247.out 2024-05-14T14:42:51.764 INFO:teuthology.orchestra.run.smithi039.stdout:248 2024-05-14T14:42:51.764 INFO:teuthology.orchestra.run.smithi039.stdout:248.out 2024-05-14T14:42:51.764 INFO:teuthology.orchestra.run.smithi039.stdout:249 2024-05-14T14:42:51.764 INFO:teuthology.orchestra.run.smithi039.stdout:249.out 2024-05-14T14:42:51.764 INFO:teuthology.orchestra.run.smithi039.stdout:250 2024-05-14T14:42:51.764 INFO:teuthology.orchestra.run.smithi039.stdout:250.out 2024-05-14T14:42:51.764 INFO:teuthology.orchestra.run.smithi039.stdout:251 2024-05-14T14:42:51.764 INFO:teuthology.orchestra.run.smithi039.stdout:251.out 2024-05-14T14:42:51.764 INFO:teuthology.orchestra.run.smithi039.stdout:252 2024-05-14T14:42:51.764 INFO:teuthology.orchestra.run.smithi039.stdout:252.out 2024-05-14T14:42:51.764 INFO:teuthology.orchestra.run.smithi039.stdout:253 2024-05-14T14:42:51.764 INFO:teuthology.orchestra.run.smithi039.stdout:253.out 2024-05-14T14:42:51.764 INFO:teuthology.orchestra.run.smithi039.stdout:254 2024-05-14T14:42:51.765 INFO:teuthology.orchestra.run.smithi039.stdout:254.out 2024-05-14T14:42:51.765 INFO:teuthology.orchestra.run.smithi039.stdout:255 2024-05-14T14:42:51.765 INFO:teuthology.orchestra.run.smithi039.stdout:255.out 2024-05-14T14:42:51.765 INFO:teuthology.orchestra.run.smithi039.stdout:256 2024-05-14T14:42:51.765 INFO:teuthology.orchestra.run.smithi039.stdout:256.out 2024-05-14T14:42:51.765 INFO:teuthology.orchestra.run.smithi039.stdout:257 2024-05-14T14:42:51.765 INFO:teuthology.orchestra.run.smithi039.stdout:257.out 2024-05-14T14:42:51.765 INFO:teuthology.orchestra.run.smithi039.stdout:258 2024-05-14T14:42:51.765 INFO:teuthology.orchestra.run.smithi039.stdout:258.out 2024-05-14T14:42:51.765 INFO:teuthology.orchestra.run.smithi039.stdout:259 2024-05-14T14:42:51.765 INFO:teuthology.orchestra.run.smithi039.stdout:259.out 2024-05-14T14:42:51.765 INFO:teuthology.orchestra.run.smithi039.stdout:260 2024-05-14T14:42:51.765 INFO:teuthology.orchestra.run.smithi039.stdout:260.out 2024-05-14T14:42:51.765 INFO:teuthology.orchestra.run.smithi039.stdout:261 2024-05-14T14:42:51.765 INFO:teuthology.orchestra.run.smithi039.stdout:261.out 2024-05-14T14:42:51.765 INFO:teuthology.orchestra.run.smithi039.stdout:262 2024-05-14T14:42:51.766 INFO:teuthology.orchestra.run.smithi039.stdout:262.out 2024-05-14T14:42:51.766 INFO:teuthology.orchestra.run.smithi039.stdout:263 2024-05-14T14:42:51.766 INFO:teuthology.orchestra.run.smithi039.stdout:263.out 2024-05-14T14:42:51.766 INFO:teuthology.orchestra.run.smithi039.stdout:264 2024-05-14T14:42:51.766 INFO:teuthology.orchestra.run.smithi039.stdout:264.out 2024-05-14T14:42:51.766 INFO:teuthology.orchestra.run.smithi039.stdout:265 2024-05-14T14:42:51.766 INFO:teuthology.orchestra.run.smithi039.stdout:265.out 2024-05-14T14:42:51.766 INFO:teuthology.orchestra.run.smithi039.stdout:266 2024-05-14T14:42:51.766 INFO:teuthology.orchestra.run.smithi039.stdout:266.out 2024-05-14T14:42:51.766 INFO:teuthology.orchestra.run.smithi039.stdout:267 2024-05-14T14:42:51.766 INFO:teuthology.orchestra.run.smithi039.stdout:267.out 2024-05-14T14:42:51.766 INFO:teuthology.orchestra.run.smithi039.stdout:268 2024-05-14T14:42:51.766 INFO:teuthology.orchestra.run.smithi039.stdout:268.out 2024-05-14T14:42:51.766 INFO:teuthology.orchestra.run.smithi039.stdout:269 2024-05-14T14:42:51.766 INFO:teuthology.orchestra.run.smithi039.stdout:269.out 2024-05-14T14:42:51.767 INFO:teuthology.orchestra.run.smithi039.stdout:270 2024-05-14T14:42:51.767 INFO:teuthology.orchestra.run.smithi039.stdout:270.out 2024-05-14T14:42:51.767 INFO:teuthology.orchestra.run.smithi039.stdout:271 2024-05-14T14:42:51.767 INFO:teuthology.orchestra.run.smithi039.stdout:271.out 2024-05-14T14:42:51.767 INFO:teuthology.orchestra.run.smithi039.stdout:272 2024-05-14T14:42:51.767 INFO:teuthology.orchestra.run.smithi039.stdout:272.out 2024-05-14T14:42:51.767 INFO:teuthology.orchestra.run.smithi039.stdout:273 2024-05-14T14:42:51.767 INFO:teuthology.orchestra.run.smithi039.stdout:273.out 2024-05-14T14:42:51.767 INFO:teuthology.orchestra.run.smithi039.stdout:274 2024-05-14T14:42:51.767 INFO:teuthology.orchestra.run.smithi039.stdout:274.out 2024-05-14T14:42:51.767 INFO:teuthology.orchestra.run.smithi039.stdout:275 2024-05-14T14:42:51.767 INFO:teuthology.orchestra.run.smithi039.stdout:275.out 2024-05-14T14:42:51.767 INFO:teuthology.orchestra.run.smithi039.stdout:276 2024-05-14T14:42:51.767 INFO:teuthology.orchestra.run.smithi039.stdout:276.out 2024-05-14T14:42:51.767 INFO:teuthology.orchestra.run.smithi039.stdout:277 2024-05-14T14:42:51.768 INFO:teuthology.orchestra.run.smithi039.stdout:277.out 2024-05-14T14:42:51.768 INFO:teuthology.orchestra.run.smithi039.stdout:278 2024-05-14T14:42:51.768 INFO:teuthology.orchestra.run.smithi039.stdout:278.out 2024-05-14T14:42:51.768 INFO:teuthology.orchestra.run.smithi039.stdout:279 2024-05-14T14:42:51.768 INFO:teuthology.orchestra.run.smithi039.stdout:279.out 2024-05-14T14:42:51.768 INFO:teuthology.orchestra.run.smithi039.stdout:280 2024-05-14T14:42:51.768 INFO:teuthology.orchestra.run.smithi039.stdout:280.out 2024-05-14T14:42:51.768 INFO:teuthology.orchestra.run.smithi039.stdout:281 2024-05-14T14:42:51.768 INFO:teuthology.orchestra.run.smithi039.stdout:281.out 2024-05-14T14:42:51.768 INFO:teuthology.orchestra.run.smithi039.stdout:282 2024-05-14T14:42:51.768 INFO:teuthology.orchestra.run.smithi039.stdout:282.out 2024-05-14T14:42:51.768 INFO:teuthology.orchestra.run.smithi039.stdout:283 2024-05-14T14:42:51.768 INFO:teuthology.orchestra.run.smithi039.stdout:283.out 2024-05-14T14:42:51.768 INFO:teuthology.orchestra.run.smithi039.stdout:284 2024-05-14T14:42:51.768 INFO:teuthology.orchestra.run.smithi039.stdout:284.out 2024-05-14T14:42:51.768 INFO:teuthology.orchestra.run.smithi039.stdout:285 2024-05-14T14:42:51.769 INFO:teuthology.orchestra.run.smithi039.stdout:285.out 2024-05-14T14:42:51.769 INFO:teuthology.orchestra.run.smithi039.stdout:286 2024-05-14T14:42:51.769 INFO:teuthology.orchestra.run.smithi039.stdout:286.out 2024-05-14T14:42:51.769 INFO:teuthology.orchestra.run.smithi039.stdout:287 2024-05-14T14:42:51.769 INFO:teuthology.orchestra.run.smithi039.stdout:287.out 2024-05-14T14:42:51.769 INFO:teuthology.orchestra.run.smithi039.stdout:288 2024-05-14T14:42:51.769 INFO:teuthology.orchestra.run.smithi039.stdout:288.out 2024-05-14T14:42:51.769 INFO:teuthology.orchestra.run.smithi039.stdout:289 2024-05-14T14:42:51.769 INFO:teuthology.orchestra.run.smithi039.stdout:289.out 2024-05-14T14:42:51.769 INFO:teuthology.orchestra.run.smithi039.stdout:290 2024-05-14T14:42:51.769 INFO:teuthology.orchestra.run.smithi039.stdout:290.out 2024-05-14T14:42:51.769 INFO:teuthology.orchestra.run.smithi039.stdout:291 2024-05-14T14:42:51.769 INFO:teuthology.orchestra.run.smithi039.stdout:291.out 2024-05-14T14:42:51.769 INFO:teuthology.orchestra.run.smithi039.stdout:292 2024-05-14T14:42:51.770 INFO:teuthology.orchestra.run.smithi039.stdout:292.out 2024-05-14T14:42:51.770 INFO:teuthology.orchestra.run.smithi039.stdout:293 2024-05-14T14:42:51.770 INFO:teuthology.orchestra.run.smithi039.stdout:293.out 2024-05-14T14:42:51.770 INFO:teuthology.orchestra.run.smithi039.stdout:294 2024-05-14T14:42:51.770 INFO:teuthology.orchestra.run.smithi039.stdout:294.out 2024-05-14T14:42:51.770 INFO:teuthology.orchestra.run.smithi039.stdout:295 2024-05-14T14:42:51.770 INFO:teuthology.orchestra.run.smithi039.stdout:295.out 2024-05-14T14:42:51.770 INFO:teuthology.orchestra.run.smithi039.stdout:296 2024-05-14T14:42:51.770 INFO:teuthology.orchestra.run.smithi039.stdout:296.out 2024-05-14T14:42:51.770 INFO:teuthology.orchestra.run.smithi039.stdout:297 2024-05-14T14:42:51.770 INFO:teuthology.orchestra.run.smithi039.stdout:297.out 2024-05-14T14:42:51.770 INFO:teuthology.orchestra.run.smithi039.stdout:298 2024-05-14T14:42:51.770 INFO:teuthology.orchestra.run.smithi039.stdout:298.out 2024-05-14T14:42:51.770 INFO:teuthology.orchestra.run.smithi039.stdout:299 2024-05-14T14:42:51.770 INFO:teuthology.orchestra.run.smithi039.stdout:299.out 2024-05-14T14:42:51.771 INFO:teuthology.orchestra.run.smithi039.stdout:300 2024-05-14T14:42:51.771 INFO:teuthology.orchestra.run.smithi039.stdout:300.out 2024-05-14T14:42:51.771 INFO:teuthology.orchestra.run.smithi039.stdout:301 2024-05-14T14:42:51.771 INFO:teuthology.orchestra.run.smithi039.stdout:301.out 2024-05-14T14:42:51.771 INFO:teuthology.orchestra.run.smithi039.stdout:302 2024-05-14T14:42:51.771 INFO:teuthology.orchestra.run.smithi039.stdout:302.out 2024-05-14T14:42:51.771 INFO:teuthology.orchestra.run.smithi039.stdout:303 2024-05-14T14:42:51.771 INFO:teuthology.orchestra.run.smithi039.stdout:303.out 2024-05-14T14:42:51.771 INFO:teuthology.orchestra.run.smithi039.stdout:304 2024-05-14T14:42:51.771 INFO:teuthology.orchestra.run.smithi039.stdout:304.out 2024-05-14T14:42:51.771 INFO:teuthology.orchestra.run.smithi039.stdout:305 2024-05-14T14:42:51.771 INFO:teuthology.orchestra.run.smithi039.stdout:305.out 2024-05-14T14:42:51.771 INFO:teuthology.orchestra.run.smithi039.stdout:306 2024-05-14T14:42:51.771 INFO:teuthology.orchestra.run.smithi039.stdout:306.out 2024-05-14T14:42:51.771 INFO:teuthology.orchestra.run.smithi039.stdout:307 2024-05-14T14:42:51.772 INFO:teuthology.orchestra.run.smithi039.stdout:307.out 2024-05-14T14:42:51.772 INFO:teuthology.orchestra.run.smithi039.stdout:308 2024-05-14T14:42:51.772 INFO:teuthology.orchestra.run.smithi039.stdout:308.out 2024-05-14T14:42:51.772 INFO:teuthology.orchestra.run.smithi039.stdout:309 2024-05-14T14:42:51.772 INFO:teuthology.orchestra.run.smithi039.stdout:309.out 2024-05-14T14:42:51.772 INFO:teuthology.orchestra.run.smithi039.stdout:310 2024-05-14T14:42:51.772 INFO:teuthology.orchestra.run.smithi039.stdout:310.out 2024-05-14T14:42:51.772 INFO:teuthology.orchestra.run.smithi039.stdout:311 2024-05-14T14:42:51.772 INFO:teuthology.orchestra.run.smithi039.stdout:311.out 2024-05-14T14:42:51.772 INFO:teuthology.orchestra.run.smithi039.stdout:312 2024-05-14T14:42:51.772 INFO:teuthology.orchestra.run.smithi039.stdout:312.out 2024-05-14T14:42:51.772 INFO:teuthology.orchestra.run.smithi039.stdout:313 2024-05-14T14:42:51.772 INFO:teuthology.orchestra.run.smithi039.stdout:313.out 2024-05-14T14:42:51.772 INFO:teuthology.orchestra.run.smithi039.stdout:314 2024-05-14T14:42:51.772 INFO:teuthology.orchestra.run.smithi039.stdout:314.out 2024-05-14T14:42:51.772 INFO:teuthology.orchestra.run.smithi039.stdout:315 2024-05-14T14:42:51.773 INFO:teuthology.orchestra.run.smithi039.stdout:315.out 2024-05-14T14:42:51.773 INFO:teuthology.orchestra.run.smithi039.stdout:316 2024-05-14T14:42:51.773 INFO:teuthology.orchestra.run.smithi039.stdout:316.out 2024-05-14T14:42:51.773 INFO:teuthology.orchestra.run.smithi039.stdout:317 2024-05-14T14:42:51.773 INFO:teuthology.orchestra.run.smithi039.stdout:317.out 2024-05-14T14:42:51.773 INFO:teuthology.orchestra.run.smithi039.stdout:318 2024-05-14T14:42:51.773 INFO:teuthology.orchestra.run.smithi039.stdout:318.out 2024-05-14T14:42:51.773 INFO:teuthology.orchestra.run.smithi039.stdout:319 2024-05-14T14:42:51.773 INFO:teuthology.orchestra.run.smithi039.stdout:319.out 2024-05-14T14:42:51.773 INFO:teuthology.orchestra.run.smithi039.stdout:320 2024-05-14T14:42:51.773 INFO:teuthology.orchestra.run.smithi039.stdout:320.out 2024-05-14T14:42:51.773 INFO:teuthology.orchestra.run.smithi039.stdout:321 2024-05-14T14:42:51.773 INFO:teuthology.orchestra.run.smithi039.stdout:321.out 2024-05-14T14:42:51.773 INFO:teuthology.orchestra.run.smithi039.stdout:322 2024-05-14T14:42:51.773 INFO:teuthology.orchestra.run.smithi039.stdout:322.out 2024-05-14T14:42:51.774 INFO:teuthology.orchestra.run.smithi039.stdout:323 2024-05-14T14:42:51.774 INFO:teuthology.orchestra.run.smithi039.stdout:323.out 2024-05-14T14:42:51.774 INFO:teuthology.orchestra.run.smithi039.stdout:324 2024-05-14T14:42:51.774 INFO:teuthology.orchestra.run.smithi039.stdout:324.out 2024-05-14T14:42:51.774 INFO:teuthology.orchestra.run.smithi039.stdout:325 2024-05-14T14:42:51.774 INFO:teuthology.orchestra.run.smithi039.stdout:325.out 2024-05-14T14:42:51.774 INFO:teuthology.orchestra.run.smithi039.stdout:326 2024-05-14T14:42:51.774 INFO:teuthology.orchestra.run.smithi039.stdout:326.out 2024-05-14T14:42:51.774 INFO:teuthology.orchestra.run.smithi039.stdout:327 2024-05-14T14:42:51.774 INFO:teuthology.orchestra.run.smithi039.stdout:327.out 2024-05-14T14:42:51.774 INFO:teuthology.orchestra.run.smithi039.stdout:328 2024-05-14T14:42:51.774 INFO:teuthology.orchestra.run.smithi039.stdout:328.out 2024-05-14T14:42:51.774 INFO:teuthology.orchestra.run.smithi039.stdout:329 2024-05-14T14:42:51.774 INFO:teuthology.orchestra.run.smithi039.stdout:329.out 2024-05-14T14:42:51.774 INFO:teuthology.orchestra.run.smithi039.stdout:330 2024-05-14T14:42:51.775 INFO:teuthology.orchestra.run.smithi039.stdout:330.out 2024-05-14T14:42:51.775 INFO:teuthology.orchestra.run.smithi039.stdout:331 2024-05-14T14:42:51.775 INFO:teuthology.orchestra.run.smithi039.stdout:331.out 2024-05-14T14:42:51.775 INFO:teuthology.orchestra.run.smithi039.stdout:332 2024-05-14T14:42:51.775 INFO:teuthology.orchestra.run.smithi039.stdout:332.out 2024-05-14T14:42:51.775 INFO:teuthology.orchestra.run.smithi039.stdout:333 2024-05-14T14:42:51.775 INFO:teuthology.orchestra.run.smithi039.stdout:333.out 2024-05-14T14:42:51.775 INFO:teuthology.orchestra.run.smithi039.stdout:334 2024-05-14T14:42:51.775 INFO:teuthology.orchestra.run.smithi039.stdout:334.out 2024-05-14T14:42:51.775 INFO:teuthology.orchestra.run.smithi039.stdout:335 2024-05-14T14:42:51.775 INFO:teuthology.orchestra.run.smithi039.stdout:335.out 2024-05-14T14:42:51.775 INFO:teuthology.orchestra.run.smithi039.stdout:336 2024-05-14T14:42:51.775 INFO:teuthology.orchestra.run.smithi039.stdout:336.out 2024-05-14T14:42:51.775 INFO:teuthology.orchestra.run.smithi039.stdout:337 2024-05-14T14:42:51.775 INFO:teuthology.orchestra.run.smithi039.stdout:337.out 2024-05-14T14:42:51.776 INFO:teuthology.orchestra.run.smithi039.stdout:338 2024-05-14T14:42:51.776 INFO:teuthology.orchestra.run.smithi039.stdout:338.out 2024-05-14T14:42:51.776 INFO:teuthology.orchestra.run.smithi039.stdout:339 2024-05-14T14:42:51.776 INFO:teuthology.orchestra.run.smithi039.stdout:339.out 2024-05-14T14:42:51.776 INFO:teuthology.orchestra.run.smithi039.stdout:340 2024-05-14T14:42:51.776 INFO:teuthology.orchestra.run.smithi039.stdout:340.out 2024-05-14T14:42:51.776 INFO:teuthology.orchestra.run.smithi039.stdout:341 2024-05-14T14:42:51.776 INFO:teuthology.orchestra.run.smithi039.stdout:341.out 2024-05-14T14:42:51.776 INFO:teuthology.orchestra.run.smithi039.stdout:342 2024-05-14T14:42:51.776 INFO:teuthology.orchestra.run.smithi039.stdout:342.out 2024-05-14T14:42:51.776 INFO:teuthology.orchestra.run.smithi039.stdout:343 2024-05-14T14:42:51.776 INFO:teuthology.orchestra.run.smithi039.stdout:343.out 2024-05-14T14:42:51.776 INFO:teuthology.orchestra.run.smithi039.stdout:344 2024-05-14T14:42:51.776 INFO:teuthology.orchestra.run.smithi039.stdout:344.out 2024-05-14T14:42:51.776 INFO:teuthology.orchestra.run.smithi039.stdout:345 2024-05-14T14:42:51.777 INFO:teuthology.orchestra.run.smithi039.stdout:345.out 2024-05-14T14:42:51.777 INFO:teuthology.orchestra.run.smithi039.stdout:346 2024-05-14T14:42:51.777 INFO:teuthology.orchestra.run.smithi039.stdout:346.out 2024-05-14T14:42:51.777 INFO:teuthology.orchestra.run.smithi039.stdout:347 2024-05-14T14:42:51.777 INFO:teuthology.orchestra.run.smithi039.stdout:347.out 2024-05-14T14:42:51.777 INFO:teuthology.orchestra.run.smithi039.stdout:348 2024-05-14T14:42:51.777 INFO:teuthology.orchestra.run.smithi039.stdout:348.out 2024-05-14T14:42:51.777 INFO:teuthology.orchestra.run.smithi039.stdout:349 2024-05-14T14:42:51.777 INFO:teuthology.orchestra.run.smithi039.stdout:349.out 2024-05-14T14:42:51.777 INFO:teuthology.orchestra.run.smithi039.stdout:350 2024-05-14T14:42:51.777 INFO:teuthology.orchestra.run.smithi039.stdout:350.out 2024-05-14T14:42:51.777 INFO:teuthology.orchestra.run.smithi039.stdout:351 2024-05-14T14:42:51.777 INFO:teuthology.orchestra.run.smithi039.stdout:351.out 2024-05-14T14:42:51.777 INFO:teuthology.orchestra.run.smithi039.stdout:352 2024-05-14T14:42:51.777 INFO:teuthology.orchestra.run.smithi039.stdout:352.out 2024-05-14T14:42:51.778 INFO:teuthology.orchestra.run.smithi039.stdout:353 2024-05-14T14:42:51.778 INFO:teuthology.orchestra.run.smithi039.stdout:353.out 2024-05-14T14:42:51.778 INFO:teuthology.orchestra.run.smithi039.stdout:354 2024-05-14T14:42:51.778 INFO:teuthology.orchestra.run.smithi039.stdout:354.out 2024-05-14T14:42:51.778 INFO:teuthology.orchestra.run.smithi039.stdout:355 2024-05-14T14:42:51.778 INFO:teuthology.orchestra.run.smithi039.stdout:355.out 2024-05-14T14:42:51.778 INFO:teuthology.orchestra.run.smithi039.stdout:356 2024-05-14T14:42:51.778 INFO:teuthology.orchestra.run.smithi039.stdout:356.out 2024-05-14T14:42:51.778 INFO:teuthology.orchestra.run.smithi039.stdout:357 2024-05-14T14:42:51.778 INFO:teuthology.orchestra.run.smithi039.stdout:357.out 2024-05-14T14:42:51.778 INFO:teuthology.orchestra.run.smithi039.stdout:358 2024-05-14T14:42:51.778 INFO:teuthology.orchestra.run.smithi039.stdout:358.out 2024-05-14T14:42:51.778 INFO:teuthology.orchestra.run.smithi039.stdout:359 2024-05-14T14:42:51.778 INFO:teuthology.orchestra.run.smithi039.stdout:359.out 2024-05-14T14:42:51.779 INFO:teuthology.orchestra.run.smithi039.stdout:360 2024-05-14T14:42:51.779 INFO:teuthology.orchestra.run.smithi039.stdout:360.out 2024-05-14T14:42:51.779 INFO:teuthology.orchestra.run.smithi039.stdout:361 2024-05-14T14:42:51.779 INFO:teuthology.orchestra.run.smithi039.stdout:361.out 2024-05-14T14:42:51.779 INFO:teuthology.orchestra.run.smithi039.stdout:362 2024-05-14T14:42:51.779 INFO:teuthology.orchestra.run.smithi039.stdout:362.out 2024-05-14T14:42:51.779 INFO:teuthology.orchestra.run.smithi039.stdout:363 2024-05-14T14:42:51.779 INFO:teuthology.orchestra.run.smithi039.stdout:363.out 2024-05-14T14:42:51.779 INFO:teuthology.orchestra.run.smithi039.stdout:364 2024-05-14T14:42:51.779 INFO:teuthology.orchestra.run.smithi039.stdout:364.out 2024-05-14T14:42:51.779 INFO:teuthology.orchestra.run.smithi039.stdout:365 2024-05-14T14:42:51.779 INFO:teuthology.orchestra.run.smithi039.stdout:365.out 2024-05-14T14:42:51.779 INFO:teuthology.orchestra.run.smithi039.stdout:366 2024-05-14T14:42:51.779 INFO:teuthology.orchestra.run.smithi039.stdout:366.out 2024-05-14T14:42:51.779 INFO:teuthology.orchestra.run.smithi039.stdout:367 2024-05-14T14:42:51.780 INFO:teuthology.orchestra.run.smithi039.stdout:367.out 2024-05-14T14:42:51.780 INFO:teuthology.orchestra.run.smithi039.stdout:368 2024-05-14T14:42:51.780 INFO:teuthology.orchestra.run.smithi039.stdout:368.out 2024-05-14T14:42:51.780 INFO:teuthology.orchestra.run.smithi039.stdout:369 2024-05-14T14:42:51.780 INFO:teuthology.orchestra.run.smithi039.stdout:369.out 2024-05-14T14:42:51.780 INFO:teuthology.orchestra.run.smithi039.stdout:370 2024-05-14T14:42:51.780 INFO:teuthology.orchestra.run.smithi039.stdout:370.out 2024-05-14T14:42:51.780 INFO:teuthology.orchestra.run.smithi039.stdout:371 2024-05-14T14:42:51.780 INFO:teuthology.orchestra.run.smithi039.stdout:371.out 2024-05-14T14:42:51.780 INFO:teuthology.orchestra.run.smithi039.stdout:372 2024-05-14T14:42:51.780 INFO:teuthology.orchestra.run.smithi039.stdout:372.out 2024-05-14T14:42:51.780 INFO:teuthology.orchestra.run.smithi039.stdout:373 2024-05-14T14:42:51.780 INFO:teuthology.orchestra.run.smithi039.stdout:373.out 2024-05-14T14:42:51.780 INFO:teuthology.orchestra.run.smithi039.stdout:374 2024-05-14T14:42:51.780 INFO:teuthology.orchestra.run.smithi039.stdout:374.out 2024-05-14T14:42:51.780 INFO:teuthology.orchestra.run.smithi039.stdout:375 2024-05-14T14:42:51.780 INFO:teuthology.orchestra.run.smithi039.stdout:375.out 2024-05-14T14:42:51.781 INFO:teuthology.orchestra.run.smithi039.stdout:376 2024-05-14T14:42:51.781 INFO:teuthology.orchestra.run.smithi039.stdout:376.out 2024-05-14T14:42:51.781 INFO:teuthology.orchestra.run.smithi039.stdout:377 2024-05-14T14:42:51.781 INFO:teuthology.orchestra.run.smithi039.stdout:377.out 2024-05-14T14:42:51.781 INFO:teuthology.orchestra.run.smithi039.stdout:378 2024-05-14T14:42:51.781 INFO:teuthology.orchestra.run.smithi039.stdout:378.out 2024-05-14T14:42:51.781 INFO:teuthology.orchestra.run.smithi039.stdout:379 2024-05-14T14:42:51.781 INFO:teuthology.orchestra.run.smithi039.stdout:379.out 2024-05-14T14:42:51.781 INFO:teuthology.orchestra.run.smithi039.stdout:380 2024-05-14T14:42:51.781 INFO:teuthology.orchestra.run.smithi039.stdout:380.out 2024-05-14T14:42:51.781 INFO:teuthology.orchestra.run.smithi039.stdout:381 2024-05-14T14:42:51.781 INFO:teuthology.orchestra.run.smithi039.stdout:381.out 2024-05-14T14:42:51.781 INFO:teuthology.orchestra.run.smithi039.stdout:382 2024-05-14T14:42:51.781 INFO:teuthology.orchestra.run.smithi039.stdout:382.out 2024-05-14T14:42:51.781 INFO:teuthology.orchestra.run.smithi039.stdout:383 2024-05-14T14:42:51.781 INFO:teuthology.orchestra.run.smithi039.stdout:383.out 2024-05-14T14:42:51.782 INFO:teuthology.orchestra.run.smithi039.stdout:384 2024-05-14T14:42:51.782 INFO:teuthology.orchestra.run.smithi039.stdout:384.out 2024-05-14T14:42:51.782 INFO:teuthology.orchestra.run.smithi039.stdout:385 2024-05-14T14:42:51.782 INFO:teuthology.orchestra.run.smithi039.stdout:385.out 2024-05-14T14:42:51.782 INFO:teuthology.orchestra.run.smithi039.stdout:386 2024-05-14T14:42:51.782 INFO:teuthology.orchestra.run.smithi039.stdout:386.out 2024-05-14T14:42:51.782 INFO:teuthology.orchestra.run.smithi039.stdout:387 2024-05-14T14:42:51.782 INFO:teuthology.orchestra.run.smithi039.stdout:387.out 2024-05-14T14:42:51.782 INFO:teuthology.orchestra.run.smithi039.stdout:388 2024-05-14T14:42:51.782 INFO:teuthology.orchestra.run.smithi039.stdout:388.out 2024-05-14T14:42:51.782 INFO:teuthology.orchestra.run.smithi039.stdout:389 2024-05-14T14:42:51.782 INFO:teuthology.orchestra.run.smithi039.stdout:389.out 2024-05-14T14:42:51.782 INFO:teuthology.orchestra.run.smithi039.stdout:390 2024-05-14T14:42:51.782 INFO:teuthology.orchestra.run.smithi039.stdout:390.out 2024-05-14T14:42:51.782 INFO:teuthology.orchestra.run.smithi039.stdout:391 2024-05-14T14:42:51.783 INFO:teuthology.orchestra.run.smithi039.stdout:391.out 2024-05-14T14:42:51.783 INFO:teuthology.orchestra.run.smithi039.stdout:392 2024-05-14T14:42:51.783 INFO:teuthology.orchestra.run.smithi039.stdout:392.out 2024-05-14T14:42:51.783 INFO:teuthology.orchestra.run.smithi039.stdout:393 2024-05-14T14:42:51.783 INFO:teuthology.orchestra.run.smithi039.stdout:393.out 2024-05-14T14:42:51.783 INFO:teuthology.orchestra.run.smithi039.stdout:394 2024-05-14T14:42:51.783 INFO:teuthology.orchestra.run.smithi039.stdout:394.out 2024-05-14T14:42:51.783 INFO:teuthology.orchestra.run.smithi039.stdout:395 2024-05-14T14:42:51.783 INFO:teuthology.orchestra.run.smithi039.stdout:395.out 2024-05-14T14:42:51.783 INFO:teuthology.orchestra.run.smithi039.stdout:396 2024-05-14T14:42:51.783 INFO:teuthology.orchestra.run.smithi039.stdout:396.out 2024-05-14T14:42:51.783 INFO:teuthology.orchestra.run.smithi039.stdout:397 2024-05-14T14:42:51.783 INFO:teuthology.orchestra.run.smithi039.stdout:397.out 2024-05-14T14:42:51.783 INFO:teuthology.orchestra.run.smithi039.stdout:398 2024-05-14T14:42:51.783 INFO:teuthology.orchestra.run.smithi039.stdout:398.out 2024-05-14T14:42:51.784 INFO:teuthology.orchestra.run.smithi039.stdout:399 2024-05-14T14:42:51.784 INFO:teuthology.orchestra.run.smithi039.stdout:399.out 2024-05-14T14:42:51.784 INFO:teuthology.orchestra.run.smithi039.stdout:400 2024-05-14T14:42:51.784 INFO:teuthology.orchestra.run.smithi039.stdout:400.out 2024-05-14T14:42:51.784 INFO:teuthology.orchestra.run.smithi039.stdout:401 2024-05-14T14:42:51.784 INFO:teuthology.orchestra.run.smithi039.stdout:401.out 2024-05-14T14:42:51.784 INFO:teuthology.orchestra.run.smithi039.stdout:402 2024-05-14T14:42:51.784 INFO:teuthology.orchestra.run.smithi039.stdout:402.out 2024-05-14T14:42:51.784 INFO:teuthology.orchestra.run.smithi039.stdout:403 2024-05-14T14:42:51.784 INFO:teuthology.orchestra.run.smithi039.stdout:403.out 2024-05-14T14:42:51.784 INFO:teuthology.orchestra.run.smithi039.stdout:404 2024-05-14T14:42:51.784 INFO:teuthology.orchestra.run.smithi039.stdout:404.out 2024-05-14T14:42:51.784 INFO:teuthology.orchestra.run.smithi039.stdout:405 2024-05-14T14:42:51.784 INFO:teuthology.orchestra.run.smithi039.stdout:405.out 2024-05-14T14:42:51.784 INFO:teuthology.orchestra.run.smithi039.stdout:406 2024-05-14T14:42:51.784 INFO:teuthology.orchestra.run.smithi039.stdout:406.out 2024-05-14T14:42:51.784 INFO:teuthology.orchestra.run.smithi039.stdout:407 2024-05-14T14:42:51.785 INFO:teuthology.orchestra.run.smithi039.stdout:407.out 2024-05-14T14:42:51.785 INFO:teuthology.orchestra.run.smithi039.stdout:408 2024-05-14T14:42:51.785 INFO:teuthology.orchestra.run.smithi039.stdout:408.out 2024-05-14T14:42:51.785 INFO:teuthology.orchestra.run.smithi039.stdout:409 2024-05-14T14:42:51.785 INFO:teuthology.orchestra.run.smithi039.stdout:409.out 2024-05-14T14:42:51.785 INFO:teuthology.orchestra.run.smithi039.stdout:410 2024-05-14T14:42:51.785 INFO:teuthology.orchestra.run.smithi039.stdout:410.out 2024-05-14T14:42:51.785 INFO:teuthology.orchestra.run.smithi039.stdout:411 2024-05-14T14:42:51.785 INFO:teuthology.orchestra.run.smithi039.stdout:411.out 2024-05-14T14:42:51.785 INFO:teuthology.orchestra.run.smithi039.stdout:412 2024-05-14T14:42:51.785 INFO:teuthology.orchestra.run.smithi039.stdout:412.out 2024-05-14T14:42:51.785 INFO:teuthology.orchestra.run.smithi039.stdout:413 2024-05-14T14:42:51.785 INFO:teuthology.orchestra.run.smithi039.stdout:413.out 2024-05-14T14:42:51.785 INFO:teuthology.orchestra.run.smithi039.stdout:414 2024-05-14T14:42:51.785 INFO:teuthology.orchestra.run.smithi039.stdout:414.out 2024-05-14T14:42:51.785 INFO:teuthology.orchestra.run.smithi039.stdout:415 2024-05-14T14:42:51.786 INFO:teuthology.orchestra.run.smithi039.stdout:415.out 2024-05-14T14:42:51.786 INFO:teuthology.orchestra.run.smithi039.stdout:416 2024-05-14T14:42:51.786 INFO:teuthology.orchestra.run.smithi039.stdout:416.out 2024-05-14T14:42:51.786 INFO:teuthology.orchestra.run.smithi039.stdout:417 2024-05-14T14:42:51.786 INFO:teuthology.orchestra.run.smithi039.stdout:417.out 2024-05-14T14:42:51.786 INFO:teuthology.orchestra.run.smithi039.stdout:418 2024-05-14T14:42:51.786 INFO:teuthology.orchestra.run.smithi039.stdout:418.out 2024-05-14T14:42:51.786 INFO:teuthology.orchestra.run.smithi039.stdout:419 2024-05-14T14:42:51.786 INFO:teuthology.orchestra.run.smithi039.stdout:419.out 2024-05-14T14:42:51.786 INFO:teuthology.orchestra.run.smithi039.stdout:420 2024-05-14T14:42:51.786 INFO:teuthology.orchestra.run.smithi039.stdout:420.out 2024-05-14T14:42:51.786 INFO:teuthology.orchestra.run.smithi039.stdout:421 2024-05-14T14:42:51.786 INFO:teuthology.orchestra.run.smithi039.stdout:421.out 2024-05-14T14:42:51.786 INFO:teuthology.orchestra.run.smithi039.stdout:422 2024-05-14T14:42:51.786 INFO:teuthology.orchestra.run.smithi039.stdout:422.out 2024-05-14T14:42:51.786 INFO:teuthology.orchestra.run.smithi039.stdout:423 2024-05-14T14:42:51.787 INFO:teuthology.orchestra.run.smithi039.stdout:423.out 2024-05-14T14:42:51.787 INFO:teuthology.orchestra.run.smithi039.stdout:424 2024-05-14T14:42:51.787 INFO:teuthology.orchestra.run.smithi039.stdout:424.out 2024-05-14T14:42:51.787 INFO:teuthology.orchestra.run.smithi039.stdout:425 2024-05-14T14:42:51.787 INFO:teuthology.orchestra.run.smithi039.stdout:425.out 2024-05-14T14:42:51.787 INFO:teuthology.orchestra.run.smithi039.stdout:426 2024-05-14T14:42:51.787 INFO:teuthology.orchestra.run.smithi039.stdout:426.out 2024-05-14T14:42:51.787 INFO:teuthology.orchestra.run.smithi039.stdout:427 2024-05-14T14:42:51.787 INFO:teuthology.orchestra.run.smithi039.stdout:427.out 2024-05-14T14:42:51.787 INFO:teuthology.orchestra.run.smithi039.stdout:428 2024-05-14T14:42:51.787 INFO:teuthology.orchestra.run.smithi039.stdout:428.out 2024-05-14T14:42:51.787 INFO:teuthology.orchestra.run.smithi039.stdout:429 2024-05-14T14:42:51.787 INFO:teuthology.orchestra.run.smithi039.stdout:429.out 2024-05-14T14:42:51.787 INFO:teuthology.orchestra.run.smithi039.stdout:430 2024-05-14T14:42:51.787 INFO:teuthology.orchestra.run.smithi039.stdout:430.out 2024-05-14T14:42:51.787 INFO:teuthology.orchestra.run.smithi039.stdout:431 2024-05-14T14:42:51.788 INFO:teuthology.orchestra.run.smithi039.stdout:431.out 2024-05-14T14:42:51.788 INFO:teuthology.orchestra.run.smithi039.stdout:432 2024-05-14T14:42:51.788 INFO:teuthology.orchestra.run.smithi039.stdout:432.out 2024-05-14T14:42:51.788 INFO:teuthology.orchestra.run.smithi039.stdout:433 2024-05-14T14:42:51.788 INFO:teuthology.orchestra.run.smithi039.stdout:433.out 2024-05-14T14:42:51.788 INFO:teuthology.orchestra.run.smithi039.stdout:434 2024-05-14T14:42:51.788 INFO:teuthology.orchestra.run.smithi039.stdout:434.out 2024-05-14T14:42:51.788 INFO:teuthology.orchestra.run.smithi039.stdout:435 2024-05-14T14:42:51.788 INFO:teuthology.orchestra.run.smithi039.stdout:435.out 2024-05-14T14:42:51.788 INFO:teuthology.orchestra.run.smithi039.stdout:436 2024-05-14T14:42:51.788 INFO:teuthology.orchestra.run.smithi039.stdout:436.out 2024-05-14T14:42:51.788 INFO:teuthology.orchestra.run.smithi039.stdout:437 2024-05-14T14:42:51.788 INFO:teuthology.orchestra.run.smithi039.stdout:437.out 2024-05-14T14:42:51.788 INFO:teuthology.orchestra.run.smithi039.stdout:438 2024-05-14T14:42:51.788 INFO:teuthology.orchestra.run.smithi039.stdout:438.out 2024-05-14T14:42:51.789 INFO:teuthology.orchestra.run.smithi039.stdout:439 2024-05-14T14:42:51.789 INFO:teuthology.orchestra.run.smithi039.stdout:439.out 2024-05-14T14:42:51.789 INFO:teuthology.orchestra.run.smithi039.stdout:440 2024-05-14T14:42:51.789 INFO:teuthology.orchestra.run.smithi039.stdout:440.out 2024-05-14T14:42:51.789 INFO:teuthology.orchestra.run.smithi039.stdout:441 2024-05-14T14:42:51.789 INFO:teuthology.orchestra.run.smithi039.stdout:441.out 2024-05-14T14:42:51.789 INFO:teuthology.orchestra.run.smithi039.stdout:442 2024-05-14T14:42:51.789 INFO:teuthology.orchestra.run.smithi039.stdout:442.out 2024-05-14T14:42:51.789 INFO:teuthology.orchestra.run.smithi039.stdout:443 2024-05-14T14:42:51.789 INFO:teuthology.orchestra.run.smithi039.stdout:443.out 2024-05-14T14:42:51.789 INFO:teuthology.orchestra.run.smithi039.stdout:444 2024-05-14T14:42:51.789 INFO:teuthology.orchestra.run.smithi039.stdout:444.out 2024-05-14T14:42:51.789 INFO:teuthology.orchestra.run.smithi039.stdout:445 2024-05-14T14:42:51.789 INFO:teuthology.orchestra.run.smithi039.stdout:445.out 2024-05-14T14:42:51.789 INFO:teuthology.orchestra.run.smithi039.stdout:446 2024-05-14T14:42:51.790 INFO:teuthology.orchestra.run.smithi039.stdout:446.out 2024-05-14T14:42:51.790 INFO:teuthology.orchestra.run.smithi039.stdout:447 2024-05-14T14:42:51.790 INFO:teuthology.orchestra.run.smithi039.stdout:447.out 2024-05-14T14:42:51.790 INFO:teuthology.orchestra.run.smithi039.stdout:448 2024-05-14T14:42:51.790 INFO:teuthology.orchestra.run.smithi039.stdout:448.out 2024-05-14T14:42:51.790 INFO:teuthology.orchestra.run.smithi039.stdout:449 2024-05-14T14:42:51.790 INFO:teuthology.orchestra.run.smithi039.stdout:449.out 2024-05-14T14:42:51.790 INFO:teuthology.orchestra.run.smithi039.stdout:450 2024-05-14T14:42:51.790 INFO:teuthology.orchestra.run.smithi039.stdout:450.out 2024-05-14T14:42:51.790 INFO:teuthology.orchestra.run.smithi039.stdout:451 2024-05-14T14:42:51.790 INFO:teuthology.orchestra.run.smithi039.stdout:451.out 2024-05-14T14:42:51.790 INFO:teuthology.orchestra.run.smithi039.stdout:452 2024-05-14T14:42:51.790 INFO:teuthology.orchestra.run.smithi039.stdout:452.out 2024-05-14T14:42:51.790 INFO:teuthology.orchestra.run.smithi039.stdout:453 2024-05-14T14:42:51.791 INFO:teuthology.orchestra.run.smithi039.stdout:453.out 2024-05-14T14:42:51.791 INFO:teuthology.orchestra.run.smithi039.stdout:454 2024-05-14T14:42:51.791 INFO:teuthology.orchestra.run.smithi039.stdout:454.out 2024-05-14T14:42:51.791 INFO:teuthology.orchestra.run.smithi039.stdout:455 2024-05-14T14:42:51.791 INFO:teuthology.orchestra.run.smithi039.stdout:455.out 2024-05-14T14:42:51.791 INFO:teuthology.orchestra.run.smithi039.stdout:456 2024-05-14T14:42:51.791 INFO:teuthology.orchestra.run.smithi039.stdout:456.out 2024-05-14T14:42:51.791 INFO:teuthology.orchestra.run.smithi039.stdout:457 2024-05-14T14:42:51.791 INFO:teuthology.orchestra.run.smithi039.stdout:457.out 2024-05-14T14:42:51.791 INFO:teuthology.orchestra.run.smithi039.stdout:458 2024-05-14T14:42:51.791 INFO:teuthology.orchestra.run.smithi039.stdout:458.out 2024-05-14T14:42:51.791 INFO:teuthology.orchestra.run.smithi039.stdout:459 2024-05-14T14:42:51.791 INFO:teuthology.orchestra.run.smithi039.stdout:459.out 2024-05-14T14:42:51.791 INFO:teuthology.orchestra.run.smithi039.stdout:460 2024-05-14T14:42:51.792 INFO:teuthology.orchestra.run.smithi039.stdout:460.out 2024-05-14T14:42:51.792 INFO:teuthology.orchestra.run.smithi039.stdout:461 2024-05-14T14:42:51.792 INFO:teuthology.orchestra.run.smithi039.stdout:461.out 2024-05-14T14:42:51.792 INFO:teuthology.orchestra.run.smithi039.stdout:462 2024-05-14T14:42:51.792 INFO:teuthology.orchestra.run.smithi039.stdout:462.out 2024-05-14T14:42:51.792 INFO:teuthology.orchestra.run.smithi039.stdout:463 2024-05-14T14:42:51.792 INFO:teuthology.orchestra.run.smithi039.stdout:463.out 2024-05-14T14:42:51.792 INFO:teuthology.orchestra.run.smithi039.stdout:464 2024-05-14T14:42:51.792 INFO:teuthology.orchestra.run.smithi039.stdout:464.out 2024-05-14T14:42:51.792 INFO:teuthology.orchestra.run.smithi039.stdout:465 2024-05-14T14:42:51.792 INFO:teuthology.orchestra.run.smithi039.stdout:465.out 2024-05-14T14:42:51.792 INFO:teuthology.orchestra.run.smithi039.stdout:466 2024-05-14T14:42:51.792 INFO:teuthology.orchestra.run.smithi039.stdout:466.out 2024-05-14T14:42:51.792 INFO:teuthology.orchestra.run.smithi039.stdout:467 2024-05-14T14:42:51.792 INFO:teuthology.orchestra.run.smithi039.stdout:467.out 2024-05-14T14:42:51.792 INFO:teuthology.orchestra.run.smithi039.stdout:468 2024-05-14T14:42:51.793 INFO:teuthology.orchestra.run.smithi039.stdout:468.out 2024-05-14T14:42:51.793 INFO:teuthology.orchestra.run.smithi039.stdout:469 2024-05-14T14:42:51.793 INFO:teuthology.orchestra.run.smithi039.stdout:469.out 2024-05-14T14:42:51.793 INFO:teuthology.orchestra.run.smithi039.stdout:470 2024-05-14T14:42:51.793 INFO:teuthology.orchestra.run.smithi039.stdout:470.out 2024-05-14T14:42:51.793 INFO:teuthology.orchestra.run.smithi039.stdout:471 2024-05-14T14:42:51.793 INFO:teuthology.orchestra.run.smithi039.stdout:471.out 2024-05-14T14:42:51.793 INFO:teuthology.orchestra.run.smithi039.stdout:472 2024-05-14T14:42:51.793 INFO:teuthology.orchestra.run.smithi039.stdout:472.out 2024-05-14T14:42:51.793 INFO:teuthology.orchestra.run.smithi039.stdout:473 2024-05-14T14:42:51.793 INFO:teuthology.orchestra.run.smithi039.stdout:473.out 2024-05-14T14:42:51.793 INFO:teuthology.orchestra.run.smithi039.stdout:474 2024-05-14T14:42:51.793 INFO:teuthology.orchestra.run.smithi039.stdout:474.out 2024-05-14T14:42:51.793 INFO:teuthology.orchestra.run.smithi039.stdout:475 2024-05-14T14:42:51.793 INFO:teuthology.orchestra.run.smithi039.stdout:475.out 2024-05-14T14:42:51.794 INFO:teuthology.orchestra.run.smithi039.stdout:476 2024-05-14T14:42:51.794 INFO:teuthology.orchestra.run.smithi039.stdout:476.out 2024-05-14T14:42:51.794 INFO:teuthology.orchestra.run.smithi039.stdout:477 2024-05-14T14:42:51.794 INFO:teuthology.orchestra.run.smithi039.stdout:477.out 2024-05-14T14:42:51.794 INFO:teuthology.orchestra.run.smithi039.stdout:478 2024-05-14T14:42:51.794 INFO:teuthology.orchestra.run.smithi039.stdout:478.out 2024-05-14T14:42:51.794 INFO:teuthology.orchestra.run.smithi039.stdout:479 2024-05-14T14:42:51.794 INFO:teuthology.orchestra.run.smithi039.stdout:479.out 2024-05-14T14:42:51.794 INFO:teuthology.orchestra.run.smithi039.stdout:480 2024-05-14T14:42:51.794 INFO:teuthology.orchestra.run.smithi039.stdout:480.out 2024-05-14T14:42:51.794 INFO:teuthology.orchestra.run.smithi039.stdout:481 2024-05-14T14:42:51.794 INFO:teuthology.orchestra.run.smithi039.stdout:481.out 2024-05-14T14:42:51.794 INFO:teuthology.orchestra.run.smithi039.stdout:482 2024-05-14T14:42:51.794 INFO:teuthology.orchestra.run.smithi039.stdout:482.out 2024-05-14T14:42:51.794 INFO:teuthology.orchestra.run.smithi039.stdout:483 2024-05-14T14:42:51.795 INFO:teuthology.orchestra.run.smithi039.stdout:483.out 2024-05-14T14:42:51.795 INFO:teuthology.orchestra.run.smithi039.stdout:484 2024-05-14T14:42:51.795 INFO:teuthology.orchestra.run.smithi039.stdout:484.out 2024-05-14T14:42:51.795 INFO:teuthology.orchestra.run.smithi039.stdout:485 2024-05-14T14:42:51.795 INFO:teuthology.orchestra.run.smithi039.stdout:485.out 2024-05-14T14:42:51.795 INFO:teuthology.orchestra.run.smithi039.stdout:486 2024-05-14T14:42:51.795 INFO:teuthology.orchestra.run.smithi039.stdout:486.out 2024-05-14T14:42:51.795 INFO:teuthology.orchestra.run.smithi039.stdout:487 2024-05-14T14:42:51.795 INFO:teuthology.orchestra.run.smithi039.stdout:487.out 2024-05-14T14:42:51.795 INFO:teuthology.orchestra.run.smithi039.stdout:488 2024-05-14T14:42:51.795 INFO:teuthology.orchestra.run.smithi039.stdout:488.out 2024-05-14T14:42:51.795 INFO:teuthology.orchestra.run.smithi039.stdout:489 2024-05-14T14:42:51.795 INFO:teuthology.orchestra.run.smithi039.stdout:489.out 2024-05-14T14:42:51.795 INFO:teuthology.orchestra.run.smithi039.stdout:490 2024-05-14T14:42:51.795 INFO:teuthology.orchestra.run.smithi039.stdout:490.out 2024-05-14T14:42:51.796 INFO:teuthology.orchestra.run.smithi039.stdout:491 2024-05-14T14:42:51.796 INFO:teuthology.orchestra.run.smithi039.stdout:491.out 2024-05-14T14:42:51.796 INFO:teuthology.orchestra.run.smithi039.stdout:492 2024-05-14T14:42:51.796 INFO:teuthology.orchestra.run.smithi039.stdout:492.out 2024-05-14T14:42:51.796 INFO:teuthology.orchestra.run.smithi039.stdout:493 2024-05-14T14:42:51.796 INFO:teuthology.orchestra.run.smithi039.stdout:493.out 2024-05-14T14:42:51.796 INFO:teuthology.orchestra.run.smithi039.stdout:494 2024-05-14T14:42:51.796 INFO:teuthology.orchestra.run.smithi039.stdout:494.out 2024-05-14T14:42:51.796 INFO:teuthology.orchestra.run.smithi039.stdout:495 2024-05-14T14:42:51.796 INFO:teuthology.orchestra.run.smithi039.stdout:495.out 2024-05-14T14:42:51.796 INFO:teuthology.orchestra.run.smithi039.stdout:496 2024-05-14T14:42:51.796 INFO:teuthology.orchestra.run.smithi039.stdout:496.out 2024-05-14T14:42:51.796 INFO:teuthology.orchestra.run.smithi039.stdout:497 2024-05-14T14:42:51.796 INFO:teuthology.orchestra.run.smithi039.stdout:497.out 2024-05-14T14:42:51.796 INFO:teuthology.orchestra.run.smithi039.stdout:498 2024-05-14T14:42:51.797 INFO:teuthology.orchestra.run.smithi039.stdout:498.out 2024-05-14T14:42:51.797 INFO:teuthology.orchestra.run.smithi039.stdout:499 2024-05-14T14:42:51.797 INFO:teuthology.orchestra.run.smithi039.stdout:499.out 2024-05-14T14:42:51.797 INFO:teuthology.orchestra.run.smithi039.stdout:500 2024-05-14T14:42:51.797 INFO:teuthology.orchestra.run.smithi039.stdout:500.out 2024-05-14T14:42:51.797 INFO:teuthology.orchestra.run.smithi039.stdout:501 2024-05-14T14:42:51.797 INFO:teuthology.orchestra.run.smithi039.stdout:501.out 2024-05-14T14:42:51.797 INFO:teuthology.orchestra.run.smithi039.stdout:502 2024-05-14T14:42:51.797 INFO:teuthology.orchestra.run.smithi039.stdout:502.out 2024-05-14T14:42:51.797 INFO:teuthology.orchestra.run.smithi039.stdout:503 2024-05-14T14:42:51.797 INFO:teuthology.orchestra.run.smithi039.stdout:503.out 2024-05-14T14:42:51.797 INFO:teuthology.orchestra.run.smithi039.stdout:504 2024-05-14T14:42:51.797 INFO:teuthology.orchestra.run.smithi039.stdout:504.out 2024-05-14T14:42:51.797 INFO:teuthology.orchestra.run.smithi039.stdout:505 2024-05-14T14:42:51.797 INFO:teuthology.orchestra.run.smithi039.stdout:505.out 2024-05-14T14:42:51.797 INFO:teuthology.orchestra.run.smithi039.stdout:506 2024-05-14T14:42:51.798 INFO:teuthology.orchestra.run.smithi039.stdout:506.out 2024-05-14T14:42:51.798 INFO:teuthology.orchestra.run.smithi039.stdout:507 2024-05-14T14:42:51.798 INFO:teuthology.orchestra.run.smithi039.stdout:507.out 2024-05-14T14:42:51.798 INFO:teuthology.orchestra.run.smithi039.stdout:508 2024-05-14T14:42:51.798 INFO:teuthology.orchestra.run.smithi039.stdout:508.out 2024-05-14T14:42:51.798 INFO:teuthology.orchestra.run.smithi039.stdout:509 2024-05-14T14:42:51.798 INFO:teuthology.orchestra.run.smithi039.stdout:509.out 2024-05-14T14:42:51.798 INFO:teuthology.orchestra.run.smithi039.stdout:510 2024-05-14T14:42:51.798 INFO:teuthology.orchestra.run.smithi039.stdout:510.out 2024-05-14T14:42:51.798 INFO:teuthology.orchestra.run.smithi039.stdout:511 2024-05-14T14:42:51.798 INFO:teuthology.orchestra.run.smithi039.stdout:511.out 2024-05-14T14:42:51.798 INFO:teuthology.orchestra.run.smithi039.stdout:512 2024-05-14T14:42:51.798 INFO:teuthology.orchestra.run.smithi039.stdout:512.out 2024-05-14T14:42:51.798 INFO:teuthology.orchestra.run.smithi039.stdout:513 2024-05-14T14:42:51.798 INFO:teuthology.orchestra.run.smithi039.stdout:513.out 2024-05-14T14:42:51.799 INFO:teuthology.orchestra.run.smithi039.stdout:514 2024-05-14T14:42:51.799 INFO:teuthology.orchestra.run.smithi039.stdout:514.out 2024-05-14T14:42:51.799 INFO:teuthology.orchestra.run.smithi039.stdout:515 2024-05-14T14:42:51.799 INFO:teuthology.orchestra.run.smithi039.stdout:515.out 2024-05-14T14:42:51.799 INFO:teuthology.orchestra.run.smithi039.stdout:516 2024-05-14T14:42:51.799 INFO:teuthology.orchestra.run.smithi039.stdout:516.out 2024-05-14T14:42:51.799 INFO:teuthology.orchestra.run.smithi039.stdout:517 2024-05-14T14:42:51.799 INFO:teuthology.orchestra.run.smithi039.stdout:517.out 2024-05-14T14:42:51.799 INFO:teuthology.orchestra.run.smithi039.stdout:518 2024-05-14T14:42:51.799 INFO:teuthology.orchestra.run.smithi039.stdout:518.out 2024-05-14T14:42:51.799 INFO:teuthology.orchestra.run.smithi039.stdout:519 2024-05-14T14:42:51.799 INFO:teuthology.orchestra.run.smithi039.stdout:519.out 2024-05-14T14:42:51.799 INFO:teuthology.orchestra.run.smithi039.stdout:520 2024-05-14T14:42:51.799 INFO:teuthology.orchestra.run.smithi039.stdout:520.out 2024-05-14T14:42:51.799 INFO:teuthology.orchestra.run.smithi039.stdout:521 2024-05-14T14:42:51.800 INFO:teuthology.orchestra.run.smithi039.stdout:521.out 2024-05-14T14:42:51.800 INFO:teuthology.orchestra.run.smithi039.stdout:522 2024-05-14T14:42:51.800 INFO:teuthology.orchestra.run.smithi039.stdout:522.out 2024-05-14T14:42:51.800 INFO:teuthology.orchestra.run.smithi039.stdout:523 2024-05-14T14:42:51.800 INFO:teuthology.orchestra.run.smithi039.stdout:523.out 2024-05-14T14:42:51.800 INFO:teuthology.orchestra.run.smithi039.stdout:524 2024-05-14T14:42:51.800 INFO:teuthology.orchestra.run.smithi039.stdout:524.out 2024-05-14T14:42:51.800 INFO:teuthology.orchestra.run.smithi039.stdout:525 2024-05-14T14:42:51.800 INFO:teuthology.orchestra.run.smithi039.stdout:525.out 2024-05-14T14:42:51.800 INFO:teuthology.orchestra.run.smithi039.stdout:526 2024-05-14T14:42:51.800 INFO:teuthology.orchestra.run.smithi039.stdout:526.out 2024-05-14T14:42:51.800 INFO:teuthology.orchestra.run.smithi039.stdout:527 2024-05-14T14:42:51.800 INFO:teuthology.orchestra.run.smithi039.stdout:527.out 2024-05-14T14:42:51.800 INFO:teuthology.orchestra.run.smithi039.stdout:528 2024-05-14T14:42:51.800 INFO:teuthology.orchestra.run.smithi039.stdout:528.out 2024-05-14T14:42:51.801 INFO:teuthology.orchestra.run.smithi039.stdout:529 2024-05-14T14:42:51.801 INFO:teuthology.orchestra.run.smithi039.stdout:529.out 2024-05-14T14:42:51.801 INFO:teuthology.orchestra.run.smithi039.stdout:530 2024-05-14T14:42:51.801 INFO:teuthology.orchestra.run.smithi039.stdout:530.out 2024-05-14T14:42:51.801 INFO:teuthology.orchestra.run.smithi039.stdout:531 2024-05-14T14:42:51.801 INFO:teuthology.orchestra.run.smithi039.stdout:531.out 2024-05-14T14:42:51.801 INFO:teuthology.orchestra.run.smithi039.stdout:532 2024-05-14T14:42:51.801 INFO:teuthology.orchestra.run.smithi039.stdout:532.out 2024-05-14T14:42:51.801 INFO:teuthology.orchestra.run.smithi039.stdout:533 2024-05-14T14:42:51.801 INFO:teuthology.orchestra.run.smithi039.stdout:533.out 2024-05-14T14:42:51.801 INFO:teuthology.orchestra.run.smithi039.stdout:534 2024-05-14T14:42:51.801 INFO:teuthology.orchestra.run.smithi039.stdout:534.out 2024-05-14T14:42:51.801 INFO:teuthology.orchestra.run.smithi039.stdout:535 2024-05-14T14:42:51.801 INFO:teuthology.orchestra.run.smithi039.stdout:535.out 2024-05-14T14:42:51.801 INFO:teuthology.orchestra.run.smithi039.stdout:536 2024-05-14T14:42:51.802 INFO:teuthology.orchestra.run.smithi039.stdout:536.out 2024-05-14T14:42:51.802 INFO:teuthology.orchestra.run.smithi039.stdout:537 2024-05-14T14:42:51.802 INFO:teuthology.orchestra.run.smithi039.stdout:537.out 2024-05-14T14:42:51.802 INFO:teuthology.orchestra.run.smithi039.stdout:538 2024-05-14T14:42:51.802 INFO:teuthology.orchestra.run.smithi039.stdout:538.out 2024-05-14T14:42:51.802 INFO:teuthology.orchestra.run.smithi039.stdout:539 2024-05-14T14:42:51.802 INFO:teuthology.orchestra.run.smithi039.stdout:539.out 2024-05-14T14:42:51.802 INFO:teuthology.orchestra.run.smithi039.stdout:540 2024-05-14T14:42:51.802 INFO:teuthology.orchestra.run.smithi039.stdout:540.out 2024-05-14T14:42:51.802 INFO:teuthology.orchestra.run.smithi039.stdout:541 2024-05-14T14:42:51.802 INFO:teuthology.orchestra.run.smithi039.stdout:541.out 2024-05-14T14:42:51.802 INFO:teuthology.orchestra.run.smithi039.stdout:542 2024-05-14T14:42:51.802 INFO:teuthology.orchestra.run.smithi039.stdout:542.out 2024-05-14T14:42:51.802 INFO:teuthology.orchestra.run.smithi039.stdout:543 2024-05-14T14:42:51.802 INFO:teuthology.orchestra.run.smithi039.stdout:543.out 2024-05-14T14:42:51.803 INFO:teuthology.orchestra.run.smithi039.stdout:544 2024-05-14T14:42:51.803 INFO:teuthology.orchestra.run.smithi039.stdout:544.out 2024-05-14T14:42:51.803 INFO:teuthology.orchestra.run.smithi039.stdout:545 2024-05-14T14:42:51.803 INFO:teuthology.orchestra.run.smithi039.stdout:545.out 2024-05-14T14:42:51.803 INFO:teuthology.orchestra.run.smithi039.stdout:546 2024-05-14T14:42:51.803 INFO:teuthology.orchestra.run.smithi039.stdout:546.out 2024-05-14T14:42:51.803 INFO:teuthology.orchestra.run.smithi039.stdout:547 2024-05-14T14:42:51.803 INFO:teuthology.orchestra.run.smithi039.stdout:547.out 2024-05-14T14:42:51.803 INFO:teuthology.orchestra.run.smithi039.stdout:548 2024-05-14T14:42:51.803 INFO:teuthology.orchestra.run.smithi039.stdout:548.out 2024-05-14T14:42:51.803 INFO:teuthology.orchestra.run.smithi039.stdout:549 2024-05-14T14:42:51.803 INFO:teuthology.orchestra.run.smithi039.stdout:549.out 2024-05-14T14:42:51.803 INFO:teuthology.orchestra.run.smithi039.stdout:550 2024-05-14T14:42:51.803 INFO:teuthology.orchestra.run.smithi039.stdout:550.out 2024-05-14T14:42:51.803 INFO:teuthology.orchestra.run.smithi039.stdout:551 2024-05-14T14:42:51.804 INFO:teuthology.orchestra.run.smithi039.stdout:551.out 2024-05-14T14:42:51.804 INFO:teuthology.orchestra.run.smithi039.stdout:552 2024-05-14T14:42:51.804 INFO:teuthology.orchestra.run.smithi039.stdout:552.out 2024-05-14T14:42:51.804 INFO:teuthology.orchestra.run.smithi039.stdout:553 2024-05-14T14:42:51.804 INFO:teuthology.orchestra.run.smithi039.stdout:553.out 2024-05-14T14:42:51.804 INFO:teuthology.orchestra.run.smithi039.stdout:554 2024-05-14T14:42:51.804 INFO:teuthology.orchestra.run.smithi039.stdout:554.out 2024-05-14T14:42:51.804 INFO:teuthology.orchestra.run.smithi039.stdout:555 2024-05-14T14:42:51.804 INFO:teuthology.orchestra.run.smithi039.stdout:555.out 2024-05-14T14:42:51.804 INFO:teuthology.orchestra.run.smithi039.stdout:556 2024-05-14T14:42:51.804 INFO:teuthology.orchestra.run.smithi039.stdout:556.out 2024-05-14T14:42:51.804 INFO:teuthology.orchestra.run.smithi039.stdout:557 2024-05-14T14:42:51.804 INFO:teuthology.orchestra.run.smithi039.stdout:557.out 2024-05-14T14:42:51.804 INFO:teuthology.orchestra.run.smithi039.stdout:558 2024-05-14T14:42:51.804 INFO:teuthology.orchestra.run.smithi039.stdout:558.out 2024-05-14T14:42:51.804 INFO:teuthology.orchestra.run.smithi039.stdout:559 2024-05-14T14:42:51.804 INFO:teuthology.orchestra.run.smithi039.stdout:559.out 2024-05-14T14:42:51.805 INFO:teuthology.orchestra.run.smithi039.stdout:560 2024-05-14T14:42:51.805 INFO:teuthology.orchestra.run.smithi039.stdout:560.out 2024-05-14T14:42:51.805 INFO:teuthology.orchestra.run.smithi039.stdout:561 2024-05-14T14:42:51.805 INFO:teuthology.orchestra.run.smithi039.stdout:561.out 2024-05-14T14:42:51.805 INFO:teuthology.orchestra.run.smithi039.stdout:562 2024-05-14T14:42:51.805 INFO:teuthology.orchestra.run.smithi039.stdout:562.out 2024-05-14T14:42:51.805 INFO:teuthology.orchestra.run.smithi039.stdout:563 2024-05-14T14:42:51.805 INFO:teuthology.orchestra.run.smithi039.stdout:563.out 2024-05-14T14:42:51.805 INFO:teuthology.orchestra.run.smithi039.stdout:564 2024-05-14T14:42:51.805 INFO:teuthology.orchestra.run.smithi039.stdout:564.out 2024-05-14T14:42:51.805 INFO:teuthology.orchestra.run.smithi039.stdout:565 2024-05-14T14:42:51.805 INFO:teuthology.orchestra.run.smithi039.stdout:565.out 2024-05-14T14:42:51.805 INFO:teuthology.orchestra.run.smithi039.stdout:566 2024-05-14T14:42:51.805 INFO:teuthology.orchestra.run.smithi039.stdout:566.out 2024-05-14T14:42:51.805 INFO:teuthology.orchestra.run.smithi039.stdout:567 2024-05-14T14:42:51.805 INFO:teuthology.orchestra.run.smithi039.stdout:567.out 2024-05-14T14:42:51.806 INFO:teuthology.orchestra.run.smithi039.stdout:568 2024-05-14T14:42:51.806 INFO:teuthology.orchestra.run.smithi039.stdout:568.out 2024-05-14T14:42:51.806 INFO:teuthology.orchestra.run.smithi039.stdout:569 2024-05-14T14:42:51.806 INFO:teuthology.orchestra.run.smithi039.stdout:569.out 2024-05-14T14:42:51.806 INFO:teuthology.orchestra.run.smithi039.stdout:570 2024-05-14T14:42:51.806 INFO:teuthology.orchestra.run.smithi039.stdout:570.out 2024-05-14T14:42:51.806 INFO:teuthology.orchestra.run.smithi039.stdout:571 2024-05-14T14:42:51.806 INFO:teuthology.orchestra.run.smithi039.stdout:571.out 2024-05-14T14:42:51.806 INFO:teuthology.orchestra.run.smithi039.stdout:572 2024-05-14T14:42:51.806 INFO:teuthology.orchestra.run.smithi039.stdout:572.out 2024-05-14T14:42:51.806 INFO:teuthology.orchestra.run.smithi039.stdout:573 2024-05-14T14:42:51.806 INFO:teuthology.orchestra.run.smithi039.stdout:573.out 2024-05-14T14:42:51.806 INFO:teuthology.orchestra.run.smithi039.stdout:574 2024-05-14T14:42:51.806 INFO:teuthology.orchestra.run.smithi039.stdout:574.out 2024-05-14T14:42:51.807 INFO:teuthology.orchestra.run.smithi039.stdout:575 2024-05-14T14:42:51.807 INFO:teuthology.orchestra.run.smithi039.stdout:575.out 2024-05-14T14:42:51.807 INFO:teuthology.orchestra.run.smithi039.stdout:576 2024-05-14T14:42:51.807 INFO:teuthology.orchestra.run.smithi039.stdout:576.out 2024-05-14T14:42:51.807 INFO:teuthology.orchestra.run.smithi039.stdout:577 2024-05-14T14:42:51.807 INFO:teuthology.orchestra.run.smithi039.stdout:577.out 2024-05-14T14:42:51.807 INFO:teuthology.orchestra.run.smithi039.stdout:578 2024-05-14T14:42:51.807 INFO:teuthology.orchestra.run.smithi039.stdout:578.out 2024-05-14T14:42:51.807 INFO:teuthology.orchestra.run.smithi039.stdout:579 2024-05-14T14:42:51.807 INFO:teuthology.orchestra.run.smithi039.stdout:579.out 2024-05-14T14:42:51.807 INFO:teuthology.orchestra.run.smithi039.stdout:580 2024-05-14T14:42:51.807 INFO:teuthology.orchestra.run.smithi039.stdout:580.out 2024-05-14T14:42:51.807 INFO:teuthology.orchestra.run.smithi039.stdout:581 2024-05-14T14:42:51.807 INFO:teuthology.orchestra.run.smithi039.stdout:581.out 2024-05-14T14:42:51.807 INFO:teuthology.orchestra.run.smithi039.stdout:582 2024-05-14T14:42:51.807 INFO:teuthology.orchestra.run.smithi039.stdout:582.out 2024-05-14T14:42:51.808 INFO:teuthology.orchestra.run.smithi039.stdout:583 2024-05-14T14:42:51.808 INFO:teuthology.orchestra.run.smithi039.stdout:583.out 2024-05-14T14:42:51.808 INFO:teuthology.orchestra.run.smithi039.stdout:584 2024-05-14T14:42:51.808 INFO:teuthology.orchestra.run.smithi039.stdout:584.out 2024-05-14T14:42:51.808 INFO:teuthology.orchestra.run.smithi039.stdout:585 2024-05-14T14:42:51.808 INFO:teuthology.orchestra.run.smithi039.stdout:585.out 2024-05-14T14:42:51.808 INFO:teuthology.orchestra.run.smithi039.stdout:586 2024-05-14T14:42:51.808 INFO:teuthology.orchestra.run.smithi039.stdout:586.out 2024-05-14T14:42:51.808 INFO:teuthology.orchestra.run.smithi039.stdout:587 2024-05-14T14:42:51.808 INFO:teuthology.orchestra.run.smithi039.stdout:587.out 2024-05-14T14:42:51.808 INFO:teuthology.orchestra.run.smithi039.stdout:588 2024-05-14T14:42:51.808 INFO:teuthology.orchestra.run.smithi039.stdout:588.out 2024-05-14T14:42:51.808 INFO:teuthology.orchestra.run.smithi039.stdout:589 2024-05-14T14:42:51.808 INFO:teuthology.orchestra.run.smithi039.stdout:589.out 2024-05-14T14:42:51.808 INFO:teuthology.orchestra.run.smithi039.stdout:590 2024-05-14T14:42:51.808 INFO:teuthology.orchestra.run.smithi039.stdout:590.out 2024-05-14T14:42:51.809 INFO:teuthology.orchestra.run.smithi039.stdout:591 2024-05-14T14:42:51.809 INFO:teuthology.orchestra.run.smithi039.stdout:591.out 2024-05-14T14:42:51.809 INFO:teuthology.orchestra.run.smithi039.stdout:592 2024-05-14T14:42:51.809 INFO:teuthology.orchestra.run.smithi039.stdout:592.out 2024-05-14T14:42:51.809 INFO:teuthology.orchestra.run.smithi039.stdout:593 2024-05-14T14:42:51.809 INFO:teuthology.orchestra.run.smithi039.stdout:593.out 2024-05-14T14:42:51.809 INFO:teuthology.orchestra.run.smithi039.stdout:594 2024-05-14T14:42:51.809 INFO:teuthology.orchestra.run.smithi039.stdout:594.out 2024-05-14T14:42:51.810 INFO:teuthology.orchestra.run.smithi039.stdout:595 2024-05-14T14:42:51.810 INFO:teuthology.orchestra.run.smithi039.stdout:595.out 2024-05-14T14:42:51.810 INFO:teuthology.orchestra.run.smithi039.stdout:596 2024-05-14T14:42:51.810 INFO:teuthology.orchestra.run.smithi039.stdout:596.out 2024-05-14T14:42:51.810 INFO:teuthology.orchestra.run.smithi039.stdout:597 2024-05-14T14:42:51.810 INFO:teuthology.orchestra.run.smithi039.stdout:597.out 2024-05-14T14:42:51.810 INFO:teuthology.orchestra.run.smithi039.stdout:598 2024-05-14T14:42:51.810 INFO:teuthology.orchestra.run.smithi039.stdout:598.out 2024-05-14T14:42:51.810 INFO:teuthology.orchestra.run.smithi039.stdout:599 2024-05-14T14:42:51.810 INFO:teuthology.orchestra.run.smithi039.stdout:599.out 2024-05-14T14:42:51.810 INFO:teuthology.orchestra.run.smithi039.stdout:600 2024-05-14T14:42:51.810 INFO:teuthology.orchestra.run.smithi039.stdout:600.out 2024-05-14T14:42:51.810 INFO:teuthology.orchestra.run.smithi039.stdout:601 2024-05-14T14:42:51.810 INFO:teuthology.orchestra.run.smithi039.stdout:601.out 2024-05-14T14:42:51.810 INFO:teuthology.orchestra.run.smithi039.stdout:602 2024-05-14T14:42:51.811 INFO:teuthology.orchestra.run.smithi039.stdout:602.out 2024-05-14T14:42:51.811 INFO:teuthology.orchestra.run.smithi039.stdout:603 2024-05-14T14:42:51.811 INFO:teuthology.orchestra.run.smithi039.stdout:603.out 2024-05-14T14:42:51.811 INFO:teuthology.orchestra.run.smithi039.stdout:604 2024-05-14T14:42:51.811 INFO:teuthology.orchestra.run.smithi039.stdout:604.out 2024-05-14T14:42:51.811 INFO:teuthology.orchestra.run.smithi039.stdout:605 2024-05-14T14:42:51.811 INFO:teuthology.orchestra.run.smithi039.stdout:605.out 2024-05-14T14:42:51.811 INFO:teuthology.orchestra.run.smithi039.stdout:606 2024-05-14T14:42:51.811 INFO:teuthology.orchestra.run.smithi039.stdout:606.out 2024-05-14T14:42:51.811 INFO:teuthology.orchestra.run.smithi039.stdout:607 2024-05-14T14:42:51.811 INFO:teuthology.orchestra.run.smithi039.stdout:607.out 2024-05-14T14:42:51.811 INFO:teuthology.orchestra.run.smithi039.stdout:608 2024-05-14T14:42:51.811 INFO:teuthology.orchestra.run.smithi039.stdout:608.out 2024-05-14T14:42:51.811 INFO:teuthology.orchestra.run.smithi039.stdout:609 2024-05-14T14:42:51.811 INFO:teuthology.orchestra.run.smithi039.stdout:609.out 2024-05-14T14:42:51.812 INFO:teuthology.orchestra.run.smithi039.stdout:610 2024-05-14T14:42:51.812 INFO:teuthology.orchestra.run.smithi039.stdout:610.out 2024-05-14T14:42:51.812 INFO:teuthology.orchestra.run.smithi039.stdout:611 2024-05-14T14:42:51.812 INFO:teuthology.orchestra.run.smithi039.stdout:611.out 2024-05-14T14:42:51.812 INFO:teuthology.orchestra.run.smithi039.stdout:612 2024-05-14T14:42:51.812 INFO:teuthology.orchestra.run.smithi039.stdout:612.out 2024-05-14T14:42:51.812 INFO:teuthology.orchestra.run.smithi039.stdout:613 2024-05-14T14:42:51.812 INFO:teuthology.orchestra.run.smithi039.stdout:613.out 2024-05-14T14:42:51.812 INFO:teuthology.orchestra.run.smithi039.stdout:614 2024-05-14T14:42:51.812 INFO:teuthology.orchestra.run.smithi039.stdout:614.out 2024-05-14T14:42:51.812 INFO:teuthology.orchestra.run.smithi039.stdout:615 2024-05-14T14:42:51.812 INFO:teuthology.orchestra.run.smithi039.stdout:615.out 2024-05-14T14:42:51.812 INFO:teuthology.orchestra.run.smithi039.stdout:616 2024-05-14T14:42:51.812 INFO:teuthology.orchestra.run.smithi039.stdout:616.out 2024-05-14T14:42:51.812 INFO:teuthology.orchestra.run.smithi039.stdout:617 2024-05-14T14:42:51.813 INFO:teuthology.orchestra.run.smithi039.stdout:617.out 2024-05-14T14:42:51.813 INFO:teuthology.orchestra.run.smithi039.stdout:618 2024-05-14T14:42:51.813 INFO:teuthology.orchestra.run.smithi039.stdout:618.out 2024-05-14T14:42:51.813 INFO:teuthology.orchestra.run.smithi039.stdout:619 2024-05-14T14:42:51.813 INFO:teuthology.orchestra.run.smithi039.stdout:619.out 2024-05-14T14:42:51.813 INFO:teuthology.orchestra.run.smithi039.stdout:620 2024-05-14T14:42:51.813 INFO:teuthology.orchestra.run.smithi039.stdout:620.out 2024-05-14T14:42:51.813 INFO:teuthology.orchestra.run.smithi039.stdout:621 2024-05-14T14:42:51.813 INFO:teuthology.orchestra.run.smithi039.stdout:621.out 2024-05-14T14:42:51.813 INFO:teuthology.orchestra.run.smithi039.stdout:622 2024-05-14T14:42:51.813 INFO:teuthology.orchestra.run.smithi039.stdout:622.out 2024-05-14T14:42:51.813 INFO:teuthology.orchestra.run.smithi039.stdout:623 2024-05-14T14:42:51.813 INFO:teuthology.orchestra.run.smithi039.stdout:623.out 2024-05-14T14:42:51.813 INFO:teuthology.orchestra.run.smithi039.stdout:624 2024-05-14T14:42:51.813 INFO:teuthology.orchestra.run.smithi039.stdout:624.out 2024-05-14T14:42:51.813 INFO:teuthology.orchestra.run.smithi039.stdout:625 2024-05-14T14:42:51.814 INFO:teuthology.orchestra.run.smithi039.stdout:625.out 2024-05-14T14:42:51.814 INFO:teuthology.orchestra.run.smithi039.stdout:626 2024-05-14T14:42:51.814 INFO:teuthology.orchestra.run.smithi039.stdout:626.out 2024-05-14T14:42:51.814 INFO:teuthology.orchestra.run.smithi039.stdout:627 2024-05-14T14:42:51.814 INFO:teuthology.orchestra.run.smithi039.stdout:627.out 2024-05-14T14:42:51.814 INFO:teuthology.orchestra.run.smithi039.stdout:628 2024-05-14T14:42:51.814 INFO:teuthology.orchestra.run.smithi039.stdout:628.out 2024-05-14T14:42:51.814 INFO:teuthology.orchestra.run.smithi039.stdout:629 2024-05-14T14:42:51.814 INFO:teuthology.orchestra.run.smithi039.stdout:629.out 2024-05-14T14:42:51.814 INFO:teuthology.orchestra.run.smithi039.stdout:630 2024-05-14T14:42:51.814 INFO:teuthology.orchestra.run.smithi039.stdout:630.out 2024-05-14T14:42:51.814 INFO:teuthology.orchestra.run.smithi039.stdout:631 2024-05-14T14:42:51.814 INFO:teuthology.orchestra.run.smithi039.stdout:631.out 2024-05-14T14:42:51.814 INFO:teuthology.orchestra.run.smithi039.stdout:632 2024-05-14T14:42:51.814 INFO:teuthology.orchestra.run.smithi039.stdout:632.out 2024-05-14T14:42:51.815 INFO:teuthology.orchestra.run.smithi039.stdout:633 2024-05-14T14:42:51.815 INFO:teuthology.orchestra.run.smithi039.stdout:633.out 2024-05-14T14:42:51.815 INFO:teuthology.orchestra.run.smithi039.stdout:634 2024-05-14T14:42:51.815 INFO:teuthology.orchestra.run.smithi039.stdout:634.out 2024-05-14T14:42:51.815 INFO:teuthology.orchestra.run.smithi039.stdout:635 2024-05-14T14:42:51.815 INFO:teuthology.orchestra.run.smithi039.stdout:635.out 2024-05-14T14:42:51.815 INFO:teuthology.orchestra.run.smithi039.stdout:636 2024-05-14T14:42:51.815 INFO:teuthology.orchestra.run.smithi039.stdout:636.out 2024-05-14T14:42:51.815 INFO:teuthology.orchestra.run.smithi039.stdout:637 2024-05-14T14:42:51.815 INFO:teuthology.orchestra.run.smithi039.stdout:637.out 2024-05-14T14:42:51.815 INFO:teuthology.orchestra.run.smithi039.stdout:638 2024-05-14T14:42:51.815 INFO:teuthology.orchestra.run.smithi039.stdout:638.out 2024-05-14T14:42:51.815 INFO:teuthology.orchestra.run.smithi039.stdout:639 2024-05-14T14:42:51.815 INFO:teuthology.orchestra.run.smithi039.stdout:639.out 2024-05-14T14:42:51.815 INFO:teuthology.orchestra.run.smithi039.stdout:640 2024-05-14T14:42:51.816 INFO:teuthology.orchestra.run.smithi039.stdout:640.out 2024-05-14T14:42:51.816 INFO:teuthology.orchestra.run.smithi039.stdout:641 2024-05-14T14:42:51.816 INFO:teuthology.orchestra.run.smithi039.stdout:641.out 2024-05-14T14:42:51.816 INFO:teuthology.orchestra.run.smithi039.stdout:642 2024-05-14T14:42:51.816 INFO:teuthology.orchestra.run.smithi039.stdout:642.out 2024-05-14T14:42:51.816 INFO:teuthology.orchestra.run.smithi039.stdout:643 2024-05-14T14:42:51.816 INFO:teuthology.orchestra.run.smithi039.stdout:643.out 2024-05-14T14:42:51.816 INFO:teuthology.orchestra.run.smithi039.stdout:644 2024-05-14T14:42:51.816 INFO:teuthology.orchestra.run.smithi039.stdout:644.out 2024-05-14T14:42:51.816 INFO:teuthology.orchestra.run.smithi039.stdout:645 2024-05-14T14:42:51.816 INFO:teuthology.orchestra.run.smithi039.stdout:645.out 2024-05-14T14:42:51.816 INFO:teuthology.orchestra.run.smithi039.stdout:646 2024-05-14T14:42:51.816 INFO:teuthology.orchestra.run.smithi039.stdout:646.out 2024-05-14T14:42:51.816 INFO:teuthology.orchestra.run.smithi039.stdout:647 2024-05-14T14:42:51.816 INFO:teuthology.orchestra.run.smithi039.stdout:647.out 2024-05-14T14:42:51.816 INFO:teuthology.orchestra.run.smithi039.stdout:648 2024-05-14T14:42:51.817 INFO:teuthology.orchestra.run.smithi039.stdout:648.out 2024-05-14T14:42:51.817 INFO:teuthology.orchestra.run.smithi039.stdout:649 2024-05-14T14:42:51.817 INFO:teuthology.orchestra.run.smithi039.stdout:649.out 2024-05-14T14:42:51.817 INFO:teuthology.orchestra.run.smithi039.stdout:650 2024-05-14T14:42:51.817 INFO:teuthology.orchestra.run.smithi039.stdout:650.out 2024-05-14T14:42:51.817 INFO:teuthology.orchestra.run.smithi039.stdout:651 2024-05-14T14:42:51.817 INFO:teuthology.orchestra.run.smithi039.stdout:651.out 2024-05-14T14:42:51.817 INFO:teuthology.orchestra.run.smithi039.stdout:652 2024-05-14T14:42:51.817 INFO:teuthology.orchestra.run.smithi039.stdout:652.out 2024-05-14T14:42:51.817 INFO:teuthology.orchestra.run.smithi039.stdout:653 2024-05-14T14:42:51.817 INFO:teuthology.orchestra.run.smithi039.stdout:653.out 2024-05-14T14:42:51.817 INFO:teuthology.orchestra.run.smithi039.stdout:654 2024-05-14T14:42:51.817 INFO:teuthology.orchestra.run.smithi039.stdout:654.out 2024-05-14T14:42:51.817 INFO:teuthology.orchestra.run.smithi039.stdout:655 2024-05-14T14:42:51.817 INFO:teuthology.orchestra.run.smithi039.stdout:655.out 2024-05-14T14:42:51.818 INFO:teuthology.orchestra.run.smithi039.stdout:656 2024-05-14T14:42:51.818 INFO:teuthology.orchestra.run.smithi039.stdout:656.out 2024-05-14T14:42:51.818 INFO:teuthology.orchestra.run.smithi039.stdout:657 2024-05-14T14:42:51.818 INFO:teuthology.orchestra.run.smithi039.stdout:657.out 2024-05-14T14:42:51.818 INFO:teuthology.orchestra.run.smithi039.stdout:658 2024-05-14T14:42:51.818 INFO:teuthology.orchestra.run.smithi039.stdout:658.out 2024-05-14T14:42:51.818 INFO:teuthology.orchestra.run.smithi039.stdout:659 2024-05-14T14:42:51.818 INFO:teuthology.orchestra.run.smithi039.stdout:659.out 2024-05-14T14:42:51.818 INFO:teuthology.orchestra.run.smithi039.stdout:660 2024-05-14T14:42:51.818 INFO:teuthology.orchestra.run.smithi039.stdout:660.out 2024-05-14T14:42:51.818 INFO:teuthology.orchestra.run.smithi039.stdout:661 2024-05-14T14:42:51.818 INFO:teuthology.orchestra.run.smithi039.stdout:661.out 2024-05-14T14:42:51.818 INFO:teuthology.orchestra.run.smithi039.stdout:662 2024-05-14T14:42:51.818 INFO:teuthology.orchestra.run.smithi039.stdout:662.out 2024-05-14T14:42:51.818 INFO:teuthology.orchestra.run.smithi039.stdout:663 2024-05-14T14:42:51.818 INFO:teuthology.orchestra.run.smithi039.stdout:663.out 2024-05-14T14:42:51.819 INFO:teuthology.orchestra.run.smithi039.stdout:664 2024-05-14T14:42:51.819 INFO:teuthology.orchestra.run.smithi039.stdout:664.out 2024-05-14T14:42:51.819 INFO:teuthology.orchestra.run.smithi039.stdout:665 2024-05-14T14:42:51.819 INFO:teuthology.orchestra.run.smithi039.stdout:665.out 2024-05-14T14:42:51.819 INFO:teuthology.orchestra.run.smithi039.stdout:666 2024-05-14T14:42:51.819 INFO:teuthology.orchestra.run.smithi039.stdout:666.out 2024-05-14T14:42:51.819 INFO:teuthology.orchestra.run.smithi039.stdout:667 2024-05-14T14:42:51.819 INFO:teuthology.orchestra.run.smithi039.stdout:667.out 2024-05-14T14:42:51.819 INFO:teuthology.orchestra.run.smithi039.stdout:668 2024-05-14T14:42:51.819 INFO:teuthology.orchestra.run.smithi039.stdout:668.out 2024-05-14T14:42:51.819 INFO:teuthology.orchestra.run.smithi039.stdout:669 2024-05-14T14:42:51.819 INFO:teuthology.orchestra.run.smithi039.stdout:669.out 2024-05-14T14:42:51.819 INFO:teuthology.orchestra.run.smithi039.stdout:670 2024-05-14T14:42:51.819 INFO:teuthology.orchestra.run.smithi039.stdout:670.out 2024-05-14T14:42:51.819 INFO:teuthology.orchestra.run.smithi039.stdout:671 2024-05-14T14:42:51.820 INFO:teuthology.orchestra.run.smithi039.stdout:671.out 2024-05-14T14:42:51.820 INFO:teuthology.orchestra.run.smithi039.stdout:672 2024-05-14T14:42:51.820 INFO:teuthology.orchestra.run.smithi039.stdout:672.out 2024-05-14T14:42:51.820 INFO:teuthology.orchestra.run.smithi039.stdout:673 2024-05-14T14:42:51.820 INFO:teuthology.orchestra.run.smithi039.stdout:673.out 2024-05-14T14:42:51.820 INFO:teuthology.orchestra.run.smithi039.stdout:674 2024-05-14T14:42:51.820 INFO:teuthology.orchestra.run.smithi039.stdout:674.out 2024-05-14T14:42:51.820 INFO:teuthology.orchestra.run.smithi039.stdout:675 2024-05-14T14:42:51.820 INFO:teuthology.orchestra.run.smithi039.stdout:675.out 2024-05-14T14:42:51.820 INFO:teuthology.orchestra.run.smithi039.stdout:676 2024-05-14T14:42:51.820 INFO:teuthology.orchestra.run.smithi039.stdout:676.out 2024-05-14T14:42:51.820 INFO:teuthology.orchestra.run.smithi039.stdout:677 2024-05-14T14:42:51.820 INFO:teuthology.orchestra.run.smithi039.stdout:677.out 2024-05-14T14:42:51.820 INFO:teuthology.orchestra.run.smithi039.stdout:678 2024-05-14T14:42:51.820 INFO:teuthology.orchestra.run.smithi039.stdout:678.out 2024-05-14T14:42:51.821 INFO:teuthology.orchestra.run.smithi039.stdout:679 2024-05-14T14:42:51.821 INFO:teuthology.orchestra.run.smithi039.stdout:679.out 2024-05-14T14:42:51.821 INFO:teuthology.orchestra.run.smithi039.stdout:680 2024-05-14T14:42:51.821 INFO:teuthology.orchestra.run.smithi039.stdout:680.out 2024-05-14T14:42:51.821 INFO:teuthology.orchestra.run.smithi039.stdout:681 2024-05-14T14:42:51.821 INFO:teuthology.orchestra.run.smithi039.stdout:681.out 2024-05-14T14:42:51.821 INFO:teuthology.orchestra.run.smithi039.stdout:682 2024-05-14T14:42:51.821 INFO:teuthology.orchestra.run.smithi039.stdout:682.out 2024-05-14T14:42:51.821 INFO:teuthology.orchestra.run.smithi039.stdout:683 2024-05-14T14:42:51.821 INFO:teuthology.orchestra.run.smithi039.stdout:683.out 2024-05-14T14:42:51.821 INFO:teuthology.orchestra.run.smithi039.stdout:684 2024-05-14T14:42:51.821 INFO:teuthology.orchestra.run.smithi039.stdout:684.out 2024-05-14T14:42:51.821 INFO:teuthology.orchestra.run.smithi039.stdout:685 2024-05-14T14:42:51.821 INFO:teuthology.orchestra.run.smithi039.stdout:685.out 2024-05-14T14:42:51.821 INFO:teuthology.orchestra.run.smithi039.stdout:686 2024-05-14T14:42:51.822 INFO:teuthology.orchestra.run.smithi039.stdout:686.out 2024-05-14T14:42:51.822 INFO:teuthology.orchestra.run.smithi039.stdout:687 2024-05-14T14:42:51.822 INFO:teuthology.orchestra.run.smithi039.stdout:687.out 2024-05-14T14:42:51.822 INFO:teuthology.orchestra.run.smithi039.stdout:688 2024-05-14T14:42:51.822 INFO:teuthology.orchestra.run.smithi039.stdout:688.out 2024-05-14T14:42:51.822 INFO:teuthology.orchestra.run.smithi039.stdout:689 2024-05-14T14:42:51.822 INFO:teuthology.orchestra.run.smithi039.stdout:689.out 2024-05-14T14:42:51.822 INFO:teuthology.orchestra.run.smithi039.stdout:690 2024-05-14T14:42:51.822 INFO:teuthology.orchestra.run.smithi039.stdout:690.out 2024-05-14T14:42:51.822 INFO:teuthology.orchestra.run.smithi039.stdout:691 2024-05-14T14:42:51.822 INFO:teuthology.orchestra.run.smithi039.stdout:691.out 2024-05-14T14:42:51.822 INFO:teuthology.orchestra.run.smithi039.stdout:692 2024-05-14T14:42:51.822 INFO:teuthology.orchestra.run.smithi039.stdout:692.out 2024-05-14T14:42:51.822 INFO:teuthology.orchestra.run.smithi039.stdout:693 2024-05-14T14:42:51.822 INFO:teuthology.orchestra.run.smithi039.stdout:693.out 2024-05-14T14:42:51.823 INFO:teuthology.orchestra.run.smithi039.stdout:694 2024-05-14T14:42:51.823 INFO:teuthology.orchestra.run.smithi039.stdout:694.out 2024-05-14T14:42:51.823 INFO:teuthology.orchestra.run.smithi039.stdout:695 2024-05-14T14:42:51.823 INFO:teuthology.orchestra.run.smithi039.stdout:695.out 2024-05-14T14:42:51.823 INFO:teuthology.orchestra.run.smithi039.stdout:696 2024-05-14T14:42:51.823 INFO:teuthology.orchestra.run.smithi039.stdout:696.out 2024-05-14T14:42:51.823 INFO:teuthology.orchestra.run.smithi039.stdout:697 2024-05-14T14:42:51.823 INFO:teuthology.orchestra.run.smithi039.stdout:697.out 2024-05-14T14:42:51.823 INFO:teuthology.orchestra.run.smithi039.stdout:698 2024-05-14T14:42:51.823 INFO:teuthology.orchestra.run.smithi039.stdout:698.out 2024-05-14T14:42:51.823 INFO:teuthology.orchestra.run.smithi039.stdout:699 2024-05-14T14:42:51.823 INFO:teuthology.orchestra.run.smithi039.stdout:699.out 2024-05-14T14:42:51.823 INFO:teuthology.orchestra.run.smithi039.stdout:700 2024-05-14T14:42:51.823 INFO:teuthology.orchestra.run.smithi039.stdout:700.out 2024-05-14T14:42:51.823 INFO:teuthology.orchestra.run.smithi039.stdout:701 2024-05-14T14:42:51.823 INFO:teuthology.orchestra.run.smithi039.stdout:701.out 2024-05-14T14:42:51.824 INFO:teuthology.orchestra.run.smithi039.stdout:702 2024-05-14T14:42:51.824 INFO:teuthology.orchestra.run.smithi039.stdout:702.out 2024-05-14T14:42:51.824 INFO:teuthology.orchestra.run.smithi039.stdout:703 2024-05-14T14:42:51.824 INFO:teuthology.orchestra.run.smithi039.stdout:703.out 2024-05-14T14:42:51.824 INFO:teuthology.orchestra.run.smithi039.stdout:704 2024-05-14T14:42:51.824 INFO:teuthology.orchestra.run.smithi039.stdout:704.out 2024-05-14T14:42:51.824 INFO:teuthology.orchestra.run.smithi039.stdout:705 2024-05-14T14:42:51.824 INFO:teuthology.orchestra.run.smithi039.stdout:705.out 2024-05-14T14:42:51.824 INFO:teuthology.orchestra.run.smithi039.stdout:706 2024-05-14T14:42:51.824 INFO:teuthology.orchestra.run.smithi039.stdout:706.out 2024-05-14T14:42:51.824 INFO:teuthology.orchestra.run.smithi039.stdout:707 2024-05-14T14:42:51.824 INFO:teuthology.orchestra.run.smithi039.stdout:707.out 2024-05-14T14:42:51.824 INFO:teuthology.orchestra.run.smithi039.stdout:708 2024-05-14T14:42:51.824 INFO:teuthology.orchestra.run.smithi039.stdout:708.out 2024-05-14T14:42:51.824 INFO:teuthology.orchestra.run.smithi039.stdout:709 2024-05-14T14:42:51.824 INFO:teuthology.orchestra.run.smithi039.stdout:709.out 2024-05-14T14:42:51.825 INFO:teuthology.orchestra.run.smithi039.stdout:710 2024-05-14T14:42:51.825 INFO:teuthology.orchestra.run.smithi039.stdout:710.out 2024-05-14T14:42:51.825 INFO:teuthology.orchestra.run.smithi039.stdout:711 2024-05-14T14:42:51.825 INFO:teuthology.orchestra.run.smithi039.stdout:711.out 2024-05-14T14:42:51.825 INFO:teuthology.orchestra.run.smithi039.stdout:712 2024-05-14T14:42:51.825 INFO:teuthology.orchestra.run.smithi039.stdout:712.out 2024-05-14T14:42:51.825 INFO:teuthology.orchestra.run.smithi039.stdout:713 2024-05-14T14:42:51.825 INFO:teuthology.orchestra.run.smithi039.stdout:713.out 2024-05-14T14:42:51.825 INFO:teuthology.orchestra.run.smithi039.stdout:714 2024-05-14T14:42:51.825 INFO:teuthology.orchestra.run.smithi039.stdout:714.out 2024-05-14T14:42:51.825 INFO:teuthology.orchestra.run.smithi039.stdout:715 2024-05-14T14:42:51.825 INFO:teuthology.orchestra.run.smithi039.stdout:715.out 2024-05-14T14:42:51.825 INFO:teuthology.orchestra.run.smithi039.stdout:716 2024-05-14T14:42:51.825 INFO:teuthology.orchestra.run.smithi039.stdout:716.out 2024-05-14T14:42:51.825 INFO:teuthology.orchestra.run.smithi039.stdout:717 2024-05-14T14:42:51.825 INFO:teuthology.orchestra.run.smithi039.stdout:717.out 2024-05-14T14:42:51.826 INFO:teuthology.orchestra.run.smithi039.stdout:718 2024-05-14T14:42:51.826 INFO:teuthology.orchestra.run.smithi039.stdout:718.out 2024-05-14T14:42:51.826 INFO:teuthology.orchestra.run.smithi039.stdout:719 2024-05-14T14:42:51.826 INFO:teuthology.orchestra.run.smithi039.stdout:719.out 2024-05-14T14:42:51.826 INFO:teuthology.orchestra.run.smithi039.stdout:720 2024-05-14T14:42:51.826 INFO:teuthology.orchestra.run.smithi039.stdout:720.out 2024-05-14T14:42:51.826 INFO:teuthology.orchestra.run.smithi039.stdout:721 2024-05-14T14:42:51.826 INFO:teuthology.orchestra.run.smithi039.stdout:721.out 2024-05-14T14:42:51.826 INFO:teuthology.orchestra.run.smithi039.stdout:722 2024-05-14T14:42:51.826 INFO:teuthology.orchestra.run.smithi039.stdout:722.out 2024-05-14T14:42:51.826 INFO:teuthology.orchestra.run.smithi039.stdout:723 2024-05-14T14:42:51.826 INFO:teuthology.orchestra.run.smithi039.stdout:723.out 2024-05-14T14:42:51.826 INFO:teuthology.orchestra.run.smithi039.stdout:724 2024-05-14T14:42:51.827 INFO:teuthology.orchestra.run.smithi039.stdout:724.out 2024-05-14T14:42:51.827 INFO:teuthology.orchestra.run.smithi039.stdout:725 2024-05-14T14:42:51.827 INFO:teuthology.orchestra.run.smithi039.stdout:725.out 2024-05-14T14:42:51.827 INFO:teuthology.orchestra.run.smithi039.stdout:726 2024-05-14T14:42:51.827 INFO:teuthology.orchestra.run.smithi039.stdout:726.out 2024-05-14T14:42:51.827 INFO:teuthology.orchestra.run.smithi039.stdout:727 2024-05-14T14:42:51.827 INFO:teuthology.orchestra.run.smithi039.stdout:727.out 2024-05-14T14:42:51.827 INFO:teuthology.orchestra.run.smithi039.stdout:728 2024-05-14T14:42:51.827 INFO:teuthology.orchestra.run.smithi039.stdout:728.out 2024-05-14T14:42:51.827 INFO:teuthology.orchestra.run.smithi039.stdout:729 2024-05-14T14:42:51.827 INFO:teuthology.orchestra.run.smithi039.stdout:729.out 2024-05-14T14:42:51.827 INFO:teuthology.orchestra.run.smithi039.stdout:730 2024-05-14T14:42:51.827 INFO:teuthology.orchestra.run.smithi039.stdout:730.out 2024-05-14T14:42:51.827 INFO:teuthology.orchestra.run.smithi039.stdout:731 2024-05-14T14:42:51.827 INFO:teuthology.orchestra.run.smithi039.stdout:731.out 2024-05-14T14:42:51.828 INFO:teuthology.orchestra.run.smithi039.stdout:732 2024-05-14T14:42:51.828 INFO:teuthology.orchestra.run.smithi039.stdout:732.out 2024-05-14T14:42:51.828 INFO:teuthology.orchestra.run.smithi039.stdout:733 2024-05-14T14:42:51.828 INFO:teuthology.orchestra.run.smithi039.stdout:733.out 2024-05-14T14:42:51.828 INFO:teuthology.orchestra.run.smithi039.stdout:734 2024-05-14T14:42:51.828 INFO:teuthology.orchestra.run.smithi039.stdout:734.out 2024-05-14T14:42:51.828 INFO:teuthology.orchestra.run.smithi039.stdout:735 2024-05-14T14:42:51.828 INFO:teuthology.orchestra.run.smithi039.stdout:735.out 2024-05-14T14:42:51.828 INFO:teuthology.orchestra.run.smithi039.stdout:736 2024-05-14T14:42:51.828 INFO:teuthology.orchestra.run.smithi039.stdout:736.out 2024-05-14T14:42:51.828 INFO:teuthology.orchestra.run.smithi039.stdout:737 2024-05-14T14:42:51.828 INFO:teuthology.orchestra.run.smithi039.stdout:737.out 2024-05-14T14:42:51.828 INFO:teuthology.orchestra.run.smithi039.stdout:738 2024-05-14T14:42:51.828 INFO:teuthology.orchestra.run.smithi039.stdout:738.out 2024-05-14T14:42:51.828 INFO:teuthology.orchestra.run.smithi039.stdout:739 2024-05-14T14:42:51.828 INFO:teuthology.orchestra.run.smithi039.stdout:739.out 2024-05-14T14:42:51.829 INFO:teuthology.orchestra.run.smithi039.stdout:741 2024-05-14T14:42:51.829 INFO:teuthology.orchestra.run.smithi039.stdout:741.out 2024-05-14T14:42:51.829 INFO:teuthology.orchestra.run.smithi039.stdout:742 2024-05-14T14:42:51.829 INFO:teuthology.orchestra.run.smithi039.stdout:742.out 2024-05-14T14:42:51.829 INFO:teuthology.orchestra.run.smithi039.stdout:743 2024-05-14T14:42:51.829 INFO:teuthology.orchestra.run.smithi039.stdout:743.out 2024-05-14T14:42:51.829 INFO:teuthology.orchestra.run.smithi039.stdout:744 2024-05-14T14:42:51.829 INFO:teuthology.orchestra.run.smithi039.stdout:744.out 2024-05-14T14:42:51.829 INFO:teuthology.orchestra.run.smithi039.stdout:group.list 2024-05-14T14:42:51.829 INFO:teuthology.orchestra.run.smithi039.stdout:Makefile 2024-05-14T14:42:51.831 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2024-05-14T14:42:52.049 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:42:52.053 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:42:52.053 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:42:52.054 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:42:52.054 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:42:58.209 INFO:teuthology.orchestra.run.smithi039.stdout:generic/001 6s 2024-05-14T14:42:58.215 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/001 2024-05-14T14:42:58.215 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:42:58.217 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:42:58.254 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:42:58.254 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2024-05-14T14:42:58.464 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:42:58.469 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:42:58.469 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:42:58.470 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:42:58.470 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:42:58.928 INFO:teuthology.orchestra.run.smithi039.stdout:generic/002 0s 2024-05-14T14:42:58.936 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/002 2024-05-14T14:42:58.936 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:42:58.939 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:42:59.005 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:42:59.006 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2024-05-14T14:42:59.224 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:42:59.228 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:42:59.228 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:42:59.229 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:42:59.229 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:42:59.464 INFO:teuthology.orchestra.run.smithi039.stdout:generic/003 [not run] atime not maintained by ceph 2024-05-14T14:42:59.468 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/003 2024-05-14T14:42:59.468 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/003 2024-05-14T14:42:59.468 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:42:59.471 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:42:59.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:42:59.482 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2024-05-14T14:42:59.690 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:42:59.694 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:42:59.694 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:42:59.695 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:42:59.695 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:42:59.947 INFO:teuthology.orchestra.run.smithi039.stdout:generic/004 [not run] O_TMPFILE is not supported 2024-05-14T14:42:59.951 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/004 2024-05-14T14:42:59.951 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/004 2024-05-14T14:42:59.951 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:42:59.954 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:42:59.966 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:42:59.966 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2024-05-14T14:43:00.161 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:43:00.165 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:43:00.165 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:43:00.166 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:43:00.166 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:43:00.593 INFO:teuthology.orchestra.run.smithi039.stdout:generic/005 0s 2024-05-14T14:43:00.599 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/005 2024-05-14T14:43:00.599 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:43:00.601 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:43:00.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:43:00.644 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2024-05-14T14:43:00.847 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:43:00.851 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:43:00.852 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:43:00.853 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:43:00.853 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:43:12.613 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:43:12.616 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:43:28.663 INFO:teuthology.orchestra.run.smithi039.stdout:generic/006 28s 2024-05-14T14:43:28.668 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/006 2024-05-14T14:43:28.668 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:43:28.671 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:43:28.779 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:43:28.780 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2024-05-14T14:43:28.982 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:43:28.986 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:43:28.986 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:43:28.987 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:43:28.987 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:43:42.676 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:43:42.680 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:44:12.722 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:44:12.725 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:44:26.222 INFO:teuthology.orchestra.run.smithi039.stdout:generic/007 57s 2024-05-14T14:44:26.227 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/007 2024-05-14T14:44:26.227 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:44:26.230 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:44:26.290 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:44:26.291 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2024-05-14T14:44:26.502 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:44:26.506 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:44:26.506 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:44:26.507 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:44:26.507 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:44:26.865 INFO:teuthology.orchestra.run.smithi039.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-05-14T14:44:26.869 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/008 2024-05-14T14:44:26.869 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/008 2024-05-14T14:44:26.869 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:44:26.871 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:44:26.886 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:44:26.887 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2024-05-14T14:44:27.080 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:44:27.084 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:44:27.085 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:44:27.086 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:44:27.086 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:44:27.388 INFO:teuthology.orchestra.run.smithi039.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-05-14T14:44:27.392 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/009 2024-05-14T14:44:27.392 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/009 2024-05-14T14:44:27.392 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:44:27.394 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:44:27.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:44:27.409 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2024-05-14T14:44:27.606 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:44:27.610 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:44:27.610 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:44:27.611 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:44:27.612 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:44:28.191 INFO:teuthology.orchestra.run.smithi039.stdout:generic/010 1s 2024-05-14T14:44:28.197 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/010 2024-05-14T14:44:28.197 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:44:28.199 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:44:28.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:44:28.232 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2024-05-14T14:44:28.438 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:44:28.442 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:44:28.442 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:44:28.443 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:44:28.443 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:44:43.095 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:44:43.098 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:44:59.973 INFO:teuthology.orchestra.run.smithi039.stdout:generic/011 31s 2024-05-14T14:44:59.978 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/011 2024-05-14T14:44:59.978 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:44:59.981 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:45:00.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:45:00.021 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2024-05-14T14:45:00.304 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:45:00.307 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:45:00.308 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:45:00.309 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:45:00.309 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:45:00.635 INFO:teuthology.orchestra.run.smithi039.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-05-14T14:45:00.640 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/012 2024-05-14T14:45:00.640 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/012 2024-05-14T14:45:00.640 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:45:00.642 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:45:00.686 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:45:00.687 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2024-05-14T14:45:00.905 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:45:00.909 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:45:00.910 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:45:00.911 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:45:00.911 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:45:13.151 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:45:13.154 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:45:43.576 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:45:43.579 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:45:54.525 INFO:teuthology.orchestra.run.smithi039.stdout:generic/013 53s 2024-05-14T14:45:54.532 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/013 2024-05-14T14:45:54.532 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:45:54.535 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:45:54.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:45:54.559 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2024-05-14T14:45:54.825 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:45:54.831 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:45:54.831 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:45:54.833 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:45:54.833 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:45:55.238 INFO:teuthology.orchestra.run.smithi039.stdout:generic/014 [not run] Sparse files are not supported or do not work as expected 2024-05-14T14:45:55.244 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/014 2024-05-14T14:45:55.244 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/014 2024-05-14T14:45:55.244 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:45:55.247 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:45:55.268 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:45:55.269 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2024-05-14T14:45:55.579 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:45:55.585 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:45:55.586 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:45:55.587 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:45:55.587 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:45:55.897 INFO:teuthology.orchestra.run.smithi039.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-05-14T14:45:55.902 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/015 2024-05-14T14:45:55.902 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/015 2024-05-14T14:45:55.903 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:45:55.906 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:45:55.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:45:55.924 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2024-05-14T14:45:56.199 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:45:56.204 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:45:56.205 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:45:56.206 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:45:56.206 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:45:56.639 INFO:teuthology.orchestra.run.smithi039.stdout:generic/016 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-05-14T14:45:56.645 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/016 2024-05-14T14:45:56.645 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/016 2024-05-14T14:45:56.645 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:45:56.648 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:45:56.682 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:45:56.682 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2024-05-14T14:45:56.995 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:45:57.002 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:45:57.002 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:45:57.003 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:45:57.004 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:45:57.360 INFO:teuthology.orchestra.run.smithi039.stdout:generic/017 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-14T14:45:57.366 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/017 2024-05-14T14:45:57.366 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/017 2024-05-14T14:45:57.366 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:45:57.369 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:45:57.393 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:45:57.393 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2024-05-14T14:45:57.685 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:45:57.717 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:45:57.718 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:45:57.718 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:45:57.718 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:45:58.138 INFO:teuthology.orchestra.run.smithi039.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2024-05-14T14:45:58.149 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/018 2024-05-14T14:45:58.149 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/018 2024-05-14T14:45:58.149 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:45:58.153 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:45:58.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:45:58.167 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2024-05-14T14:45:58.436 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:45:58.442 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:45:58.443 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:45:58.444 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:45:58.444 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:45:58.759 INFO:teuthology.orchestra.run.smithi039.stdout:generic/019 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T14:45:58.765 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/019 2024-05-14T14:45:58.765 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/019 2024-05-14T14:45:58.765 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:45:58.768 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:45:58.785 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:45:58.785 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2024-05-14T14:45:59.070 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:45:59.076 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:45:59.077 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:45:59.078 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:45:59.078 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:02.344 INFO:teuthology.orchestra.run.smithi039.stdout:generic/020 3s 2024-05-14T14:46:02.350 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/020 2024-05-14T14:46:02.350 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:02.353 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:02.386 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:02.386 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2024-05-14T14:46:02.708 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:02.713 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:02.713 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:02.715 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:02.715 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:03.136 INFO:teuthology.orchestra.run.smithi039.stdout:generic/021 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-05-14T14:46:03.142 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/021 2024-05-14T14:46:03.142 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/021 2024-05-14T14:46:03.142 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:03.145 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:03.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:03.178 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2024-05-14T14:46:03.523 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:03.528 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:03.528 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:03.530 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:03.530 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:03.964 INFO:teuthology.orchestra.run.smithi039.stdout:generic/022 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-05-14T14:46:03.970 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/022 2024-05-14T14:46:03.970 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/022 2024-05-14T14:46:03.970 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:03.974 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:04.002 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:04.002 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2024-05-14T14:46:04.341 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:04.347 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:04.348 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:04.349 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:04.349 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:05.734 INFO:teuthology.orchestra.run.smithi039.stdout:generic/023 1s 2024-05-14T14:46:05.741 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/023 2024-05-14T14:46:05.741 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:05.745 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:05.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:05.859 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2024-05-14T14:46:06.157 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:06.162 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:06.163 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:06.165 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:06.165 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:06.500 INFO:teuthology.orchestra.run.smithi039.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2024-05-14T14:46:06.505 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/024 2024-05-14T14:46:06.506 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/024 2024-05-14T14:46:06.506 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:06.510 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:06.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:06.544 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2024-05-14T14:46:06.888 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:06.893 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:06.893 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:06.897 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:06.897 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:07.242 INFO:teuthology.orchestra.run.smithi039.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2024-05-14T14:46:07.248 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/025 2024-05-14T14:46:07.248 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/025 2024-05-14T14:46:07.248 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:07.252 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:07.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:07.293 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2024-05-14T14:46:07.628 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:07.634 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:07.634 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:07.636 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:07.636 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:08.001 INFO:teuthology.orchestra.run.smithi039.stdout:generic/026 [not run] ceph does not define maximum ACL count 2024-05-14T14:46:08.008 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/026 2024-05-14T14:46:08.008 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/026 2024-05-14T14:46:08.008 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:08.011 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:08.033 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:08.034 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2024-05-14T14:46:08.301 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:08.306 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:08.307 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:08.308 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:08.308 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:08.624 INFO:teuthology.orchestra.run.smithi039.stdout:generic/027 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-05-14T14:46:08.629 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/027 2024-05-14T14:46:08.630 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/027 2024-05-14T14:46:08.630 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:08.633 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:08.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:08.652 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2024-05-14T14:46:08.904 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:08.910 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:08.911 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:08.912 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:08.912 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:13.645 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:46:13.648 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:46:14.249 INFO:teuthology.orchestra.run.smithi039.stdout:generic/028 5s 2024-05-14T14:46:14.256 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/028 2024-05-14T14:46:14.256 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:14.260 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:14.280 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:14.280 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2024-05-14T14:46:14.540 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:14.548 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:14.548 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:14.550 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:14.550 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:19.657 INFO:teuthology.orchestra.run.smithi039.stdout:generic/029 5s 2024-05-14T14:46:19.724 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/029 2024-05-14T14:46:19.724 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:19.727 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:19.739 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:19.739 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2024-05-14T14:46:20.011 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:20.017 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:20.018 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:20.019 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:20.019 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:21.618 INFO:teuthology.orchestra.run.smithi039.stdout:generic/030 1s 2024-05-14T14:46:21.626 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/030 2024-05-14T14:46:21.626 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:21.629 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:21.641 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:21.641 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2024-05-14T14:46:21.911 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:21.916 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:21.917 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:21.918 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:21.918 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:22.327 INFO:teuthology.orchestra.run.smithi039.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-05-14T14:46:22.333 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/031 2024-05-14T14:46:22.333 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/031 2024-05-14T14:46:22.333 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:22.336 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:22.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:22.357 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2024-05-14T14:46:22.640 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:22.644 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:22.645 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:22.646 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:22.646 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:22.968 INFO:teuthology.orchestra.run.smithi039.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-05-14T14:46:22.974 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/032 2024-05-14T14:46:22.974 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/032 2024-05-14T14:46:22.974 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:22.977 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:22.997 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:22.997 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2024-05-14T14:46:23.272 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:23.278 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:23.279 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:23.280 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:23.280 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:23.671 INFO:teuthology.orchestra.run.smithi039.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-05-14T14:46:23.677 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/033 2024-05-14T14:46:23.677 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/033 2024-05-14T14:46:23.677 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:23.680 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:23.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:23.704 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2024-05-14T14:46:23.981 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:23.987 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:23.988 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:23.989 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:23.989 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:24.317 INFO:teuthology.orchestra.run.smithi039.stdout:generic/034 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T14:46:24.322 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/034 2024-05-14T14:46:24.323 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/034 2024-05-14T14:46:24.323 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:24.326 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:24.342 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:24.343 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2024-05-14T14:46:24.630 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:24.635 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:24.635 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:24.637 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:24.637 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:25.027 INFO:teuthology.orchestra.run.smithi039.stdout:generic/035 1s 2024-05-14T14:46:25.035 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/035 2024-05-14T14:46:25.035 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:25.038 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:25.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:25.070 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2024-05-14T14:46:25.405 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:25.411 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:25.412 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:25.413 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:25.413 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:35.824 INFO:teuthology.orchestra.run.smithi039.stdout:generic/036 10s 2024-05-14T14:46:35.832 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/036 2024-05-14T14:46:35.832 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:35.836 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:35.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:35.873 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2024-05-14T14:46:36.208 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:36.214 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:36.215 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:36.216 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:36.217 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:40.739 INFO:teuthology.orchestra.run.smithi039.stdout:generic/037 4s 2024-05-14T14:46:40.747 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/037 2024-05-14T14:46:40.747 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:40.750 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:40.763 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:40.763 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2024-05-14T14:46:41.034 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:41.039 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:41.040 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:41.041 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:41.041 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:41.362 INFO:teuthology.orchestra.run.smithi039.stdout:generic/038 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-05-14T14:46:41.367 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/038 2024-05-14T14:46:41.367 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/038 2024-05-14T14:46:41.367 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:41.371 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:41.387 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:41.388 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2024-05-14T14:46:41.649 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:41.656 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:41.656 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:41.657 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:41.657 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:42.011 INFO:teuthology.orchestra.run.smithi039.stdout:generic/039 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T14:46:42.016 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/039 2024-05-14T14:46:42.016 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/039 2024-05-14T14:46:42.016 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:42.019 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:42.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:42.038 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2024-05-14T14:46:42.294 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:42.300 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:42.301 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:42.302 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:42.302 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:42.637 INFO:teuthology.orchestra.run.smithi039.stdout:generic/040 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T14:46:42.643 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/040 2024-05-14T14:46:42.643 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/040 2024-05-14T14:46:42.643 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:42.646 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:42.666 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:42.667 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2024-05-14T14:46:42.941 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:42.947 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:42.947 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:42.949 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:42.949 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:43.293 INFO:teuthology.orchestra.run.smithi039.stdout:generic/041 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T14:46:43.299 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/041 2024-05-14T14:46:43.299 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/041 2024-05-14T14:46:43.299 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:43.301 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:43.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:43.324 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2024-05-14T14:46:43.592 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:43.597 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:43.597 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:43.598 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:43.598 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:43.736 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:46:43.739 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:46:44.018 INFO:teuthology.orchestra.run.smithi039.stdout:generic/042 [not run] ceph does not support shutdown 2024-05-14T14:46:44.026 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/042 2024-05-14T14:46:44.026 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/042 2024-05-14T14:46:44.026 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:44.029 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:44.045 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:44.045 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2024-05-14T14:46:44.314 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:44.320 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:44.320 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:44.321 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:44.322 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:44.759 INFO:teuthology.orchestra.run.smithi039.stdout:generic/043 [not run] ceph does not support shutdown 2024-05-14T14:46:44.768 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/043 2024-05-14T14:46:44.768 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/043 2024-05-14T14:46:44.769 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:44.772 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:44.788 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:44.788 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2024-05-14T14:46:45.093 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:45.100 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:45.100 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:45.102 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:45.102 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:45.586 INFO:teuthology.orchestra.run.smithi039.stdout:generic/044 [not run] ceph does not support shutdown 2024-05-14T14:46:45.596 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/044 2024-05-14T14:46:45.596 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/044 2024-05-14T14:46:45.596 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:45.599 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:45.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:45.618 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2024-05-14T14:46:45.908 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:45.913 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:45.914 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:45.915 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:45.915 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:46.367 INFO:teuthology.orchestra.run.smithi039.stdout:generic/045 [not run] ceph does not support shutdown 2024-05-14T14:46:46.386 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/045 2024-05-14T14:46:46.387 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/045 2024-05-14T14:46:46.387 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:46.390 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:46.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:46.407 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2024-05-14T14:46:46.710 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:46.716 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:46.717 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:46.718 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:46.718 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:47.163 INFO:teuthology.orchestra.run.smithi039.stdout:generic/046 [not run] ceph does not support shutdown 2024-05-14T14:46:47.172 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/046 2024-05-14T14:46:47.173 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/046 2024-05-14T14:46:47.173 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:47.176 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:47.191 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:47.191 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2024-05-14T14:46:47.452 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:47.457 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:47.457 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:47.459 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:47.459 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:47.916 INFO:teuthology.orchestra.run.smithi039.stdout:generic/047 [not run] ceph does not support shutdown 2024-05-14T14:46:47.924 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/047 2024-05-14T14:46:47.924 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/047 2024-05-14T14:46:47.924 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:47.926 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:47.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:47.942 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2024-05-14T14:46:48.207 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:48.212 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:48.212 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:48.213 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:48.213 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:48.678 INFO:teuthology.orchestra.run.smithi039.stdout:generic/048 [not run] ceph does not support shutdown 2024-05-14T14:46:48.687 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/048 2024-05-14T14:46:48.687 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/048 2024-05-14T14:46:48.687 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:48.690 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:48.708 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:48.708 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2024-05-14T14:46:48.981 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:48.987 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:48.987 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:48.988 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:48.989 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:49.434 INFO:teuthology.orchestra.run.smithi039.stdout:generic/049 [not run] ceph does not support shutdown 2024-05-14T14:46:49.443 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/049 2024-05-14T14:46:49.443 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/049 2024-05-14T14:46:49.443 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:49.446 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:49.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:49.464 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2024-05-14T14:46:49.736 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:49.743 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:49.744 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:49.745 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:49.746 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:50.240 INFO:teuthology.orchestra.run.smithi039.stdout:generic/050 [not run] ceph does not support shutdown 2024-05-14T14:46:50.259 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/050 2024-05-14T14:46:50.259 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/050 2024-05-14T14:46:50.259 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:50.262 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:50.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:50.279 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2024-05-14T14:46:50.555 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:50.562 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:50.562 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:50.564 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:50.564 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:51.004 INFO:teuthology.orchestra.run.smithi039.stdout:generic/051 [not run] ceph does not support shutdown 2024-05-14T14:46:51.010 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/051 2024-05-14T14:46:51.010 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/051 2024-05-14T14:46:51.010 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:51.014 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:51.029 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:51.029 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2024-05-14T14:46:51.294 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:51.299 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:51.300 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:51.301 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:51.301 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:51.738 INFO:teuthology.orchestra.run.smithi039.stdout:generic/052 [not run] ceph does not support shutdown 2024-05-14T14:46:51.757 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/052 2024-05-14T14:46:51.757 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/052 2024-05-14T14:46:51.757 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:51.761 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:51.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:51.777 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2024-05-14T14:46:52.036 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:52.041 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:52.041 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:52.043 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:52.043 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:52.797 INFO:teuthology.orchestra.run.smithi039.stdout:generic/053 0s 2024-05-14T14:46:52.849 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/053 2024-05-14T14:46:52.849 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:52.854 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:52.865 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:52.865 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2024-05-14T14:46:53.131 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:53.136 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:53.136 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:53.138 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:53.138 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:53.590 INFO:teuthology.orchestra.run.smithi039.stdout:generic/054 [not run] ceph does not support shutdown 2024-05-14T14:46:53.624 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/054 2024-05-14T14:46:53.625 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/054 2024-05-14T14:46:53.625 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:53.627 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:53.641 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:53.642 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2024-05-14T14:46:53.902 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:53.907 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:53.907 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:53.909 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:53.909 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:54.354 INFO:teuthology.orchestra.run.smithi039.stdout:generic/055 [not run] ceph does not support shutdown 2024-05-14T14:46:54.362 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/055 2024-05-14T14:46:54.362 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/055 2024-05-14T14:46:54.362 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:54.365 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:54.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:54.380 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2024-05-14T14:46:54.648 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:54.652 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:54.653 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:54.654 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:54.654 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:55.003 INFO:teuthology.orchestra.run.smithi039.stdout:generic/056 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T14:46:55.007 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/056 2024-05-14T14:46:55.008 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/056 2024-05-14T14:46:55.008 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:55.011 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:55.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:55.033 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2024-05-14T14:46:55.303 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:55.309 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:55.309 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:55.310 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:55.310 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:55.671 INFO:teuthology.orchestra.run.smithi039.stdout:generic/057 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T14:46:55.676 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/057 2024-05-14T14:46:55.676 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/057 2024-05-14T14:46:55.676 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:55.679 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:55.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:55.703 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2024-05-14T14:46:55.996 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:56.002 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:56.002 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:56.004 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:56.004 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:56.422 INFO:teuthology.orchestra.run.smithi039.stdout:generic/058 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-05-14T14:46:56.426 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/058 2024-05-14T14:46:56.427 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/058 2024-05-14T14:46:56.427 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:56.430 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:56.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:56.457 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2024-05-14T14:46:56.818 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:56.823 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:56.824 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:56.825 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:56.825 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:57.168 INFO:teuthology.orchestra.run.smithi039.stdout:generic/059 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T14:46:57.174 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/059 2024-05-14T14:46:57.174 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/059 2024-05-14T14:46:57.174 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:57.178 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:57.196 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:57.196 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2024-05-14T14:46:57.470 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:57.475 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:57.476 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:57.477 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:57.477 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:57.905 INFO:teuthology.orchestra.run.smithi039.stdout:generic/060 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-05-14T14:46:57.910 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/060 2024-05-14T14:46:57.911 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/060 2024-05-14T14:46:57.911 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:57.914 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:57.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:57.954 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2024-05-14T14:46:58.289 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:58.295 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:58.295 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:58.297 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:58.297 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:58.717 INFO:teuthology.orchestra.run.smithi039.stdout:generic/061 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-05-14T14:46:58.722 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/061 2024-05-14T14:46:58.722 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/061 2024-05-14T14:46:58.723 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:46:58.726 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:46:58.774 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:46:58.774 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2024-05-14T14:46:59.105 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:46:59.110 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:46:59.110 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:46:59.111 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:46:59.111 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:47:00.956 INFO:teuthology.orchestra.run.smithi039.stdout:generic/062 1s 2024-05-14T14:47:00.968 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/062 2024-05-14T14:47:00.969 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:47:00.971 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:47:00.984 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:47:00.985 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2024-05-14T14:47:01.256 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:47:01.263 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:47:01.263 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:47:01.265 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:47:01.265 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:47:01.797 INFO:teuthology.orchestra.run.smithi039.stdout:generic/063 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-05-14T14:47:01.802 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/063 2024-05-14T14:47:01.802 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/063 2024-05-14T14:47:01.802 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:47:01.805 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:47:01.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:47:01.846 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2024-05-14T14:47:02.176 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:47:02.182 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:47:02.183 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:47:02.184 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:47:02.184 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:47:02.522 INFO:teuthology.orchestra.run.smithi039.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-14T14:47:02.527 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/064 2024-05-14T14:47:02.527 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/064 2024-05-14T14:47:02.527 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:47:02.530 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:47:02.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:47:02.550 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2024-05-14T14:47:02.821 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:47:02.827 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:47:02.827 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:47:02.829 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:47:02.829 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:47:03.172 INFO:teuthology.orchestra.run.smithi039.stdout:generic/065 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T14:47:03.177 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/065 2024-05-14T14:47:03.177 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/065 2024-05-14T14:47:03.177 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:47:03.180 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:47:03.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:47:03.202 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2024-05-14T14:47:03.469 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:47:03.475 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:47:03.475 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:47:03.476 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:47:03.477 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:47:03.800 INFO:teuthology.orchestra.run.smithi039.stdout:generic/066 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T14:47:03.806 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/066 2024-05-14T14:47:03.806 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/066 2024-05-14T14:47:03.806 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:47:03.809 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:47:03.824 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:47:03.824 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2024-05-14T14:47:04.100 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:47:04.105 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:47:04.105 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:47:04.106 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:47:04.106 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:47:04.456 INFO:teuthology.orchestra.run.smithi039.stdout:generic/067 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T14:47:04.461 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/067 2024-05-14T14:47:04.461 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/067 2024-05-14T14:47:04.461 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:47:04.463 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:47:04.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:47:04.482 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2024-05-14T14:47:04.750 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:47:04.755 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:47:04.756 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:47:04.759 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:47:04.759 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:47:05.113 INFO:teuthology.orchestra.run.smithi039.stdout:generic/068 [not run] ceph does not support freezing 2024-05-14T14:47:05.119 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/068 2024-05-14T14:47:05.119 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/068 2024-05-14T14:47:05.119 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:47:05.122 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:47:05.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:47:05.140 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2024-05-14T14:47:05.394 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:47:05.399 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:47:05.400 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:47:05.401 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:47:05.401 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:47:13.982 INFO:teuthology.orchestra.run.smithi039.stdout:generic/069 8s 2024-05-14T14:47:13.990 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/069 2024-05-14T14:47:13.990 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:47:13.994 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:47:14.005 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:47:14.006 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2024-05-14T14:47:14.040 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:47:14.058 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:47:14.354 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:47:14.360 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:47:14.360 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:47:14.361 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:47:14.361 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:47:40.324 INFO:teuthology.orchestra.run.smithi039.stdout:generic/070 26s 2024-05-14T14:47:40.331 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/070 2024-05-14T14:47:40.331 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:47:40.335 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:47:40.393 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:47:40.393 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2024-05-14T14:47:40.721 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:47:40.726 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:47:40.726 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:47:40.727 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:47:40.728 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:47:41.060 INFO:teuthology.orchestra.run.smithi039.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-05-14T14:47:41.066 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/071 2024-05-14T14:47:41.066 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/071 2024-05-14T14:47:41.066 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:47:41.069 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:47:41.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:47:41.091 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2024-05-14T14:47:41.348 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:47:41.352 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:47:41.353 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:47:41.354 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:47:41.354 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:47:41.767 INFO:teuthology.orchestra.run.smithi039.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-05-14T14:47:41.771 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/072 2024-05-14T14:47:41.771 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/072 2024-05-14T14:47:41.772 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:47:41.777 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:47:41.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:47:41.801 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2024-05-14T14:47:42.073 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:47:42.079 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:47:42.079 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:47:42.081 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:47:42.081 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:47:42.418 INFO:teuthology.orchestra.run.smithi039.stdout:generic/073 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T14:47:42.423 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/073 2024-05-14T14:47:42.423 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/073 2024-05-14T14:47:42.423 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:47:42.426 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:47:42.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:47:42.443 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2024-05-14T14:47:42.699 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:47:42.704 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:47:42.704 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:47:42.705 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:47:42.705 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:47:44.145 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:47:44.149 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:47:44.206 INFO:tasks.ceph.mds.b.smithi062.stderr:2024-05-14T14:47:44.225+0000 7fcc26b22640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45082) UID: 0 2024-05-14T14:47:44.206 INFO:tasks.ceph.mds.d.smithi062.stderr:2024-05-14T14:47:44.225+0000 7fbd5811b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45082) UID: 0 2024-05-14T14:47:58.959 INFO:teuthology.orchestra.run.smithi039.stdout:generic/074 16s 2024-05-14T14:47:59.010 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/074 2024-05-14T14:47:59.010 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:47:59.013 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:48:00.285 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:48:00.285 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2024-05-14T14:48:00.620 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:48:00.625 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:48:00.626 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:48:00.627 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:48:00.627 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:48:25.402 INFO:teuthology.orchestra.run.smithi039.stdout:generic/075 25s 2024-05-14T14:48:25.408 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/075 2024-05-14T14:48:25.408 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:48:25.411 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:48:25.461 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:48:25.461 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2024-05-14T14:48:25.819 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:48:25.824 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:48:25.825 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:48:25.826 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:48:25.826 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:48:26.144 INFO:teuthology.orchestra.run.smithi039.stdout:generic/076 [not run] require 172.21.15.39:6789:/scratch to be local device 2024-05-14T14:48:26.150 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/076 2024-05-14T14:48:26.150 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/076 2024-05-14T14:48:26.150 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:48:26.153 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:48:26.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:48:26.168 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2024-05-14T14:48:26.445 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:48:26.450 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:48:26.451 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:48:26.452 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:48:26.452 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:48:27.562 INFO:teuthology.orchestra.run.smithi039.stdout:generic/077 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-05-14T14:48:27.566 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/077 2024-05-14T14:48:27.566 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/077 2024-05-14T14:48:27.567 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:48:27.570 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:48:27.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:48:27.614 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2024-05-14T14:48:27.956 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:48:27.962 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:48:27.962 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:48:27.964 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:48:27.964 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:48:28.316 INFO:teuthology.orchestra.run.smithi039.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2024-05-14T14:48:28.321 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/078 2024-05-14T14:48:28.321 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/078 2024-05-14T14:48:28.321 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:48:28.325 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:48:28.368 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:48:28.368 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2024-05-14T14:48:28.717 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:48:28.721 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:48:28.722 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:48:28.723 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:48:28.723 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:48:29.255 INFO:teuthology.orchestra.run.smithi039.stdout:generic/079 [not run] file system doesn't support chattr +ia 2024-05-14T14:48:29.261 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/079 2024-05-14T14:48:29.261 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/079 2024-05-14T14:48:29.261 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:48:29.265 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:48:29.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:48:29.294 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2024-05-14T14:48:29.556 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:48:29.561 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:48:29.562 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:48:29.563 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:48:29.563 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:48:31.964 INFO:teuthology.orchestra.run.smithi039.stdout:generic/080 2s 2024-05-14T14:48:32.017 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/080 2024-05-14T14:48:32.017 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:48:32.021 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:48:32.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:48:32.049 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2024-05-14T14:48:32.311 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:48:32.317 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:48:32.317 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:48:32.319 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:48:32.319 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:48:32.743 INFO:teuthology.orchestra.run.smithi039.stdout:generic/081 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T14:48:32.749 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/081 2024-05-14T14:48:32.749 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/081 2024-05-14T14:48:32.749 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:48:32.754 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:48:32.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:48:32.776 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2024-05-14T14:48:33.079 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:48:33.085 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:48:33.086 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:48:33.087 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:48:33.087 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:48:33.438 INFO:teuthology.orchestra.run.smithi039.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2024-05-14T14:48:33.443 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/082 2024-05-14T14:48:33.443 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/082 2024-05-14T14:48:33.443 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:48:33.446 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:48:33.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:48:33.465 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2024-05-14T14:48:33.743 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:48:33.748 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:48:33.748 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:48:33.749 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:48:33.749 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:48:34.081 INFO:teuthology.orchestra.run.smithi039.stdout:generic/083 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-05-14T14:48:34.088 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/083 2024-05-14T14:48:34.088 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/083 2024-05-14T14:48:34.088 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:48:34.091 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:48:34.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:48:34.111 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2024-05-14T14:48:34.379 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:48:34.384 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:48:34.384 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:48:34.385 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:48:34.385 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:48:40.016 INFO:teuthology.orchestra.run.smithi039.stdout:generic/084 6s 2024-05-14T14:48:40.024 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/084 2024-05-14T14:48:40.024 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:48:40.026 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:48:40.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:48:40.043 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2024-05-14T14:48:40.333 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:48:40.338 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:48:40.338 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:48:40.339 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:48:40.339 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:48:40.683 INFO:teuthology.orchestra.run.smithi039.stdout:generic/085 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T14:48:40.689 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/085 2024-05-14T14:48:40.689 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/085 2024-05-14T14:48:40.689 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:48:40.691 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:48:40.711 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:48:40.712 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2024-05-14T14:48:40.973 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:48:40.979 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:48:40.980 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:48:40.981 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:48:40.981 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:48:41.322 INFO:teuthology.orchestra.run.smithi039.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-05-14T14:48:41.327 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/086 2024-05-14T14:48:41.327 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/086 2024-05-14T14:48:41.327 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:48:41.331 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:48:41.351 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:48:41.352 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2024-05-14T14:48:41.606 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:48:41.608 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:48:41.609 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:48:41.610 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:48:41.610 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:48:42.022 INFO:teuthology.orchestra.run.smithi039.stdout:generic/087 1s 2024-05-14T14:48:42.029 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/087 2024-05-14T14:48:42.029 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:48:42.033 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:48:42.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:48:42.103 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2024-05-14T14:48:42.448 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:48:42.453 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:48:42.454 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:48:42.455 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:48:42.455 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:48:42.802 INFO:teuthology.orchestra.run.smithi039.stdout:generic/088 0s 2024-05-14T14:48:42.811 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/088 2024-05-14T14:48:42.811 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:48:42.814 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:48:42.855 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:48:42.856 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2024-05-14T14:48:43.190 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:48:43.194 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:48:43.195 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:48:43.196 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:48:43.197 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:50:54.372 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:50:54.376 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:51:26.594 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:51:26.596 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:51:56.658 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:51:56.661 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:52:26.720 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:52:26.723 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:52:57.284 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:52:57.286 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:53:27.332 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:53:27.336 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:53:27.379 INFO:tasks.ceph.mds.b.smithi062.stderr:2024-05-14T14:53:27.393+0000 7fcc26b22640 -1 Fail to open '/proc/46219/cmdline' error = (2) No such file or directory 2024-05-14T14:53:27.379 INFO:tasks.ceph.mds.b.smithi062.stderr:2024-05-14T14:53:27.393+0000 7fcc26b22640 -1 received signal: Hangup from (PID: 46219) UID: 0 2024-05-14T14:53:27.379 INFO:tasks.ceph.mds.d.smithi062.stderr:2024-05-14T14:53:27.398+0000 7fbd5811b640 -1 Fail to open '/proc/46219/cmdline' error = (2) No such file or directory 2024-05-14T14:53:27.379 INFO:tasks.ceph.mds.d.smithi062.stderr:2024-05-14T14:53:27.398+0000 7fbd5811b640 -1 received signal: Hangup from (PID: 46219) UID: 0 2024-05-14T14:55:50.218 INFO:teuthology.orchestra.run.smithi062.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-mds.b.log.1: 2024-05-14T14:55:50.219 INFO:teuthology.orchestra.run.smithi062.stderr:gzip: stdin: file size changed while zipping 2024-05-14T14:56:22.460 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:56:22.463 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:56:52.532 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:56:52.535 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:56:52.571 INFO:tasks.ceph.mds.b.smithi062.stderr:2024-05-14T14:56:52.593+0000 7fcc26b22640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46264) UID: 0 2024-05-14T14:56:52.571 INFO:tasks.ceph.mds.d.smithi062.stderr:2024-05-14T14:56:52.593+0000 7fbd5811b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46264) UID: 0 2024-05-14T14:58:34.531 INFO:teuthology.orchestra.run.smithi039.stdout:generic/089 591s 2024-05-14T14:58:34.538 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/089 2024-05-14T14:58:34.539 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:58:34.539 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:58:35.574 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:58:35.574 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2024-05-14T14:58:35.948 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:58:35.952 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:58:35.952 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:58:35.953 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:58:35.953 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:58:36.213 INFO:teuthology.orchestra.run.smithi039.stdout:generic/090 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T14:58:36.217 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/090 2024-05-14T14:58:36.217 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/090 2024-05-14T14:58:36.217 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T14:58:36.219 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:58:36.234 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T14:58:36.234 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2024-05-14T14:58:36.439 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T14:58:36.443 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T14:58:36.443 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T14:58:36.444 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T14:58:36.444 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T14:59:38.020 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T14:59:38.024 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:00:08.226 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:00:08.229 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:00:20.004 INFO:teuthology.orchestra.run.smithi039.stdout:generic/091 104s 2024-05-14T15:00:20.009 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/091 2024-05-14T15:00:20.009 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:00:20.011 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:00:20.058 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:00:20.059 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2024-05-14T15:00:20.449 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:00:20.455 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:00:20.455 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:00:20.456 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:00:20.456 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:00:20.709 INFO:teuthology.orchestra.run.smithi039.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-05-14T15:00:20.713 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/092 2024-05-14T15:00:20.713 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/092 2024-05-14T15:00:20.713 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:00:20.716 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:00:20.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:00:20.730 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2024-05-14T15:00:20.938 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:00:20.942 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:00:20.942 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:00:20.943 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:00:20.943 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:00:21.420 INFO:teuthology.orchestra.run.smithi039.stdout:generic/093 0s 2024-05-14T15:00:21.425 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/093 2024-05-14T15:00:21.425 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:00:21.428 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:00:21.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:00:21.498 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2024-05-14T15:00:21.912 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:00:21.916 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:00:21.917 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:00:21.918 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:00:21.918 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:00:22.217 INFO:teuthology.orchestra.run.smithi039.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-14T15:00:22.221 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/094 2024-05-14T15:00:22.221 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/094 2024-05-14T15:00:22.221 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:00:22.224 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:00:22.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:00:22.273 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2024-05-14T15:00:22.695 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:00:22.699 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:00:22.699 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:00:22.700 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:00:22.700 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:00:34.636 INFO:teuthology.orchestra.run.smithi039.stdout:generic/095 12s 2024-05-14T15:00:34.643 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/095 2024-05-14T15:00:34.643 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:00:34.647 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:00:34.666 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:00:34.667 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2024-05-14T15:00:34.897 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:00:34.901 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:00:34.901 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:00:34.902 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:00:34.902 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:00:35.231 INFO:teuthology.orchestra.run.smithi039.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-05-14T15:00:35.234 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/096 2024-05-14T15:00:35.234 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/096 2024-05-14T15:00:35.235 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:00:35.237 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:00:35.252 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:00:35.253 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2024-05-14T15:00:35.454 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:00:35.457 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:00:35.457 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:00:35.458 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:00:35.458 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:00:36.148 INFO:teuthology.orchestra.run.smithi039.stdout:generic/097 1s 2024-05-14T15:00:36.157 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/097 2024-05-14T15:00:36.157 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:00:36.160 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:00:36.182 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:00:36.183 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2024-05-14T15:00:36.392 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:00:36.396 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:00:36.397 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:00:36.398 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:00:36.398 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:00:38.318 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:00:38.321 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:00:38.585 INFO:teuthology.orchestra.run.smithi039.stdout:generic/098 2s 2024-05-14T15:00:38.591 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/098 2024-05-14T15:00:38.591 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:00:38.593 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:00:38.602 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:00:38.603 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2024-05-14T15:00:38.815 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:00:38.819 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:00:38.819 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:00:38.821 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:00:38.821 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:00:39.626 INFO:teuthology.orchestra.run.smithi039.stdout:generic/099 1s 2024-05-14T15:00:39.632 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/099 2024-05-14T15:00:39.632 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:00:39.634 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:00:39.706 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:00:39.707 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2024-05-14T15:00:40.112 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:00:40.116 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:00:40.116 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:00:40.117 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:00:40.118 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:00:51.499 INFO:teuthology.orchestra.run.smithi039.stdout:generic/100 11s 2024-05-14T15:00:51.504 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/100 2024-05-14T15:00:51.504 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:00:51.507 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:00:54.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:00:54.931 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2024-05-14T15:00:55.207 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:00:55.211 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:00:55.211 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:00:55.213 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:00:55.213 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:00:55.468 INFO:teuthology.orchestra.run.smithi039.stdout:generic/101 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T15:00:55.472 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/101 2024-05-14T15:00:55.472 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/101 2024-05-14T15:00:55.472 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:00:55.475 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:00:55.487 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:00:55.488 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2024-05-14T15:00:55.689 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:00:55.693 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:00:55.694 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:00:55.695 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:00:55.695 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:00:55.934 INFO:teuthology.orchestra.run.smithi039.stdout:generic/102 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-05-14T15:00:55.938 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/102 2024-05-14T15:00:55.939 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/102 2024-05-14T15:00:55.939 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:00:55.941 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:00:55.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:00:55.954 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2024-05-14T15:00:56.153 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:00:56.157 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:00:56.157 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:00:56.158 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:00:56.158 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:00:56.435 INFO:teuthology.orchestra.run.smithi039.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-05-14T15:00:56.439 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/103 2024-05-14T15:00:56.439 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/103 2024-05-14T15:00:56.439 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:00:56.442 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:00:56.501 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:00:56.501 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2024-05-14T15:00:56.910 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:00:56.914 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:00:56.915 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:00:56.916 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:00:56.916 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:00:57.182 INFO:teuthology.orchestra.run.smithi039.stdout:generic/104 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T15:00:57.186 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/104 2024-05-14T15:00:57.186 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/104 2024-05-14T15:00:57.186 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:00:57.189 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:00:57.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:00:57.206 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2024-05-14T15:00:57.404 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:00:57.408 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:00:57.409 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:00:57.410 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:00:57.410 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:00:57.901 INFO:teuthology.orchestra.run.smithi039.stdout:generic/105 0s 2024-05-14T15:00:57.910 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/105 2024-05-14T15:00:57.910 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:00:57.914 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:00:57.927 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:00:57.927 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2024-05-14T15:00:58.481 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:00:58.485 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:00:58.485 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:00:58.486 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:00:58.486 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:00:58.767 INFO:teuthology.orchestra.run.smithi039.stdout:generic/106 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T15:00:58.771 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/106 2024-05-14T15:00:58.771 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/106 2024-05-14T15:00:58.772 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:00:58.774 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:00:58.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:00:58.792 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2024-05-14T15:00:58.988 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:00:58.993 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:00:58.994 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:00:58.994 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:00:58.994 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:00:59.253 INFO:teuthology.orchestra.run.smithi039.stdout:generic/107 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T15:00:59.257 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/107 2024-05-14T15:00:59.258 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/107 2024-05-14T15:00:59.258 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:00:59.260 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:00:59.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:00:59.279 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2024-05-14T15:00:59.483 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:00:59.487 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:00:59.488 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:00:59.489 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:00:59.489 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:00:59.821 INFO:teuthology.orchestra.run.smithi039.stdout:generic/108 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T15:00:59.825 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/108 2024-05-14T15:00:59.826 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/108 2024-05-14T15:00:59.826 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:00:59.828 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:00:59.842 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:00:59.843 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2024-05-14T15:01:00.049 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:01:00.053 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:01:00.054 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:01:00.055 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:01:00.055 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:01:08.533 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:01:08.536 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:01:12.002 INFO:teuthology.orchestra.run.smithi039.stdout:generic/109 12s 2024-05-14T15:01:12.008 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/109 2024-05-14T15:01:12.008 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:01:12.011 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:01:12.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:01:12.021 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2024-05-14T15:01:12.854 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:01:12.858 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:01:12.859 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:01:12.860 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:01:12.860 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:01:33.286 INFO:teuthology.orchestra.run.smithi039.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2024-05-14T15:01:33.291 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/110 2024-05-14T15:01:33.291 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/110 2024-05-14T15:01:33.291 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:01:33.293 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:01:33.475 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:01:33.476 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2024-05-14T15:01:33.941 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:01:33.948 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:01:33.949 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:01:33.950 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:01:33.950 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:01:34.453 INFO:teuthology.orchestra.run.smithi039.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2024-05-14T15:01:34.459 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/111 2024-05-14T15:01:34.459 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/111 2024-05-14T15:01:34.459 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:01:34.463 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:01:34.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:01:34.554 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2024-05-14T15:01:35.000 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:01:35.004 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:01:35.005 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:01:35.006 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:01:35.006 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:01:38.591 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:01:38.594 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:01:51.583 INFO:teuthology.orchestra.run.smithi039.stdout:generic/112 16s 2024-05-14T15:01:51.588 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/112 2024-05-14T15:01:51.588 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:01:51.591 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:01:51.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:01:51.645 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2024-05-14T15:01:52.066 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:01:52.070 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:01:52.071 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:01:52.072 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:01:52.072 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:02:09.043 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:02:09.046 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:02:10.359 INFO:teuthology.orchestra.run.smithi039.stdout:generic/113 18s 2024-05-14T15:02:10.364 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/113 2024-05-14T15:02:10.364 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:02:10.367 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:02:10.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:02:10.400 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2024-05-14T15:02:10.861 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:02:10.865 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:02:10.865 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:02:10.866 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:02:10.866 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:02:11.113 INFO:teuthology.orchestra.run.smithi039.stdout:generic/114 [not run] Sparse files are not supported or do not work as expected 2024-05-14T15:02:11.117 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/114 2024-05-14T15:02:11.117 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/114 2024-05-14T15:02:11.117 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:02:11.120 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:02:11.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:02:11.140 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2024-05-14T15:02:11.370 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:02:11.376 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:02:11.376 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:02:11.378 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:02:11.378 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:02:11.661 INFO:teuthology.orchestra.run.smithi039.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2024-05-14T15:02:11.665 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/115 2024-05-14T15:02:11.665 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/115 2024-05-14T15:02:11.665 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:02:11.668 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:02:11.727 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:02:11.727 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2024-05-14T15:02:12.157 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:02:12.161 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:02:12.161 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:02:12.162 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:02:12.162 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:02:12.432 INFO:teuthology.orchestra.run.smithi039.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2024-05-14T15:02:12.437 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/116 2024-05-14T15:02:12.437 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/116 2024-05-14T15:02:12.437 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:02:12.441 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:02:12.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:02:12.490 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2024-05-14T15:02:12.944 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:02:12.948 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:02:12.948 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:02:12.949 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:02:12.949 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:02:24.763 INFO:teuthology.orchestra.run.smithi039.stdout:generic/117 11s 2024-05-14T15:02:24.769 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/117 2024-05-14T15:02:24.769 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:02:24.772 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:02:24.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:02:24.781 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2024-05-14T15:02:24.978 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:02:24.982 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:02:24.983 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:02:24.984 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:02:24.984 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:02:25.690 INFO:teuthology.orchestra.run.smithi039.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2024-05-14T15:02:25.694 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/118 2024-05-14T15:02:25.695 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/118 2024-05-14T15:02:25.695 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:02:25.697 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:02:25.750 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:02:25.750 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2024-05-14T15:02:26.175 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:02:26.179 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:02:26.180 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:02:26.181 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:02:26.181 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:02:26.524 INFO:teuthology.orchestra.run.smithi039.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2024-05-14T15:02:26.528 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/119 2024-05-14T15:02:26.528 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/119 2024-05-14T15:02:26.528 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:02:26.530 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:02:26.577 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:02:26.577 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2024-05-14T15:02:26.994 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:02:26.998 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:02:26.998 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:02:26.999 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:02:26.999 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:02:27.244 INFO:teuthology.orchestra.run.smithi039.stdout:generic/120 [not run] atime not maintained by ceph 2024-05-14T15:02:27.248 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/120 2024-05-14T15:02:27.248 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/120 2024-05-14T15:02:27.249 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:02:27.251 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:02:27.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:02:27.262 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2024-05-14T15:02:27.456 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:02:27.460 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:02:27.461 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:02:27.462 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:02:27.462 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:02:27.736 INFO:teuthology.orchestra.run.smithi039.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2024-05-14T15:02:27.740 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/121 2024-05-14T15:02:27.740 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/121 2024-05-14T15:02:27.740 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:02:27.743 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:02:27.809 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:02:27.810 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2024-05-14T15:02:28.240 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:02:28.244 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:02:28.244 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:02:28.245 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:02:28.245 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:02:28.511 INFO:teuthology.orchestra.run.smithi039.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2024-05-14T15:02:28.515 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/122 2024-05-14T15:02:28.515 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/122 2024-05-14T15:02:28.515 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:02:28.517 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:02:28.565 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:02:28.566 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2024-05-14T15:02:29.002 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:02:29.006 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:02:29.006 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:02:29.009 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:02:29.009 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:02:29.508 INFO:teuthology.orchestra.run.smithi039.stdout:generic/123 0s 2024-05-14T15:02:29.513 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/123 2024-05-14T15:02:29.513 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:02:29.516 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:02:29.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:02:29.573 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2024-05-14T15:02:30.016 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:02:30.020 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:02:30.020 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:02:30.021 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:02:30.021 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:02:32.069 INFO:teuthology.orchestra.run.smithi039.stdout:generic/124 2s 2024-05-14T15:02:32.081 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/124 2024-05-14T15:02:32.081 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:02:32.083 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:02:32.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:02:32.738 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2024-05-14T15:02:33.142 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:02:33.146 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:02:33.147 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:02:33.148 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:02:33.148 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:02:39.143 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:02:39.146 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:03:09.225 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:03:09.229 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:03:34.653 INFO:teuthology.orchestra.run.smithi039.stdout:generic/125 61s 2024-05-14T15:03:34.659 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/125 2024-05-14T15:03:34.659 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:03:34.662 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:03:34.729 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:03:34.730 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2024-05-14T15:03:35.142 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:03:35.146 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:03:35.146 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:03:35.147 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:03:35.147 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:03:35.600 INFO:teuthology.orchestra.run.smithi039.stdout:generic/126 0s 2024-05-14T15:03:35.605 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/126 2024-05-14T15:03:35.605 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:03:35.608 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:03:35.685 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:03:35.685 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2024-05-14T15:03:36.157 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:03:36.161 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:03:36.162 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:03:36.163 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:03:36.163 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:03:39.304 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:03:39.307 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:04:09.371 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:04:09.374 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:04:39.447 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:04:39.449 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:05:09.508 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:05:09.511 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:05:39.574 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:05:39.578 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:06:09.634 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:06:09.638 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:06:39.721 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:06:39.724 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:07:09.777 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:07:09.780 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:07:40.113 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:07:40.116 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:08:10.382 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:08:10.386 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:08:40.439 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:08:40.442 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:09:10.495 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:09:10.498 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:09:40.560 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:09:40.566 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:10:10.624 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:10:10.627 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:10:10.658 INFO:tasks.ceph.mds.b.smithi062.stderr:2024-05-14T15:10:10.663+0000 7fcc26b22640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47242) UID: 0 2024-05-14T15:10:10.659 INFO:tasks.ceph.mds.d.smithi062.stderr:2024-05-14T15:10:10.663+0000 7fbd5811b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47242) UID: 0 2024-05-14T15:12:54.033 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:12:54.036 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:13:08.780 INFO:teuthology.orchestra.run.smithi039.stdout:generic/127 572s 2024-05-14T15:13:08.786 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/127 2024-05-14T15:13:08.786 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:13:08.788 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:13:08.841 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:13:08.842 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2024-05-14T15:13:09.272 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:13:09.276 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:13:09.276 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:13:09.277 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:13:09.277 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:13:10.427 INFO:teuthology.orchestra.run.smithi039.stdout:generic/128 1s 2024-05-14T15:13:10.433 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/128 2024-05-14T15:13:10.433 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:13:10.436 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:13:10.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:13:10.450 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2024-05-14T15:13:10.659 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:13:10.663 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:13:10.663 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:13:10.664 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:13:10.665 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:13:10.927 INFO:teuthology.orchestra.run.smithi039.stdout:generic/129 [not run] Sparse files are not supported or do not work as expected 2024-05-14T15:13:10.931 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/129 2024-05-14T15:13:10.931 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/129 2024-05-14T15:13:10.931 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:13:10.934 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:13:10.956 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:13:10.956 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2024-05-14T15:13:11.168 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:13:11.172 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:13:11.173 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:13:11.174 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:13:11.174 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:13:11.441 INFO:teuthology.orchestra.run.smithi039.stdout:generic/130 [not run] Sparse files are not supported or do not work as expected 2024-05-14T15:13:11.445 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/130 2024-05-14T15:13:11.445 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/130 2024-05-14T15:13:11.445 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:13:11.448 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:13:11.469 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:13:11.470 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2024-05-14T15:13:11.674 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:13:11.678 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:13:11.679 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:13:11.680 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:13:11.680 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:13:13.050 INFO:teuthology.orchestra.run.smithi039.stdout:generic/131 2s 2024-05-14T15:13:13.056 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/131 2024-05-14T15:13:13.056 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:13:13.059 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:13:13.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:13:13.116 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2024-05-14T15:13:13.528 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:13:13.532 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:13:13.532 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:13:13.533 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:13:13.534 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:13:24.120 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:13:24.122 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:13:25.703 INFO:teuthology.orchestra.run.smithi039.stdout:generic/132 12s 2024-05-14T15:13:25.709 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/132 2024-05-14T15:13:25.709 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:13:25.712 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:13:25.720 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:13:25.721 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2024-05-14T15:13:25.919 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:13:25.924 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:13:25.924 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:13:25.925 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:13:25.925 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:13:54.212 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:13:54.215 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:14:24.336 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:14:24.339 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:14:54.507 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:14:54.510 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:15:24.589 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:15:24.592 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:15:54.650 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:15:54.653 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:16:24.703 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:16:24.706 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:16:54.759 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:16:54.763 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:17:24.815 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:17:24.818 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:17:51.183 INFO:teuthology.orchestra.run.smithi039.stdout:generic/133 265s 2024-05-14T15:17:51.199 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/133 2024-05-14T15:17:51.199 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:17:51.201 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:17:51.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:17:51.244 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2024-05-14T15:17:51.729 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:17:51.734 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:17:51.734 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:17:51.736 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:17:51.736 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:17:52.387 INFO:teuthology.orchestra.run.smithi039.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2024-05-14T15:17:52.388 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/134 2024-05-14T15:17:52.388 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/134 2024-05-14T15:17:52.388 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:17:52.391 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:17:52.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:17:52.433 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2024-05-14T15:17:52.875 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:17:52.879 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:17:52.879 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:17:52.881 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:17:52.881 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:17:53.855 INFO:teuthology.orchestra.run.smithi039.stdout:generic/135 0s 2024-05-14T15:17:53.861 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/135 2024-05-14T15:17:53.861 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:17:53.863 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:17:53.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:17:53.872 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2024-05-14T15:17:54.070 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:17:54.074 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:17:54.074 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:17:54.076 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:17:54.076 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:17:54.350 INFO:teuthology.orchestra.run.smithi039.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2024-05-14T15:17:54.354 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/136 2024-05-14T15:17:54.354 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/136 2024-05-14T15:17:54.354 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:17:54.356 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:17:54.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:17:54.414 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2024-05-14T15:17:54.817 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:17:54.821 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:17:54.822 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:17:54.823 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:17:54.823 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:17:54.869 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:17:54.872 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:17:55.096 INFO:teuthology.orchestra.run.smithi039.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph 2024-05-14T15:17:55.100 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/137 2024-05-14T15:17:55.101 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/137 2024-05-14T15:17:55.101 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:17:55.103 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:17:55.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:17:55.159 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2024-05-14T15:17:55.599 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:17:55.603 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:17:55.604 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:17:55.605 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:17:55.605 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:17:55.878 INFO:teuthology.orchestra.run.smithi039.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2024-05-14T15:17:55.882 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/138 2024-05-14T15:17:55.882 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/138 2024-05-14T15:17:55.882 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:17:55.884 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:17:55.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:17:55.933 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2024-05-14T15:17:56.340 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:17:56.344 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:17:56.345 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:17:56.346 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:17:56.346 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:17:56.624 INFO:teuthology.orchestra.run.smithi039.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2024-05-14T15:17:56.628 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/139 2024-05-14T15:17:56.628 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/139 2024-05-14T15:17:56.629 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:17:56.631 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:17:56.685 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:17:56.685 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2024-05-14T15:17:57.103 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:17:57.109 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:17:57.110 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:17:57.110 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:17:57.110 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:17:57.394 INFO:teuthology.orchestra.run.smithi039.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2024-05-14T15:17:57.398 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/140 2024-05-14T15:17:57.398 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/140 2024-05-14T15:17:57.398 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:17:57.400 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:17:57.440 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:17:57.440 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2024-05-14T15:17:57.879 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:17:57.883 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:17:57.883 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:17:57.884 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:17:57.884 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:17:58.340 INFO:teuthology.orchestra.run.smithi039.stdout:generic/141 0s 2024-05-14T15:17:58.406 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/141 2024-05-14T15:17:58.407 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:17:58.409 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:17:58.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:17:58.418 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2024-05-14T15:17:58.619 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:17:58.623 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:17:58.623 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:17:58.624 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:17:58.624 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:17:58.906 INFO:teuthology.orchestra.run.smithi039.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2024-05-14T15:17:58.910 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/142 2024-05-14T15:17:58.910 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/142 2024-05-14T15:17:58.910 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:17:58.912 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:17:58.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:17:58.971 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2024-05-14T15:17:59.400 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:17:59.404 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:17:59.404 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:17:59.405 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:17:59.405 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:17:59.685 INFO:teuthology.orchestra.run.smithi039.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2024-05-14T15:17:59.689 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/143 2024-05-14T15:17:59.689 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/143 2024-05-14T15:17:59.689 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:17:59.691 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:17:59.743 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:17:59.743 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2024-05-14T15:18:00.186 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:00.190 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:00.190 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:00.191 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:00.191 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:00.470 INFO:teuthology.orchestra.run.smithi039.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2024-05-14T15:18:00.474 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/144 2024-05-14T15:18:00.474 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/144 2024-05-14T15:18:00.474 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:00.476 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:00.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:00.535 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2024-05-14T15:18:00.976 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:00.980 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:00.981 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:00.982 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:00.982 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:01.250 INFO:teuthology.orchestra.run.smithi039.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2024-05-14T15:18:01.254 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/145 2024-05-14T15:18:01.254 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/145 2024-05-14T15:18:01.254 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:01.256 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:01.303 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:01.304 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2024-05-14T15:18:01.728 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:01.732 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:01.733 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:01.734 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:01.734 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:02.014 INFO:teuthology.orchestra.run.smithi039.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2024-05-14T15:18:02.016 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/146 2024-05-14T15:18:02.016 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/146 2024-05-14T15:18:02.016 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:02.018 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:02.067 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:02.067 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2024-05-14T15:18:02.494 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:02.498 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:02.498 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:02.499 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:02.499 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:02.793 INFO:teuthology.orchestra.run.smithi039.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2024-05-14T15:18:02.797 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/147 2024-05-14T15:18:02.797 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/147 2024-05-14T15:18:02.798 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:02.800 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:02.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:02.847 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2024-05-14T15:18:03.261 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:03.265 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:03.266 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:03.267 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:03.267 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:03.539 INFO:teuthology.orchestra.run.smithi039.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2024-05-14T15:18:03.543 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/148 2024-05-14T15:18:03.543 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/148 2024-05-14T15:18:03.543 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:03.546 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:03.603 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:03.603 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2024-05-14T15:18:04.029 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:04.032 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:04.033 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:04.034 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:04.034 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:04.306 INFO:teuthology.orchestra.run.smithi039.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2024-05-14T15:18:04.310 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/149 2024-05-14T15:18:04.310 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/149 2024-05-14T15:18:04.310 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:04.313 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:04.366 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:04.366 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2024-05-14T15:18:04.786 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:04.790 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:04.791 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:04.792 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:04.792 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:05.061 INFO:teuthology.orchestra.run.smithi039.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2024-05-14T15:18:05.065 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/150 2024-05-14T15:18:05.065 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/150 2024-05-14T15:18:05.065 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:05.067 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:05.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:05.130 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2024-05-14T15:18:05.516 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:05.521 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:05.522 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:05.523 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:05.523 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:05.793 INFO:teuthology.orchestra.run.smithi039.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2024-05-14T15:18:05.797 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/151 2024-05-14T15:18:05.797 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/151 2024-05-14T15:18:05.797 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:05.799 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:05.843 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:05.843 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2024-05-14T15:18:06.304 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:06.309 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:06.309 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:06.310 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:06.310 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:06.587 INFO:teuthology.orchestra.run.smithi039.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2024-05-14T15:18:06.590 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/152 2024-05-14T15:18:06.591 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/152 2024-05-14T15:18:06.591 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:06.593 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:06.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:06.649 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2024-05-14T15:18:07.065 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:07.069 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:07.070 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:07.071 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:07.071 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:07.360 INFO:teuthology.orchestra.run.smithi039.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2024-05-14T15:18:07.364 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/153 2024-05-14T15:18:07.364 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/153 2024-05-14T15:18:07.364 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:07.367 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:07.424 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:07.424 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2024-05-14T15:18:07.849 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:07.854 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:07.854 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:07.855 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:07.855 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:08.120 INFO:teuthology.orchestra.run.smithi039.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2024-05-14T15:18:08.124 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/154 2024-05-14T15:18:08.124 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/154 2024-05-14T15:18:08.125 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:08.127 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:08.181 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:08.181 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2024-05-14T15:18:08.609 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:08.610 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:08.610 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:08.611 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:08.612 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:08.889 INFO:teuthology.orchestra.run.smithi039.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2024-05-14T15:18:08.893 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/155 2024-05-14T15:18:08.893 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/155 2024-05-14T15:18:08.893 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:08.896 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:08.947 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:08.947 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2024-05-14T15:18:09.352 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:09.356 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:09.357 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:09.358 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:09.358 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:09.626 INFO:teuthology.orchestra.run.smithi039.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2024-05-14T15:18:09.630 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/156 2024-05-14T15:18:09.630 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/156 2024-05-14T15:18:09.630 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:09.632 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:09.689 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:09.689 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2024-05-14T15:18:10.102 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:10.106 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:10.107 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:10.108 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:10.108 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:10.380 INFO:teuthology.orchestra.run.smithi039.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2024-05-14T15:18:10.384 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/157 2024-05-14T15:18:10.384 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/157 2024-05-14T15:18:10.384 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:10.387 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:10.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:10.443 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2024-05-14T15:18:10.875 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:10.879 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:10.879 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:10.880 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:10.880 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:11.167 INFO:teuthology.orchestra.run.smithi039.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2024-05-14T15:18:11.171 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/158 2024-05-14T15:18:11.171 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/158 2024-05-14T15:18:11.171 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:11.174 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:11.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:11.226 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2024-05-14T15:18:11.664 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:11.668 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:11.669 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:11.670 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:11.670 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:11.971 INFO:teuthology.orchestra.run.smithi039.stdout:generic/159 [not run] file system doesn't support chattr +i 2024-05-14T15:18:11.975 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/159 2024-05-14T15:18:11.975 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/159 2024-05-14T15:18:11.975 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:11.978 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:11.996 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:11.996 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2024-05-14T15:18:12.209 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:12.213 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:12.214 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:12.215 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:12.215 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:12.483 INFO:teuthology.orchestra.run.smithi039.stdout:generic/160 [not run] file system doesn't support chattr +i 2024-05-14T15:18:12.487 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/160 2024-05-14T15:18:12.487 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/160 2024-05-14T15:18:12.487 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:12.490 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:12.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:12.508 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2024-05-14T15:18:12.721 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:12.725 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:12.725 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:12.726 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:12.727 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:13.124 INFO:teuthology.orchestra.run.smithi039.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:18:13.130 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/161 2024-05-14T15:18:13.130 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/161 2024-05-14T15:18:13.130 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:13.134 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:13.332 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:13.332 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2024-05-14T15:18:13.614 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:13.618 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:13.618 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:13.620 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:13.620 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:13.992 INFO:teuthology.orchestra.run.smithi039.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-05-14T15:18:14.034 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/162 2024-05-14T15:18:14.034 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/162 2024-05-14T15:18:14.034 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:14.038 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:14.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:14.267 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2024-05-14T15:18:14.530 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:14.534 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:14.534 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:14.535 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:14.536 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:14.925 INFO:teuthology.orchestra.run.smithi039.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-05-14T15:18:14.986 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/163 2024-05-14T15:18:14.986 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/163 2024-05-14T15:18:14.986 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:14.989 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:15.193 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:15.193 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2024-05-14T15:18:15.478 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:15.482 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:15.482 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:15.484 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:15.484 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:15.908 INFO:teuthology.orchestra.run.smithi039.stdout:generic/164 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:18:15.914 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/164 2024-05-14T15:18:15.914 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/164 2024-05-14T15:18:15.914 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:15.918 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:16.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:16.136 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2024-05-14T15:18:16.396 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:16.401 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:16.401 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:16.402 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:16.402 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:16.813 INFO:teuthology.orchestra.run.smithi039.stdout:generic/165 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:18:16.819 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/165 2024-05-14T15:18:16.819 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/165 2024-05-14T15:18:16.819 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:16.823 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:17.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:17.044 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2024-05-14T15:18:17.317 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:17.321 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:17.322 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:17.322 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:17.323 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:17.732 INFO:teuthology.orchestra.run.smithi039.stdout:generic/166 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:18:17.742 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/166 2024-05-14T15:18:17.742 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/166 2024-05-14T15:18:17.742 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:17.743 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:17.969 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:17.970 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2024-05-14T15:18:18.234 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:18.238 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:18.238 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:18.239 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:18.239 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:18.644 INFO:teuthology.orchestra.run.smithi039.stdout:generic/167 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:18:18.652 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/167 2024-05-14T15:18:18.652 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/167 2024-05-14T15:18:18.652 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:18.655 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:18.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:18.887 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2024-05-14T15:18:19.145 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:19.149 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:19.150 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:19.150 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:19.150 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:19.573 INFO:teuthology.orchestra.run.smithi039.stdout:generic/168 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:18:19.578 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/168 2024-05-14T15:18:19.579 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/168 2024-05-14T15:18:19.579 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:19.582 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:19.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:19.836 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2024-05-14T15:18:20.077 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:20.081 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:20.081 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:20.082 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:20.083 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:20.599 INFO:teuthology.orchestra.run.smithi039.stdout:generic/169 0s 2024-05-14T15:18:20.605 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/169 2024-05-14T15:18:20.605 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:20.607 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:20.616 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:20.616 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2024-05-14T15:18:20.835 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:20.839 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:20.840 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:20.841 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:20.841 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:21.261 INFO:teuthology.orchestra.run.smithi039.stdout:generic/170 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:18:21.265 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/170 2024-05-14T15:18:21.265 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/170 2024-05-14T15:18:21.265 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:21.269 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:21.488 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:21.488 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2024-05-14T15:18:21.752 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:21.756 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:21.756 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:21.757 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:21.757 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:22.190 INFO:teuthology.orchestra.run.smithi039.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:18:22.198 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/171 2024-05-14T15:18:22.198 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/171 2024-05-14T15:18:22.198 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:22.200 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:22.439 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:22.439 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2024-05-14T15:18:22.691 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:22.695 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:22.695 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:22.696 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:22.696 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:23.111 INFO:teuthology.orchestra.run.smithi039.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:18:23.119 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/172 2024-05-14T15:18:23.119 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/172 2024-05-14T15:18:23.119 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:23.121 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:23.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:23.353 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2024-05-14T15:18:23.621 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:23.625 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:23.626 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:23.627 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:23.627 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:24.047 INFO:teuthology.orchestra.run.smithi039.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:18:24.053 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/173 2024-05-14T15:18:24.053 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/173 2024-05-14T15:18:24.053 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:24.057 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:24.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:24.270 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2024-05-14T15:18:24.537 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:24.540 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:24.541 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:24.542 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:24.542 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:24.926 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:18:24.929 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:18:24.958 INFO:teuthology.orchestra.run.smithi039.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:18:24.965 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/174 2024-05-14T15:18:24.965 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/174 2024-05-14T15:18:24.965 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:24.968 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:25.192 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:25.193 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2024-05-14T15:18:25.470 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:25.474 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:25.474 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:25.476 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:25.476 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:25.899 INFO:teuthology.orchestra.run.smithi039.stdout:generic/175 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:18:25.906 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/175 2024-05-14T15:18:25.906 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/175 2024-05-14T15:18:25.906 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:25.908 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:26.172 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:26.173 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2024-05-14T15:18:26.408 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:26.413 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:26.413 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:26.414 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:26.414 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:26.832 INFO:teuthology.orchestra.run.smithi039.stdout:generic/176 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:18:26.840 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/176 2024-05-14T15:18:26.840 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/176 2024-05-14T15:18:26.840 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:26.842 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:27.093 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:27.093 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2024-05-14T15:18:27.344 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:27.348 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:27.348 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:27.349 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:27.349 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:27.763 INFO:teuthology.orchestra.run.smithi039.stdout:generic/177 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-14T15:18:27.767 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/177 2024-05-14T15:18:27.767 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/177 2024-05-14T15:18:27.767 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:27.770 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:27.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:27.815 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2024-05-14T15:18:28.234 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:28.238 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:28.238 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:28.239 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:28.240 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:28.515 INFO:teuthology.orchestra.run.smithi039.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2024-05-14T15:18:28.519 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/178 2024-05-14T15:18:28.519 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/178 2024-05-14T15:18:28.519 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:28.521 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:28.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:28.584 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2024-05-14T15:18:28.996 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:29.000 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:29.001 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:29.001 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:29.002 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:29.281 INFO:teuthology.orchestra.run.smithi039.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2024-05-14T15:18:29.285 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/179 2024-05-14T15:18:29.285 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/179 2024-05-14T15:18:29.285 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:29.288 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:29.345 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:29.345 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2024-05-14T15:18:29.757 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:29.761 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:29.762 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:29.763 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:29.763 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:30.032 INFO:teuthology.orchestra.run.smithi039.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2024-05-14T15:18:30.036 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/180 2024-05-14T15:18:30.036 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/180 2024-05-14T15:18:30.036 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:30.039 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:30.118 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:30.118 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2024-05-14T15:18:30.536 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:30.540 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:30.540 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:30.541 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:30.541 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:30.827 INFO:teuthology.orchestra.run.smithi039.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2024-05-14T15:18:30.831 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/181 2024-05-14T15:18:30.831 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/181 2024-05-14T15:18:30.831 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:30.834 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:30.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:30.892 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2024-05-14T15:18:31.296 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:31.300 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:31.300 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:31.301 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:31.302 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:31.573 INFO:teuthology.orchestra.run.smithi039.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2024-05-14T15:18:31.577 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/182 2024-05-14T15:18:31.577 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/182 2024-05-14T15:18:31.577 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:31.579 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:31.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:31.642 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2024-05-14T15:18:32.075 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:32.079 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:32.079 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:32.080 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:32.080 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:32.504 INFO:teuthology.orchestra.run.smithi039.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:18:32.511 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/183 2024-05-14T15:18:32.512 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/183 2024-05-14T15:18:32.512 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:32.519 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:32.746 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:32.747 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2024-05-14T15:18:33.003 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:33.008 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:33.008 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:33.009 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:33.009 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:33.324 INFO:teuthology.orchestra.run.smithi039.stdout:generic/184 0s 2024-05-14T15:18:33.330 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/184 2024-05-14T15:18:33.330 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:33.332 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:33.348 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:33.349 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2024-05-14T15:18:33.551 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:33.555 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:33.556 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:33.557 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:33.557 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:33.984 INFO:teuthology.orchestra.run.smithi039.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:18:33.992 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/185 2024-05-14T15:18:33.992 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/185 2024-05-14T15:18:33.992 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:33.996 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:34.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:34.174 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2024-05-14T15:18:34.478 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:34.482 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:34.482 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:34.483 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:34.483 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:34.889 INFO:teuthology.orchestra.run.smithi039.stdout:generic/186 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:18:34.894 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/186 2024-05-14T15:18:34.895 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/186 2024-05-14T15:18:34.895 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:34.900 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:35.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:35.114 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2024-05-14T15:18:35.392 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:35.396 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:35.397 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:35.398 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:35.398 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:35.804 INFO:teuthology.orchestra.run.smithi039.stdout:generic/187 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:18:35.810 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/187 2024-05-14T15:18:35.810 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/187 2024-05-14T15:18:35.810 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:35.814 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:36.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:36.053 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2024-05-14T15:18:36.307 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:36.311 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:36.311 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:36.312 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:36.312 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:36.748 INFO:teuthology.orchestra.run.smithi039.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:18:36.754 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/188 2024-05-14T15:18:36.754 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/188 2024-05-14T15:18:36.754 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:36.758 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:37.042 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:37.042 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2024-05-14T15:18:37.275 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:37.280 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:37.280 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:37.281 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:37.281 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:37.689 INFO:teuthology.orchestra.run.smithi039.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:18:37.696 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/189 2024-05-14T15:18:37.696 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/189 2024-05-14T15:18:37.696 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:37.699 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:37.943 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:37.943 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2024-05-14T15:18:38.218 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:38.222 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:38.222 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:38.223 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:38.223 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:38.629 INFO:teuthology.orchestra.run.smithi039.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:18:38.636 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/190 2024-05-14T15:18:38.636 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/190 2024-05-14T15:18:38.636 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:38.638 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:38.814 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:38.815 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2024-05-14T15:18:39.130 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:39.134 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:39.135 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:39.136 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:39.136 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:39.563 INFO:teuthology.orchestra.run.smithi039.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:18:39.568 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/191 2024-05-14T15:18:39.568 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/191 2024-05-14T15:18:39.568 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:39.572 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:39.858 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:39.858 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2024-05-14T15:18:40.091 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:40.095 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:40.095 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:40.096 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:40.097 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:40.352 INFO:teuthology.orchestra.run.smithi039.stdout:generic/192 [not run] atime not maintained by ceph 2024-05-14T15:18:40.356 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/192 2024-05-14T15:18:40.356 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/192 2024-05-14T15:18:40.356 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:40.358 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:40.387 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:40.387 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2024-05-14T15:18:40.598 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:40.602 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:40.603 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:40.604 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:40.604 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:41.727 INFO:teuthology.orchestra.run.smithi039.stdout:generic/193 1s 2024-05-14T15:18:41.733 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/193 2024-05-14T15:18:41.733 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:41.735 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:41.788 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:41.789 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2024-05-14T15:18:42.216 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:42.220 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:42.221 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:42.222 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:42.222 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:42.627 INFO:teuthology.orchestra.run.smithi039.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:18:42.633 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/194 2024-05-14T15:18:42.633 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/194 2024-05-14T15:18:42.633 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:42.637 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:42.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:42.932 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2024-05-14T15:18:43.154 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:43.158 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:43.159 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:43.160 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:43.160 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:43.561 INFO:teuthology.orchestra.run.smithi039.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:18:43.568 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/195 2024-05-14T15:18:43.568 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/195 2024-05-14T15:18:43.568 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:43.571 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:43.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:43.906 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2024-05-14T15:18:44.116 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:44.120 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:44.120 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:44.121 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:44.121 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:44.523 INFO:teuthology.orchestra.run.smithi039.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:18:44.529 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/196 2024-05-14T15:18:44.529 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/196 2024-05-14T15:18:44.529 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:44.533 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:44.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:44.824 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2024-05-14T15:18:45.071 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:45.075 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:45.075 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:45.076 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:45.076 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:45.467 INFO:teuthology.orchestra.run.smithi039.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:18:45.474 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/197 2024-05-14T15:18:45.474 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/197 2024-05-14T15:18:45.475 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:45.477 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:45.771 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:45.772 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2024-05-14T15:18:46.002 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:46.006 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:46.006 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:46.007 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:46.007 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:46.680 INFO:teuthology.orchestra.run.smithi039.stdout:generic/198 0s 2024-05-14T15:18:46.685 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/198 2024-05-14T15:18:46.685 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:46.688 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:46.731 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:46.731 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2024-05-14T15:18:47.196 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:47.201 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:47.202 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:47.203 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:47.203 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:47.636 INFO:teuthology.orchestra.run.smithi039.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:18:47.642 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/199 2024-05-14T15:18:47.642 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/199 2024-05-14T15:18:47.642 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:47.646 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:47.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:47.977 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2024-05-14T15:18:48.191 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:48.195 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:48.195 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:48.196 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:48.196 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:48.605 INFO:teuthology.orchestra.run.smithi039.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:18:48.611 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/200 2024-05-14T15:18:48.611 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/200 2024-05-14T15:18:48.611 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:48.615 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:48.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:48.873 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2024-05-14T15:18:49.122 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:49.126 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:49.126 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:49.127 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:49.127 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:49.540 INFO:teuthology.orchestra.run.smithi039.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:18:49.549 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/201 2024-05-14T15:18:49.549 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/201 2024-05-14T15:18:49.549 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:49.553 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:49.788 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:49.788 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2024-05-14T15:18:50.044 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:50.048 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:50.048 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:50.049 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:50.049 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:50.449 INFO:teuthology.orchestra.run.smithi039.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:18:50.457 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/202 2024-05-14T15:18:50.457 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/202 2024-05-14T15:18:50.457 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:50.461 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:50.696 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:50.697 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2024-05-14T15:18:50.956 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:50.960 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:50.960 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:50.961 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:50.961 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:51.383 INFO:teuthology.orchestra.run.smithi039.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:18:51.392 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/203 2024-05-14T15:18:51.392 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/203 2024-05-14T15:18:51.392 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:51.395 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:51.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:51.702 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2024-05-14T15:18:51.930 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:51.934 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:51.934 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:51.935 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:51.935 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:54.519 INFO:teuthology.orchestra.run.smithi039.stdout:generic/204 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-05-14T15:18:54.524 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/204 2024-05-14T15:18:54.524 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/204 2024-05-14T15:18:54.524 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:54.527 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:54.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:54.552 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2024-05-14T15:18:54.777 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:54.781 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:54.781 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:54.782 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:54.782 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:55.138 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:18:55.141 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:18:55.182 INFO:teuthology.orchestra.run.smithi039.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:18:55.189 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/205 2024-05-14T15:18:55.189 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/205 2024-05-14T15:18:55.189 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:55.196 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:55.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:55.543 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2024-05-14T15:18:55.769 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:55.773 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:55.773 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:55.775 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:55.775 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:56.180 INFO:teuthology.orchestra.run.smithi039.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:18:56.188 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/206 2024-05-14T15:18:56.188 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/206 2024-05-14T15:18:56.188 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:18:56.192 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:18:56.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:18:56.495 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2024-05-14T15:18:56.759 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:18:56.762 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:18:56.762 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:18:56.763 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:18:56.763 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:19:04.498 INFO:teuthology.orchestra.run.smithi039.stdout:generic/207 8s 2024-05-14T15:19:04.505 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/207 2024-05-14T15:19:04.505 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:19:04.508 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:19:04.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:19:04.555 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2024-05-14T15:19:04.993 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:19:04.997 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:19:04.997 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:19:04.998 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:19:04.999 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:19:25.241 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:19:25.244 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:19:25.342 INFO:tasks.ceph.osd.5.smithi062.stderr:2024-05-14T15:19:25.343+0000 7fa629395640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48440) UID: 0 2024-05-14T15:19:25.343 INFO:tasks.ceph.osd.4.smithi062.stderr:2024-05-14T15:19:25.343+0000 7fe149cba640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48440) UID: 0 2024-05-14T15:19:25.343 INFO:tasks.ceph.osd.7.smithi062.stderr:2024-05-14T15:19:25.343+0000 7fb173614640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48440) UID: 0 2024-05-14T15:19:25.343 INFO:tasks.ceph.osd.6.smithi062.stderr:2024-05-14T15:19:25.343+0000 7fb2cd976640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48440) UID: 0 2024-05-14T15:22:25.398 INFO:teuthology.orchestra.run.smithi039.stdout:generic/208 200s 2024-05-14T15:22:25.403 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/208 2024-05-14T15:22:25.403 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:22:25.406 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:22:25.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:22:25.451 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2024-05-14T15:22:25.880 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:22:25.884 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:22:25.884 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:22:25.886 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:22:25.886 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:22:53.568 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:22:53.571 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:22:53.602 INFO:tasks.ceph.osd.5.smithi062.stderr:2024-05-14T15:22:53.602+0000 7fa629395640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48789) UID: 0 2024-05-14T15:22:53.602 INFO:tasks.ceph.osd.7.smithi062.stderr:2024-05-14T15:22:53.602+0000 7fb173614640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48789) UID: 0 2024-05-14T15:22:53.603 INFO:tasks.ceph.osd.4.smithi062.stderr:2024-05-14T15:22:53.602+0000 7fe149cba640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48789) UID: 0 2024-05-14T15:22:53.603 INFO:tasks.ceph.osd.6.smithi062.stderr:2024-05-14T15:22:53.602+0000 7fb2cd976640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48789) UID: 0 2024-05-14T15:23:00.293 INFO:teuthology.orchestra.run.smithi039.stdout:generic/209 34s 2024-05-14T15:23:00.299 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/209 2024-05-14T15:23:00.299 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:23:00.302 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:00.351 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:23:00.351 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2024-05-14T15:23:00.788 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:23:00.792 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:23:00.793 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:23:00.793 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:23:00.794 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:01.156 INFO:teuthology.orchestra.run.smithi039.stdout:generic/210 1s 2024-05-14T15:23:01.161 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/210 2024-05-14T15:23:01.161 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:23:01.164 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:01.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:23:01.212 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2024-05-14T15:23:01.633 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:23:01.638 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:23:01.638 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:23:01.639 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:23:01.639 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:02.126 INFO:teuthology.orchestra.run.smithi039.stdout:generic/211 1s 2024-05-14T15:23:02.131 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/211 2024-05-14T15:23:02.131 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:23:02.134 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:02.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:23:02.148 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2024-05-14T15:23:02.357 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:23:02.361 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:23:02.361 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:23:02.363 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:23:02.363 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:02.717 INFO:teuthology.orchestra.run.smithi039.stdout:generic/212 0s 2024-05-14T15:23:02.723 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/212 2024-05-14T15:23:02.723 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:23:02.726 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:02.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:23:02.740 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2024-05-14T15:23:02.959 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:23:02.963 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:23:02.963 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:23:02.964 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:23:02.965 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:03.243 INFO:teuthology.orchestra.run.smithi039.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-05-14T15:23:03.247 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/213 2024-05-14T15:23:03.247 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/213 2024-05-14T15:23:03.247 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:23:03.250 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:03.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:23:03.261 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2024-05-14T15:23:03.469 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:23:03.473 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:23:03.473 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:23:03.474 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:23:03.474 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:03.745 INFO:teuthology.orchestra.run.smithi039.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-05-14T15:23:03.749 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/214 2024-05-14T15:23:03.749 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/214 2024-05-14T15:23:03.749 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:23:03.751 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:03.763 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:23:03.763 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2024-05-14T15:23:03.971 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:23:03.975 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:23:03.976 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:23:03.977 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:23:03.977 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:06.305 INFO:teuthology.orchestra.run.smithi039.stdout:generic/215 2s 2024-05-14T15:23:06.312 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/215 2024-05-14T15:23:06.312 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:23:06.315 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:06.344 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:23:06.344 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2024-05-14T15:23:06.557 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:23:06.561 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:23:06.561 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:23:06.563 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:23:06.563 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:07.016 INFO:teuthology.orchestra.run.smithi039.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:23:07.024 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/216 2024-05-14T15:23:07.024 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/216 2024-05-14T15:23:07.024 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:23:07.027 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:07.307 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:23:07.308 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2024-05-14T15:23:07.552 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:23:07.556 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:23:07.556 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:23:07.557 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:23:07.557 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:08.016 INFO:teuthology.orchestra.run.smithi039.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:23:08.023 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/217 2024-05-14T15:23:08.023 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/217 2024-05-14T15:23:08.023 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:23:08.034 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:08.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:23:08.381 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2024-05-14T15:23:08.594 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:23:08.598 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:23:08.598 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:23:08.599 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:23:08.599 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:09.026 INFO:teuthology.orchestra.run.smithi039.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:23:09.032 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/218 2024-05-14T15:23:09.032 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/218 2024-05-14T15:23:09.032 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:23:09.037 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:09.344 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:23:09.344 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2024-05-14T15:23:09.566 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:23:09.570 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:23:09.570 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:23:09.572 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:23:09.572 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:09.826 INFO:teuthology.orchestra.run.smithi039.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2024-05-14T15:23:09.830 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/219 2024-05-14T15:23:09.831 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/219 2024-05-14T15:23:09.831 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:23:09.833 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:09.844 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:23:09.844 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2024-05-14T15:23:10.049 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:23:10.053 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:23:10.053 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:23:10.054 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:23:10.054 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:10.465 INFO:teuthology.orchestra.run.smithi039.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:23:10.471 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/220 2024-05-14T15:23:10.471 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/220 2024-05-14T15:23:10.471 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:23:10.475 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:10.809 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:23:10.810 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2024-05-14T15:23:11.029 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:23:11.033 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:23:11.033 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:23:11.034 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:23:11.034 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:12.300 INFO:teuthology.orchestra.run.smithi039.stdout:generic/221 1s 2024-05-14T15:23:12.305 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/221 2024-05-14T15:23:12.305 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:23:12.308 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:12.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:23:12.324 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2024-05-14T15:23:12.518 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:23:12.522 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:23:12.522 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:23:12.524 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:23:12.524 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:12.929 INFO:teuthology.orchestra.run.smithi039.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:23:12.938 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/222 2024-05-14T15:23:12.938 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/222 2024-05-14T15:23:12.938 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:23:12.941 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:13.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:23:13.258 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2024-05-14T15:23:13.476 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:23:13.481 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:23:13.481 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:23:13.482 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:23:13.482 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:13.730 INFO:teuthology.orchestra.run.smithi039.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-05-14T15:23:13.734 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/223 2024-05-14T15:23:13.734 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/223 2024-05-14T15:23:13.734 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:23:13.737 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:13.751 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:23:13.751 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2024-05-14T15:23:13.952 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:23:13.956 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:23:13.957 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:23:13.958 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:23:13.958 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:14.199 INFO:teuthology.orchestra.run.smithi039.stdout:generic/224 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-05-14T15:23:14.203 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/224 2024-05-14T15:23:14.203 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/224 2024-05-14T15:23:14.203 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:23:14.206 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:14.240 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:23:14.240 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2024-05-14T15:23:14.442 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:23:14.446 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:23:14.446 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:23:14.447 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:23:14.448 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:14.734 INFO:teuthology.orchestra.run.smithi039.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-14T15:23:14.738 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/225 2024-05-14T15:23:14.738 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/225 2024-05-14T15:23:14.738 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:23:14.740 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:14.780 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:23:14.780 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2024-05-14T15:23:15.191 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:23:15.196 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:23:15.196 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:23:15.197 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:23:15.198 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:15.478 INFO:teuthology.orchestra.run.smithi039.stdout:generic/226 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-05-14T15:23:15.482 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/226 2024-05-14T15:23:15.482 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/226 2024-05-14T15:23:15.482 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:23:15.484 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:15.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:23:15.499 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2024-05-14T15:23:15.695 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:23:15.699 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:23:15.699 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:23:15.700 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:23:15.700 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:16.106 INFO:teuthology.orchestra.run.smithi039.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:23:16.112 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/227 2024-05-14T15:23:16.112 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/227 2024-05-14T15:23:16.112 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:23:16.121 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:16.411 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:23:16.411 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2024-05-14T15:23:16.635 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:23:16.639 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:23:16.639 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:23:16.640 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:23:16.640 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:16.929 INFO:teuthology.orchestra.run.smithi039.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-05-14T15:23:16.933 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/228 2024-05-14T15:23:16.934 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/228 2024-05-14T15:23:16.934 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:23:16.936 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:16.949 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:23:16.950 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2024-05-14T15:23:17.157 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:23:17.161 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:23:17.161 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:23:17.162 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:23:17.162 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:17.580 INFO:teuthology.orchestra.run.smithi039.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:23:17.586 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/229 2024-05-14T15:23:17.586 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/229 2024-05-14T15:23:17.586 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:23:17.595 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:17.874 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:23:17.874 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2024-05-14T15:23:18.107 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:23:18.111 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:23:18.112 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:23:18.113 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:23:18.113 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:18.353 INFO:teuthology.orchestra.run.smithi039.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2024-05-14T15:23:18.358 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/230 2024-05-14T15:23:18.358 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/230 2024-05-14T15:23:18.358 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:23:18.360 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:18.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:23:18.381 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2024-05-14T15:23:18.578 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:23:18.582 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:23:18.582 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:23:18.584 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:23:18.584 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:18.825 INFO:teuthology.orchestra.run.smithi039.stdout:generic/231 [not run] disk quotas not supported by this filesystem type: ceph 2024-05-14T15:23:18.829 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/231 2024-05-14T15:23:18.829 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/231 2024-05-14T15:23:18.829 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:23:18.832 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:18.864 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:23:18.864 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2024-05-14T15:23:19.060 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:23:19.064 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:23:19.065 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:23:19.066 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:23:19.066 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:19.304 INFO:teuthology.orchestra.run.smithi039.stdout:generic/232 [not run] disk quotas not supported by this filesystem type: ceph 2024-05-14T15:23:19.308 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/232 2024-05-14T15:23:19.308 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/232 2024-05-14T15:23:19.308 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:23:19.311 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:19.334 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:23:19.334 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2024-05-14T15:23:19.545 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:23:19.549 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:23:19.550 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:23:19.551 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:23:19.551 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:19.795 INFO:teuthology.orchestra.run.smithi039.stdout:generic/233 [not run] disk quotas not supported by this filesystem type: ceph 2024-05-14T15:23:19.799 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/233 2024-05-14T15:23:19.799 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/233 2024-05-14T15:23:19.799 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:23:19.801 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:19.826 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:23:19.826 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2024-05-14T15:23:20.032 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:23:20.036 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:23:20.036 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:23:20.037 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:23:20.037 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:20.281 INFO:teuthology.orchestra.run.smithi039.stdout:generic/234 [not run] disk quotas not supported by this filesystem type: ceph 2024-05-14T15:23:20.284 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/234 2024-05-14T15:23:20.284 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/234 2024-05-14T15:23:20.284 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:23:20.287 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:20.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:23:20.298 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2024-05-14T15:23:20.498 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:23:20.503 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:23:20.503 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:23:20.504 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:23:20.504 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:20.752 INFO:teuthology.orchestra.run.smithi039.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2024-05-14T15:23:20.756 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/235 2024-05-14T15:23:20.756 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/235 2024-05-14T15:23:20.756 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:23:20.759 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:20.793 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:23:20.793 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2024-05-14T15:23:20.989 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:23:20.993 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:23:20.993 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:23:20.995 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:23:20.995 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:22.318 INFO:teuthology.orchestra.run.smithi039.stdout:generic/236 1s 2024-05-14T15:23:22.325 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/236 2024-05-14T15:23:22.326 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:23:22.328 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:22.371 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:23:22.371 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2024-05-14T15:23:22.851 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:23:22.855 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:23:22.855 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:23:22.856 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:23:22.856 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:23.189 INFO:teuthology.orchestra.run.smithi039.stdout:generic/237 1s 2024-05-14T15:23:23.194 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/237 2024-05-14T15:23:23.194 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:23:23.197 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:23.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:23:23.239 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2024-05-14T15:23:23.729 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:23:23.733 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:23:23.734 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:23:23.735 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:23:23.736 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:24.141 INFO:teuthology.orchestra.run.smithi039.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:23:24.149 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/238 2024-05-14T15:23:24.149 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/238 2024-05-14T15:23:24.149 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:23:24.151 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:24.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:23:24.442 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2024-05-14T15:23:24.662 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:23:24.666 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:23:24.666 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:23:24.667 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:23:24.667 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:24.936 INFO:teuthology.orchestra.run.smithi039.stdout:generic/239 [not run] Sparse files are not supported or do not work as expected 2024-05-14T15:23:24.941 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/239 2024-05-14T15:23:24.941 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/239 2024-05-14T15:23:24.941 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:23:24.943 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:24.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:23:24.964 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2024-05-14T15:23:25.162 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:23:25.166 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:23:25.167 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:23:25.168 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:23:25.168 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:25.419 INFO:teuthology.orchestra.run.smithi039.stdout:generic/240 [not run] Sparse files are not supported or do not work as expected 2024-05-14T15:23:25.424 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/240 2024-05-14T15:23:25.424 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/240 2024-05-14T15:23:25.424 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:23:25.426 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:23:25.446 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:23:25.446 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2024-05-14T15:23:25.645 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:23:25.649 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:23:25.649 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:23:25.650 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:23:25.650 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:24:38.867 INFO:teuthology.orchestra.run.smithi039.stdout:generic/241 73s 2024-05-14T15:24:38.872 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/241 2024-05-14T15:24:38.872 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:24:38.875 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:24:41.397 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:24:41.397 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2024-05-14T15:24:41.779 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:24:41.783 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:24:41.783 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:24:41.784 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:24:41.784 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:24:42.258 INFO:teuthology.orchestra.run.smithi039.stdout:generic/242 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:24:42.266 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/242 2024-05-14T15:24:42.266 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/242 2024-05-14T15:24:42.266 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:24:42.268 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:24:42.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:24:42.539 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2024-05-14T15:24:43.104 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:24:43.110 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:24:43.111 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:24:43.112 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:24:43.112 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:24:44.019 INFO:teuthology.orchestra.run.smithi039.stdout:generic/243 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:24:44.025 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/243 2024-05-14T15:24:44.025 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/243 2024-05-14T15:24:44.025 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:24:44.029 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:24:44.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:24:44.390 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2024-05-14T15:24:44.649 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:24:44.654 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:24:44.654 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:24:44.655 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:24:44.655 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:24:44.943 INFO:teuthology.orchestra.run.smithi039.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2024-05-14T15:24:44.947 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/244 2024-05-14T15:24:44.947 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/244 2024-05-14T15:24:44.947 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:24:44.950 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:24:44.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:24:44.963 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2024-05-14T15:24:45.179 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:24:45.184 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:24:45.184 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:24:45.186 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:24:45.186 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:24:45.509 INFO:teuthology.orchestra.run.smithi039.stdout:generic/245 0s 2024-05-14T15:24:45.514 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/245 2024-05-14T15:24:45.514 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:24:45.517 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:24:45.586 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:24:45.586 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2024-05-14T15:24:45.997 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:24:46.001 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:24:46.001 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:24:46.002 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:24:46.002 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:24:46.302 INFO:teuthology.orchestra.run.smithi039.stdout:generic/246 0s 2024-05-14T15:24:46.307 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/246 2024-05-14T15:24:46.307 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:24:46.309 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:24:46.375 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:24:46.376 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2024-05-14T15:24:46.810 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:24:46.814 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:24:46.815 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:24:46.815 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:24:46.816 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:24:53.442 INFO:teuthology.orchestra.run.smithi039.stdout:generic/247 7s 2024-05-14T15:24:53.447 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/247 2024-05-14T15:24:53.447 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:24:53.450 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:24:53.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:24:53.459 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2024-05-14T15:24:53.671 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:24:53.675 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:24:53.675 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:24:53.676 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:24:53.677 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:24:53.969 INFO:teuthology.orchestra.run.smithi039.stdout:generic/248 0s 2024-05-14T15:24:53.974 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/248 2024-05-14T15:24:53.975 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:24:53.977 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:24:53.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:24:53.999 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2024-05-14T15:24:54.212 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:24:54.217 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:24:54.217 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:24:54.218 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:24:54.218 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:24:54.724 INFO:teuthology.orchestra.run.smithi039.stdout:generic/249 0s 2024-05-14T15:24:54.729 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/249 2024-05-14T15:24:54.729 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:24:54.732 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:24:54.793 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:24:54.793 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2024-05-14T15:24:55.218 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:24:55.223 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:24:55.224 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:24:55.224 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:24:55.224 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:24:55.532 INFO:teuthology.orchestra.run.smithi039.stdout:generic/250 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T15:24:55.536 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/250 2024-05-14T15:24:55.536 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/250 2024-05-14T15:24:55.536 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:24:55.538 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:24:55.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:24:55.553 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2024-05-14T15:24:55.764 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:24:55.768 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:24:55.769 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:24:55.770 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:24:55.770 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:24:56.143 INFO:teuthology.orchestra.run.smithi039.stdout:generic/251 [not run] FITRIM not supported on /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:24:56.151 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/251 2024-05-14T15:24:56.151 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/251 2024-05-14T15:24:56.151 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:24:56.153 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:24:56.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:24:56.166 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2024-05-14T15:24:56.371 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:24:56.375 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:24:56.375 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:24:56.376 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:24:56.377 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:24:56.644 INFO:teuthology.orchestra.run.smithi039.stdout:generic/252 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T15:24:56.648 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/252 2024-05-14T15:24:56.648 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/252 2024-05-14T15:24:56.648 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:24:56.651 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:24:56.665 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:24:56.665 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2024-05-14T15:24:56.866 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:24:56.870 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:24:56.871 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:24:56.872 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:24:56.872 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:24:57.296 INFO:teuthology.orchestra.run.smithi039.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:24:57.303 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/253 2024-05-14T15:24:57.303 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/253 2024-05-14T15:24:57.303 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:24:57.305 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:24:57.631 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:24:57.632 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2024-05-14T15:24:57.854 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:24:57.858 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:24:57.859 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:24:57.860 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:24:57.860 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:24:58.304 INFO:teuthology.orchestra.run.smithi039.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:24:58.312 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/254 2024-05-14T15:24:58.312 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/254 2024-05-14T15:24:58.312 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:24:58.315 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:24:58.598 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:24:58.599 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2024-05-14T15:24:58.827 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:24:58.831 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:24:58.832 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:24:58.833 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:24:58.833 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:24:59.196 INFO:teuthology.orchestra.run.smithi039.stdout:generic/255 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-05-14T15:24:59.201 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/255 2024-05-14T15:24:59.201 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/255 2024-05-14T15:24:59.201 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:24:59.203 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:24:59.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:24:59.247 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2024-05-14T15:24:59.726 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:24:59.730 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:24:59.733 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:24:59.734 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:24:59.734 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:25:00.402 INFO:teuthology.orchestra.run.smithi039.stdout:generic/256 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-05-14T15:25:00.406 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/256 2024-05-14T15:25:00.407 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/256 2024-05-14T15:25:00.407 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:25:00.409 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:25:00.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:25:00.427 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2024-05-14T15:25:00.632 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:25:00.636 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:25:00.637 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:25:00.638 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:25:00.638 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:25:01.638 INFO:teuthology.orchestra.run.smithi039.stdout:generic/257 1s 2024-05-14T15:25:01.644 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/257 2024-05-14T15:25:01.644 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:25:01.646 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:25:01.695 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:25:01.696 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2024-05-14T15:25:02.123 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:25:02.128 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:25:02.128 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:25:02.129 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:25:02.129 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:25:02.376 INFO:teuthology.orchestra.run.smithi039.stdout:generic/258 [not run] ceph does not support negative timestamps 2024-05-14T15:25:02.380 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/258 2024-05-14T15:25:02.381 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/258 2024-05-14T15:25:02.381 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:25:02.383 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:25:02.396 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:25:02.396 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2024-05-14T15:25:02.700 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:25:02.704 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:25:02.704 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:25:02.705 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:25:02.705 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:25:03.110 INFO:teuthology.orchestra.run.smithi039.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:25:03.116 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/259 2024-05-14T15:25:03.117 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/259 2024-05-14T15:25:03.117 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:25:03.122 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:25:03.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:25:03.463 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2024-05-14T15:25:03.666 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:25:03.670 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:25:03.671 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:25:03.671 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:25:03.672 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:25:04.019 INFO:teuthology.orchestra.run.smithi039.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:25:04.027 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/260 2024-05-14T15:25:04.027 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/260 2024-05-14T15:25:04.028 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:25:04.030 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:25:04.042 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:25:04.042 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2024-05-14T15:25:04.235 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:25:04.239 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:25:04.239 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:25:04.240 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:25:04.240 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:25:04.641 INFO:teuthology.orchestra.run.smithi039.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:25:04.647 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/261 2024-05-14T15:25:04.647 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/261 2024-05-14T15:25:04.647 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:25:04.651 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:25:04.981 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:25:04.982 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2024-05-14T15:25:05.203 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:25:05.207 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:25:05.208 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:25:05.209 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:25:05.209 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:25:05.618 INFO:teuthology.orchestra.run.smithi039.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:25:05.626 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/262 2024-05-14T15:25:05.626 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/262 2024-05-14T15:25:05.626 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:25:05.628 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:25:05.947 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:25:05.947 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2024-05-14T15:25:06.157 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:25:06.161 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:25:06.161 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:25:06.162 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:25:06.162 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:25:53.314 INFO:teuthology.orchestra.run.smithi039.stdout:generic/263 47s 2024-05-14T15:25:53.319 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/263 2024-05-14T15:25:53.319 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:25:53.321 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:25:53.358 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:25:53.358 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2024-05-14T15:25:53.801 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:25:53.805 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:25:53.806 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:25:53.807 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:25:53.807 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:25:54.227 INFO:teuthology.orchestra.run.smithi039.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:25:54.233 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/264 2024-05-14T15:25:54.233 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/264 2024-05-14T15:25:54.233 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:25:54.240 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:25:54.516 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:25:54.516 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2024-05-14T15:25:54.750 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:25:54.754 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:25:54.755 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:25:54.756 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:25:54.756 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:25:55.227 INFO:teuthology.orchestra.run.smithi039.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:25:55.233 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/265 2024-05-14T15:25:55.233 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/265 2024-05-14T15:25:55.233 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:25:55.236 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:25:55.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:25:55.457 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2024-05-14T15:25:55.721 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:25:55.725 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:25:55.726 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:25:55.727 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:25:55.727 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:25:56.199 INFO:teuthology.orchestra.run.smithi039.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:25:56.206 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/266 2024-05-14T15:25:56.206 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/266 2024-05-14T15:25:56.206 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:25:56.208 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:25:56.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:25:56.361 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2024-05-14T15:25:56.675 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:25:56.680 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:25:56.680 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:25:56.681 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:25:56.681 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:25:57.157 INFO:teuthology.orchestra.run.smithi039.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:25:57.165 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/267 2024-05-14T15:25:57.165 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/267 2024-05-14T15:25:57.165 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:25:57.167 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:25:57.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:25:57.381 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2024-05-14T15:25:57.642 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:25:57.646 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:25:57.647 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:25:57.648 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:25:57.648 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:25:58.115 INFO:teuthology.orchestra.run.smithi039.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:25:58.123 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/268 2024-05-14T15:25:58.123 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/268 2024-05-14T15:25:58.123 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:25:58.125 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:25:58.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:25:58.385 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2024-05-14T15:25:58.628 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:25:58.632 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:25:58.633 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:25:58.634 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:25:58.634 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:25:58.889 INFO:teuthology.orchestra.run.smithi039.stdout:generic/269 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-05-14T15:25:58.893 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/269 2024-05-14T15:25:58.893 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/269 2024-05-14T15:25:58.893 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:25:58.895 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:25:58.910 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:25:58.910 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2024-05-14T15:25:59.123 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:25:59.127 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:25:59.127 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:25:59.128 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:25:59.128 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:25:59.370 INFO:teuthology.orchestra.run.smithi039.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph 2024-05-14T15:25:59.374 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/270 2024-05-14T15:25:59.374 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/270 2024-05-14T15:25:59.374 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:25:59.376 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:25:59.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:25:59.392 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2024-05-14T15:25:59.598 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:25:59.602 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:25:59.603 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:25:59.604 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:25:59.604 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:00.081 INFO:teuthology.orchestra.run.smithi039.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:26:00.089 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/271 2024-05-14T15:26:00.089 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/271 2024-05-14T15:26:00.089 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:26:00.091 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:00.306 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:26:00.306 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2024-05-14T15:26:00.557 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:26:00.561 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:26:00.562 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:26:00.563 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:26:00.563 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:01.020 INFO:teuthology.orchestra.run.smithi039.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:26:01.028 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/272 2024-05-14T15:26:01.028 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/272 2024-05-14T15:26:01.028 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:26:01.031 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:01.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:26:01.260 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2024-05-14T15:26:01.520 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:26:01.524 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:26:01.524 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:26:01.525 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:26:01.525 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:01.795 INFO:teuthology.orchestra.run.smithi039.stdout:generic/273 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-05-14T15:26:01.799 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/273 2024-05-14T15:26:01.800 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/273 2024-05-14T15:26:01.800 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:26:01.802 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:01.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:26:01.817 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2024-05-14T15:26:02.026 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:26:02.030 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:26:02.031 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:26:02.032 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:26:02.032 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:02.296 INFO:teuthology.orchestra.run.smithi039.stdout:generic/274 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-05-14T15:26:02.300 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/274 2024-05-14T15:26:02.300 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/274 2024-05-14T15:26:02.300 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:26:02.302 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:02.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:26:02.322 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2024-05-14T15:26:02.530 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:26:02.534 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:26:02.535 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:26:02.536 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:26:02.536 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:02.784 INFO:teuthology.orchestra.run.smithi039.stdout:generic/275 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-05-14T15:26:02.788 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/275 2024-05-14T15:26:02.788 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/275 2024-05-14T15:26:02.788 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:26:02.791 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:02.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:26:02.806 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2024-05-14T15:26:03.010 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:26:03.014 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:26:03.015 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:26:03.016 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:26:03.016 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:03.502 INFO:teuthology.orchestra.run.smithi039.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:26:03.508 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/276 2024-05-14T15:26:03.508 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/276 2024-05-14T15:26:03.508 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:26:03.512 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:03.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:26:03.721 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2024-05-14T15:26:03.974 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:26:03.979 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:26:03.979 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:26:03.980 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:26:03.980 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:04.294 INFO:teuthology.orchestra.run.smithi039.stdout:generic/277 [not run] file system doesn't support chattr +A 2024-05-14T15:26:04.298 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/277 2024-05-14T15:26:04.298 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/277 2024-05-14T15:26:04.298 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:26:04.300 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:04.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:26:04.324 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2024-05-14T15:26:04.529 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:26:04.534 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:26:04.534 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:26:04.535 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:26:04.535 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:04.979 INFO:teuthology.orchestra.run.smithi039.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:26:04.987 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/278 2024-05-14T15:26:04.987 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/278 2024-05-14T15:26:04.987 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:26:04.990 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:05.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:26:05.239 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2024-05-14T15:26:05.475 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:26:05.479 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:26:05.480 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:26:05.481 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:26:05.481 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:05.947 INFO:teuthology.orchestra.run.smithi039.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:26:05.954 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/279 2024-05-14T15:26:05.954 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/279 2024-05-14T15:26:05.955 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:26:05.957 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:06.235 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:26:06.236 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2024-05-14T15:26:06.455 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:26:06.459 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:26:06.459 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:26:06.460 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:26:06.460 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:06.754 INFO:teuthology.orchestra.run.smithi039.stdout:generic/280 [not run] disk quotas not supported by this filesystem type: ceph 2024-05-14T15:26:06.758 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/280 2024-05-14T15:26:06.758 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/280 2024-05-14T15:26:06.758 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:26:06.760 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:06.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:26:06.775 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2024-05-14T15:26:06.980 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:26:06.984 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:26:06.985 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:26:06.986 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:26:06.986 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:07.432 INFO:teuthology.orchestra.run.smithi039.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:26:07.439 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/281 2024-05-14T15:26:07.439 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/281 2024-05-14T15:26:07.439 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:26:07.443 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:07.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:26:07.626 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2024-05-14T15:26:07.927 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:26:07.931 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:26:07.932 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:26:07.933 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:26:07.933 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:08.393 INFO:teuthology.orchestra.run.smithi039.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:26:08.401 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/282 2024-05-14T15:26:08.401 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/282 2024-05-14T15:26:08.401 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:26:08.403 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:08.658 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:26:08.658 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2024-05-14T15:26:08.895 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:26:08.899 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:26:08.900 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:26:08.901 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:26:08.901 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:09.371 INFO:teuthology.orchestra.run.smithi039.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:26:09.378 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/283 2024-05-14T15:26:09.378 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/283 2024-05-14T15:26:09.378 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:26:09.381 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:09.590 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:26:09.590 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2024-05-14T15:26:09.856 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:26:09.860 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:26:09.861 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:26:09.862 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:26:09.862 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:10.307 INFO:teuthology.orchestra.run.smithi039.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:26:10.314 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/284 2024-05-14T15:26:10.314 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/284 2024-05-14T15:26:10.314 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:26:10.317 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:10.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:26:10.581 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2024-05-14T15:26:10.831 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:26:10.835 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:26:10.836 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:26:10.837 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:26:10.837 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:12.198 INFO:teuthology.orchestra.run.smithi039.stdout:generic/285 2s 2024-05-14T15:26:12.204 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/285 2024-05-14T15:26:12.204 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:26:12.206 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:12.559 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:26:12.559 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2024-05-14T15:26:12.985 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:26:12.989 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:26:12.990 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:26:12.991 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:26:12.991 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:13.256 INFO:teuthology.orchestra.run.smithi039.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-05-14T15:26:13.260 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/286 2024-05-14T15:26:13.260 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/286 2024-05-14T15:26:13.261 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:26:13.263 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:13.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:26:13.283 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2024-05-14T15:26:13.483 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:26:13.488 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:26:13.488 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:26:13.489 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:26:13.489 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:14.127 INFO:teuthology.orchestra.run.smithi039.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:26:14.135 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/287 2024-05-14T15:26:14.135 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/287 2024-05-14T15:26:14.135 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:26:14.138 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:14.408 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:26:14.408 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2024-05-14T15:26:14.669 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:26:14.673 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:26:14.673 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:26:14.674 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:26:14.674 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:15.168 INFO:teuthology.orchestra.run.smithi039.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:26:15.186 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/288 2024-05-14T15:26:15.186 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/288 2024-05-14T15:26:15.187 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:26:15.189 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:15.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:26:15.209 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2024-05-14T15:26:15.472 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:26:15.476 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:26:15.477 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:26:15.478 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:26:15.478 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:16.039 INFO:teuthology.orchestra.run.smithi039.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:26:16.045 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/289 2024-05-14T15:26:16.045 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/289 2024-05-14T15:26:16.045 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:26:16.049 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:16.295 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:26:16.295 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2024-05-14T15:26:16.593 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:26:16.597 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:26:16.598 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:26:16.599 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:26:16.599 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:17.198 INFO:teuthology.orchestra.run.smithi039.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:26:17.205 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/290 2024-05-14T15:26:17.205 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/290 2024-05-14T15:26:17.205 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:26:17.208 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:17.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:26:17.433 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2024-05-14T15:26:17.760 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:26:17.764 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:26:17.765 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:26:17.766 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:26:17.766 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:18.334 INFO:teuthology.orchestra.run.smithi039.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:26:18.342 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/291 2024-05-14T15:26:18.342 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/291 2024-05-14T15:26:18.342 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:26:18.344 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:18.636 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:26:18.637 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2024-05-14T15:26:18.906 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:26:18.910 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:26:18.911 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:26:18.912 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:26:18.912 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:19.488 INFO:teuthology.orchestra.run.smithi039.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:26:19.494 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/292 2024-05-14T15:26:19.494 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/292 2024-05-14T15:26:19.494 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:26:19.498 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:19.783 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:26:19.783 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2024-05-14T15:26:20.061 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:26:20.066 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:26:20.066 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:26:20.067 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:26:20.067 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:20.598 INFO:teuthology.orchestra.run.smithi039.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:26:20.606 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/293 2024-05-14T15:26:20.606 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/293 2024-05-14T15:26:20.607 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:26:20.608 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:20.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:26:20.806 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2024-05-14T15:26:21.121 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:26:21.125 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:26:21.126 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:26:21.127 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:26:21.127 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:21.702 INFO:teuthology.orchestra.run.smithi039.stdout:generic/294 0s 2024-05-14T15:26:21.709 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/294 2024-05-14T15:26:21.709 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:26:21.716 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:21.733 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:26:21.733 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2024-05-14T15:26:22.108 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:26:22.112 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:26:22.113 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:26:22.114 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:26:22.114 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:22.569 INFO:teuthology.orchestra.run.smithi039.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:26:22.575 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/295 2024-05-14T15:26:22.575 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/295 2024-05-14T15:26:22.575 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:26:22.579 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:22.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:26:22.803 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2024-05-14T15:26:23.089 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:26:23.093 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:26:23.094 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:26:23.095 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:26:23.095 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:23.526 INFO:teuthology.orchestra.run.smithi039.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:26:23.533 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/296 2024-05-14T15:26:23.533 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/296 2024-05-14T15:26:23.533 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:26:23.536 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:23.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:26:23.802 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2024-05-14T15:26:24.046 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:26:24.062 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:26:24.063 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:26:24.063 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:26:24.063 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:24.526 INFO:teuthology.orchestra.run.smithi039.stdout:generic/297 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:26:24.531 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/297 2024-05-14T15:26:24.532 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/297 2024-05-14T15:26:24.532 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:26:24.539 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:24.757 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:26:24.757 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2024-05-14T15:26:25.029 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:26:25.033 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:26:25.033 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:26:25.034 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:26:25.034 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:25.467 INFO:teuthology.orchestra.run.smithi039.stdout:generic/298 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:26:25.473 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/298 2024-05-14T15:26:25.473 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/298 2024-05-14T15:26:25.473 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:26:25.479 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:25.708 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:26:25.708 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2024-05-14T15:26:25.985 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:26:25.990 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:26:25.990 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:26:25.991 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:26:25.991 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:26.330 INFO:teuthology.orchestra.run.smithi039.stdout:generic/299 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T15:26:26.335 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/299 2024-05-14T15:26:26.335 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/299 2024-05-14T15:26:26.335 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:26:26.337 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:26.358 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:26:26.358 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2024-05-14T15:26:26.570 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:26:26.574 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:26:26.575 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:26:26.576 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:26:26.576 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:26.878 INFO:teuthology.orchestra.run.smithi039.stdout:generic/300 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T15:26:26.882 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/300 2024-05-14T15:26:26.883 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/300 2024-05-14T15:26:26.883 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:26:26.885 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:26.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:26:26.906 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2024-05-14T15:26:27.105 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:26:27.109 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:26:27.109 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:26:27.110 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:26:27.110 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:27.547 INFO:teuthology.orchestra.run.smithi039.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:26:27.553 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/301 2024-05-14T15:26:27.553 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/301 2024-05-14T15:26:27.553 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:26:27.561 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:27.774 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:26:27.774 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2024-05-14T15:26:28.065 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:26:28.069 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:26:28.069 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:26:28.070 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:26:28.070 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:28.500 INFO:teuthology.orchestra.run.smithi039.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:26:28.506 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/302 2024-05-14T15:26:28.506 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/302 2024-05-14T15:26:28.507 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:26:28.513 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:28.843 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:26:28.844 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2024-05-14T15:26:29.057 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:26:29.061 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:26:29.061 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:26:29.062 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:26:29.062 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:29.368 INFO:teuthology.orchestra.run.smithi039.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2024-05-14T15:26:29.373 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/303 2024-05-14T15:26:29.373 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/303 2024-05-14T15:26:29.373 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:26:29.375 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:29.424 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:26:29.424 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2024-05-14T15:26:29.854 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:26:29.858 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:26:29.859 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:26:29.860 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:26:29.860 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:30.156 INFO:teuthology.orchestra.run.smithi039.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2024-05-14T15:26:30.160 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/304 2024-05-14T15:26:30.160 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/304 2024-05-14T15:26:30.160 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:26:30.163 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:30.215 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:26:30.215 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2024-05-14T15:26:30.631 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:26:30.635 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:26:30.636 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:26:30.637 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:26:30.637 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:31.077 INFO:teuthology.orchestra.run.smithi039.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:26:31.085 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/305 2024-05-14T15:26:31.085 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/305 2024-05-14T15:26:31.085 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:26:31.088 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:31.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:26:31.297 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2024-05-14T15:26:31.578 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:26:31.583 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:26:31.583 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:26:31.584 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:26:31.584 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:32.188 INFO:teuthology.orchestra.run.smithi039.stdout:generic/306 1s 2024-05-14T15:26:32.203 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/306 2024-05-14T15:26:32.203 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:26:32.209 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:32.618 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:26:32.618 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2024-05-14T15:26:33.027 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:26:33.032 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:26:33.032 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:26:33.033 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:26:33.033 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:34.657 INFO:teuthology.orchestra.run.smithi039.stdout:generic/307 1s 2024-05-14T15:26:34.663 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/307 2024-05-14T15:26:34.663 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:26:34.665 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:34.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:26:34.675 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2024-05-14T15:26:34.874 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:26:34.878 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:26:34.878 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:26:34.879 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:26:34.880 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:35.161 INFO:teuthology.orchestra.run.smithi039.stdout:generic/308 1s 2024-05-14T15:26:35.166 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/308 2024-05-14T15:26:35.166 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:26:35.169 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:35.193 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:26:35.193 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2024-05-14T15:26:35.397 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:26:35.401 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:26:35.402 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:26:35.403 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:26:35.403 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:36.729 INFO:teuthology.orchestra.run.smithi039.stdout:generic/309 1s 2024-05-14T15:26:36.735 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/309 2024-05-14T15:26:36.735 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:26:36.738 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:26:36.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:26:36.796 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2024-05-14T15:26:37.228 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:26:37.232 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:26:37.233 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:26:37.233 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:26:37.234 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:27:06.420 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:27:06.423 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:27:36.634 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:27:36.637 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:27:54.693 INFO:teuthology.orchestra.run.smithi039.stdout:generic/310 77s 2024-05-14T15:27:54.703 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/310 2024-05-14T15:27:54.703 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:27:54.709 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:27:54.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:27:54.964 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2024-05-14T15:27:55.389 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:27:55.396 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:27:55.397 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:27:55.398 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:27:55.398 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:27:55.761 INFO:teuthology.orchestra.run.smithi039.stdout:generic/311 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T15:27:55.765 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/311 2024-05-14T15:27:55.765 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/311 2024-05-14T15:27:55.765 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:27:55.768 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:27:55.780 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:27:55.780 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2024-05-14T15:27:55.991 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:27:55.995 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:27:55.995 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:27:55.996 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:27:55.997 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:27:56.237 INFO:teuthology.orchestra.run.smithi039.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-05-14T15:27:56.242 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/312 2024-05-14T15:27:56.242 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/312 2024-05-14T15:27:56.242 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:27:56.244 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:27:56.259 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:27:56.260 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2024-05-14T15:27:56.470 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:27:56.474 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:27:56.474 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:27:56.475 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:27:56.475 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:28:00.764 INFO:teuthology.orchestra.run.smithi039.stdout:generic/313 4s 2024-05-14T15:28:00.771 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/313 2024-05-14T15:28:00.771 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:28:00.774 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:28:00.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:28:00.793 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2024-05-14T15:28:00.998 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:28:01.003 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:28:01.003 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:28:01.004 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:28:01.004 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:28:01.530 INFO:teuthology.orchestra.run.smithi039.stdout:generic/314 0s 2024-05-14T15:28:01.535 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/314 2024-05-14T15:28:01.535 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:28:01.538 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:28:01.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:28:01.555 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2024-05-14T15:28:01.760 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:28:01.765 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:28:01.765 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:28:01.766 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:28:01.766 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:28:02.023 INFO:teuthology.orchestra.run.smithi039.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-05-14T15:28:02.027 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/315 2024-05-14T15:28:02.027 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/315 2024-05-14T15:28:02.027 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:28:02.030 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:28:02.046 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:28:02.046 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2024-05-14T15:28:02.246 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:28:02.250 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:28:02.250 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:28:02.251 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:28:02.251 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:28:02.615 INFO:teuthology.orchestra.run.smithi039.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-14T15:28:02.620 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/316 2024-05-14T15:28:02.620 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/316 2024-05-14T15:28:02.620 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:28:02.622 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:28:02.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:28:02.668 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2024-05-14T15:28:03.103 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:28:03.107 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:28:03.108 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:28:03.109 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:28:03.109 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:28:03.979 INFO:teuthology.orchestra.run.smithi039.stdout:generic/317 0s 2024-05-14T15:28:03.985 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/317 2024-05-14T15:28:03.985 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:28:03.988 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:28:03.997 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:28:03.997 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2024-05-14T15:28:04.194 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:28:04.198 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:28:04.199 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:28:04.200 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:28:04.200 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:28:04.767 INFO:teuthology.orchestra.run.smithi039.stdout:generic/318 0s 2024-05-14T15:28:04.772 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/318 2024-05-14T15:28:04.773 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:28:04.775 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:28:04.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:28:04.785 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2024-05-14T15:28:04.993 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:28:04.997 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:28:04.997 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:28:04.998 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:28:04.998 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:28:05.412 INFO:teuthology.orchestra.run.smithi039.stdout:generic/319 0s 2024-05-14T15:28:05.418 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/319 2024-05-14T15:28:05.418 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:28:05.420 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:28:05.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:28:05.429 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2024-05-14T15:28:05.626 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:28:05.630 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:28:05.631 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:28:05.632 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:28:05.632 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:28:05.887 INFO:teuthology.orchestra.run.smithi039.stdout:generic/320 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-05-14T15:28:05.891 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/320 2024-05-14T15:28:05.891 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/320 2024-05-14T15:28:05.892 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:28:05.894 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:28:05.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:28:05.907 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2024-05-14T15:28:06.109 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:28:06.114 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:28:06.114 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:28:06.115 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:28:06.115 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:28:06.373 INFO:teuthology.orchestra.run.smithi039.stdout:generic/321 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T15:28:06.377 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/321 2024-05-14T15:28:06.377 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/321 2024-05-14T15:28:06.378 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:28:06.380 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:28:06.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:28:06.392 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2024-05-14T15:28:06.607 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:28:06.611 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:28:06.611 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:28:06.612 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:28:06.613 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:28:06.690 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:28:06.693 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:28:06.873 INFO:teuthology.orchestra.run.smithi039.stdout:generic/322 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T15:28:06.877 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/322 2024-05-14T15:28:06.877 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/322 2024-05-14T15:28:06.877 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:28:06.879 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:28:06.892 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:28:06.892 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2024-05-14T15:28:07.092 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:28:07.096 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:28:07.096 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:28:07.097 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:28:07.097 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:28:36.782 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:28:36.785 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:28:36.878 INFO:tasks.ceph.osd.0.smithi039.stderr:2024-05-14T15:28:36.877+0000 7f65b0fad640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 303723) UID: 0 2024-05-14T15:28:36.879 INFO:tasks.ceph.osd.1.smithi039.stderr:2024-05-14T15:28:36.877+0000 7fcb29227640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 303723) UID: 0 2024-05-14T15:28:36.879 INFO:tasks.ceph.osd.2.smithi039.stderr:2024-05-14T15:28:36.877+0000 7f2810f95640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 303723) UID: 0 2024-05-14T15:28:36.879 INFO:tasks.ceph.osd.3.smithi039.stderr:2024-05-14T15:28:36.877+0000 7ff86254c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 303723) UID: 0 2024-05-14T15:30:08.167 INFO:teuthology.orchestra.run.smithi039.stdout:generic/323 121s 2024-05-14T15:30:08.172 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/323 2024-05-14T15:30:08.172 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:30:08.175 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:30:08.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:30:08.217 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2024-05-14T15:30:08.721 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:30:08.725 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:30:08.726 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:30:08.727 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:30:08.727 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:30:09.009 INFO:teuthology.orchestra.run.smithi039.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2024-05-14T15:30:09.014 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/324 2024-05-14T15:30:09.014 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/324 2024-05-14T15:30:09.014 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:30:09.016 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:30:09.028 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:30:09.028 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2024-05-14T15:30:09.238 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:30:09.242 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:30:09.242 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:30:09.243 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:30:09.243 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:30:09.522 INFO:teuthology.orchestra.run.smithi039.stdout:generic/325 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T15:30:09.526 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/325 2024-05-14T15:30:09.526 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/325 2024-05-14T15:30:09.526 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:30:09.528 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:30:09.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:30:09.541 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2024-05-14T15:30:09.746 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:30:09.750 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:30:09.751 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:30:09.752 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:30:09.752 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:30:10.211 INFO:teuthology.orchestra.run.smithi039.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:30:10.218 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/326 2024-05-14T15:30:10.218 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/326 2024-05-14T15:30:10.218 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:30:10.220 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:30:10.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:30:10.309 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2024-05-14T15:30:10.695 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:30:10.698 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:30:10.699 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:30:10.700 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:30:10.700 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:30:11.137 INFO:teuthology.orchestra.run.smithi039.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:30:11.143 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/327 2024-05-14T15:30:11.146 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/327 2024-05-14T15:30:11.146 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:30:11.150 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:30:11.249 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:30:11.249 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2024-05-14T15:30:11.614 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:30:11.618 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:30:11.618 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:30:11.619 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:30:11.620 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:30:12.081 INFO:teuthology.orchestra.run.smithi039.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:30:12.092 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/328 2024-05-14T15:30:12.092 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/328 2024-05-14T15:30:12.092 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:30:12.094 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:30:12.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:30:12.137 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2024-05-14T15:30:12.513 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:30:12.515 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:30:12.515 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:30:12.516 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:30:12.516 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:30:13.049 INFO:teuthology.orchestra.run.smithi039.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:30:13.055 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/329 2024-05-14T15:30:13.056 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/329 2024-05-14T15:30:13.056 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:30:13.060 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:30:13.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:30:13.095 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2024-05-14T15:30:13.497 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:30:13.501 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:30:13.502 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:30:13.502 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:30:13.503 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:30:13.942 INFO:teuthology.orchestra.run.smithi039.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:30:13.951 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/330 2024-05-14T15:30:13.952 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/330 2024-05-14T15:30:13.952 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:30:13.955 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:30:14.023 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:30:14.023 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2024-05-14T15:30:14.403 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:30:14.407 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:30:14.408 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:30:14.409 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:30:14.409 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:30:14.847 INFO:teuthology.orchestra.run.smithi039.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:30:14.855 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/331 2024-05-14T15:30:14.855 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/331 2024-05-14T15:30:14.855 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:30:14.857 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:30:14.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:30:14.961 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2024-05-14T15:30:15.346 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:30:15.350 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:30:15.351 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:30:15.352 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:30:15.352 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:30:15.805 INFO:teuthology.orchestra.run.smithi039.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:30:15.815 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/332 2024-05-14T15:30:15.815 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/332 2024-05-14T15:30:15.815 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:30:15.819 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:30:15.882 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:30:15.883 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2024-05-14T15:30:16.295 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:30:16.299 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:30:16.300 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:30:16.301 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:30:16.301 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:30:16.744 INFO:teuthology.orchestra.run.smithi039.stdout:generic/333 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:30:16.751 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/333 2024-05-14T15:30:16.751 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/333 2024-05-14T15:30:16.751 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:30:16.754 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:30:16.863 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:30:16.864 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2024-05-14T15:30:17.231 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:30:17.235 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:30:17.235 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:30:17.236 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:30:17.236 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:30:17.686 INFO:teuthology.orchestra.run.smithi039.stdout:generic/334 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:30:17.694 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/334 2024-05-14T15:30:17.694 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/334 2024-05-14T15:30:17.694 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:30:17.696 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:30:17.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:30:17.785 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2024-05-14T15:30:18.186 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:30:18.190 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:30:18.191 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:30:18.192 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:30:18.192 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:30:18.449 INFO:teuthology.orchestra.run.smithi039.stdout:generic/335 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T15:30:18.454 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/335 2024-05-14T15:30:18.454 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/335 2024-05-14T15:30:18.454 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:30:18.456 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:30:18.468 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:30:18.468 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2024-05-14T15:30:18.685 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:30:18.689 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:30:18.689 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:30:18.690 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:30:18.690 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:30:18.959 INFO:teuthology.orchestra.run.smithi039.stdout:generic/336 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T15:30:18.963 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/336 2024-05-14T15:30:18.963 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/336 2024-05-14T15:30:18.963 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:30:18.966 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:30:18.982 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:30:18.983 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2024-05-14T15:30:19.184 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:30:19.188 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:30:19.188 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:30:19.189 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:30:19.189 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:30:19.603 INFO:teuthology.orchestra.run.smithi039.stdout:generic/337 0s 2024-05-14T15:30:19.609 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/337 2024-05-14T15:30:19.609 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:30:19.611 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:30:19.620 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:30:19.620 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2024-05-14T15:30:19.831 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:30:19.835 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:30:19.835 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:30:19.836 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:30:19.836 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:30:20.112 INFO:teuthology.orchestra.run.smithi039.stdout:generic/338 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T15:30:20.116 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/338 2024-05-14T15:30:20.116 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/338 2024-05-14T15:30:20.116 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:30:20.118 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:30:20.142 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:30:20.142 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2024-05-14T15:30:20.369 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:30:20.373 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:30:20.373 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:30:20.374 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:30:20.374 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:12.855 INFO:teuthology.orchestra.run.smithi039.stdout:generic/339 52s 2024-05-14T15:31:12.860 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/339 2024-05-14T15:31:12.860 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:31:12.863 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:12.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:31:12.872 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2024-05-14T15:31:13.074 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:31:13.078 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:31:13.079 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:31:13.080 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:31:13.080 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:15.883 INFO:teuthology.orchestra.run.smithi039.stdout:generic/340 2s 2024-05-14T15:31:15.892 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/340 2024-05-14T15:31:15.892 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:31:15.895 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:15.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:31:15.910 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2024-05-14T15:31:16.439 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:31:16.444 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:31:16.445 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:31:16.447 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:31:16.447 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:16.813 INFO:teuthology.orchestra.run.smithi039.stdout:generic/341 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T15:31:16.820 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/341 2024-05-14T15:31:16.820 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/341 2024-05-14T15:31:16.820 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:31:16.823 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:16.843 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:31:16.844 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2024-05-14T15:31:17.102 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:31:17.107 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:31:17.107 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:31:17.108 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:31:17.108 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:17.361 INFO:teuthology.orchestra.run.smithi039.stdout:generic/342 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T15:31:17.365 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/342 2024-05-14T15:31:17.365 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/342 2024-05-14T15:31:17.365 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:31:17.367 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:17.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:31:17.380 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2024-05-14T15:31:17.574 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:31:17.578 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:31:17.578 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:31:17.579 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:31:17.579 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:17.843 INFO:teuthology.orchestra.run.smithi039.stdout:generic/343 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T15:31:17.847 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/343 2024-05-14T15:31:17.847 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/343 2024-05-14T15:31:17.847 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:31:17.850 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:17.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:31:17.866 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2024-05-14T15:31:18.064 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:31:18.068 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:31:18.068 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:31:18.069 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:31:18.069 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:22.608 INFO:teuthology.orchestra.run.smithi039.stdout:generic/344 4s 2024-05-14T15:31:22.617 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/344 2024-05-14T15:31:22.617 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:31:22.621 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:22.635 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:31:22.635 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2024-05-14T15:31:23.081 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:31:23.085 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:31:23.086 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:31:23.087 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:31:23.087 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:32.468 INFO:teuthology.orchestra.run.smithi039.stdout:generic/345 9s 2024-05-14T15:31:32.476 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/345 2024-05-14T15:31:32.476 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:31:32.480 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:32.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:31:32.494 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2024-05-14T15:31:32.960 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:31:32.963 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:31:32.964 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:31:32.965 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:31:32.965 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:35.540 INFO:teuthology.orchestra.run.smithi039.stdout:generic/346 2s 2024-05-14T15:31:35.558 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/346 2024-05-14T15:31:35.559 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:31:35.566 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:35.578 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:31:35.579 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2024-05-14T15:31:36.013 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:31:36.018 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:31:36.018 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:31:36.019 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:31:36.019 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:36.478 INFO:teuthology.orchestra.run.smithi039.stdout:generic/347 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T15:31:36.483 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/347 2024-05-14T15:31:36.483 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/347 2024-05-14T15:31:36.483 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:31:36.487 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:36.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:31:36.507 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2024-05-14T15:31:36.832 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:31:36.836 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:31:36.837 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:31:36.838 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:31:36.838 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:37.099 INFO:teuthology.orchestra.run.smithi039.stdout:generic/348 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T15:31:37.103 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/348 2024-05-14T15:31:37.103 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/348 2024-05-14T15:31:37.104 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:31:37.106 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:37.121 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:31:37.122 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2024-05-14T15:31:37.326 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:31:37.330 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:31:37.331 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:31:37.332 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:31:37.332 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:37.982 INFO:teuthology.orchestra.run.smithi039.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-05-14T15:31:37.986 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/349 2024-05-14T15:31:37.987 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/349 2024-05-14T15:31:37.987 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:31:37.988 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:38.006 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:31:38.007 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2024-05-14T15:31:38.218 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:31:38.222 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:31:38.223 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:31:38.224 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:31:38.224 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:39.362 INFO:teuthology.orchestra.run.smithi039.stdout:generic/350 1s 2024-05-14T15:31:39.368 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/350 2024-05-14T15:31:39.368 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:31:39.370 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:39.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:31:39.380 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2024-05-14T15:31:39.586 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:31:39.591 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:31:39.591 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:31:39.592 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:31:39.592 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:39.855 INFO:teuthology.orchestra.run.smithi039.stdout:generic/351 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-05-14T15:31:39.859 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/351 2024-05-14T15:31:39.859 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/351 2024-05-14T15:31:39.859 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:31:39.862 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:39.877 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:31:39.878 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2024-05-14T15:31:40.091 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:31:40.095 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:31:40.096 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:31:40.097 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:31:40.097 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:40.523 INFO:teuthology.orchestra.run.smithi039.stdout:generic/352 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:31:40.530 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/352 2024-05-14T15:31:40.530 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/352 2024-05-14T15:31:40.530 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:31:40.533 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:40.944 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:31:40.944 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2024-05-14T15:31:41.143 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:31:41.147 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:31:41.147 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:31:41.149 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:31:41.149 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:41.576 INFO:teuthology.orchestra.run.smithi039.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:31:41.581 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/353 2024-05-14T15:31:41.581 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/353 2024-05-14T15:31:41.581 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:31:41.585 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:41.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:31:41.977 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2024-05-14T15:31:42.182 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:31:42.187 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:31:42.187 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:31:42.188 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:31:42.188 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:46.535 INFO:teuthology.orchestra.run.smithi039.stdout:generic/354 4s 2024-05-14T15:31:46.543 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/354 2024-05-14T15:31:46.543 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:31:46.546 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:46.561 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:31:46.561 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2024-05-14T15:31:47.005 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:31:47.009 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:31:47.010 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:31:47.011 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:31:47.011 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:47.861 INFO:teuthology.orchestra.run.smithi039.stdout:generic/355 0s 2024-05-14T15:31:47.870 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/355 2024-05-14T15:31:47.870 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:31:47.874 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:47.922 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:31:47.923 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2024-05-14T15:31:48.444 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:31:48.448 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:31:48.449 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:31:48.450 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:31:48.450 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:49.026 INFO:teuthology.orchestra.run.smithi039.stdout:generic/356 [not run] swapfiles are not supported 2024-05-14T15:31:49.030 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/356 2024-05-14T15:31:49.030 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/356 2024-05-14T15:31:49.030 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:31:49.032 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:49.046 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:31:49.046 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2024-05-14T15:31:49.253 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:31:49.257 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:31:49.258 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:31:49.259 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:31:49.259 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:49.634 INFO:teuthology.orchestra.run.smithi039.stdout:generic/357 [not run] swapfiles are not supported 2024-05-14T15:31:49.638 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/357 2024-05-14T15:31:49.638 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/357 2024-05-14T15:31:49.638 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:31:49.640 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:49.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:31:49.655 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2024-05-14T15:31:49.852 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:31:49.856 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:31:49.857 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:31:49.857 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:31:49.858 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:50.291 INFO:teuthology.orchestra.run.smithi039.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:31:50.297 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/358 2024-05-14T15:31:50.297 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/358 2024-05-14T15:31:50.297 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:31:50.301 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:50.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:31:50.704 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2024-05-14T15:31:50.906 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:31:50.911 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:31:50.911 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:31:50.912 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:31:50.912 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:51.335 INFO:teuthology.orchestra.run.smithi039.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:31:51.343 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/359 2024-05-14T15:31:51.343 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/359 2024-05-14T15:31:51.343 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:31:51.345 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:51.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:31:51.607 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2024-05-14T15:31:51.916 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:31:51.921 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:31:51.921 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:31:51.922 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:31:51.922 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:52.207 INFO:teuthology.orchestra.run.smithi039.stdout:generic/360 0s 2024-05-14T15:31:52.213 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/360 2024-05-14T15:31:52.213 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:31:52.216 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:52.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:31:52.232 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2024-05-14T15:31:52.448 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:31:52.452 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:31:52.453 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:31:52.454 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:31:52.454 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:52.723 INFO:teuthology.orchestra.run.smithi039.stdout:generic/361 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T15:31:52.726 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/361 2024-05-14T15:31:52.727 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/361 2024-05-14T15:31:52.727 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:31:52.730 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:52.742 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:31:52.743 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2024-05-14T15:31:52.964 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:31:52.969 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:31:52.969 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:31:52.971 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:31:52.971 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:53.243 INFO:teuthology.orchestra.run.smithi039.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2024-05-14T15:31:53.248 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/362 2024-05-14T15:31:53.248 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/362 2024-05-14T15:31:53.248 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:31:53.251 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:53.268 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:31:53.268 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2024-05-14T15:31:53.512 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:31:53.516 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:31:53.517 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:31:53.518 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:31:53.518 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:53.760 INFO:teuthology.orchestra.run.smithi039.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2024-05-14T15:31:53.764 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/363 2024-05-14T15:31:53.765 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/363 2024-05-14T15:31:53.765 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:31:53.767 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:53.780 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:31:53.780 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2024-05-14T15:31:53.984 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:31:53.988 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:31:53.988 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:31:53.990 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:31:53.990 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:54.229 INFO:teuthology.orchestra.run.smithi039.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2024-05-14T15:31:54.233 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/364 2024-05-14T15:31:54.234 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/364 2024-05-14T15:31:54.234 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:31:54.236 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:54.249 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:31:54.250 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2024-05-14T15:31:54.443 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:31:54.447 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:31:54.447 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:31:54.448 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:31:54.449 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:54.683 INFO:teuthology.orchestra.run.smithi039.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2024-05-14T15:31:54.687 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/365 2024-05-14T15:31:54.687 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/365 2024-05-14T15:31:54.687 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:31:54.690 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:54.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:31:54.703 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2024-05-14T15:31:54.915 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:31:54.919 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:31:54.919 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:31:54.921 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:31:54.921 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:55.164 INFO:teuthology.orchestra.run.smithi039.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2024-05-14T15:31:55.168 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/366 2024-05-14T15:31:55.168 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/366 2024-05-14T15:31:55.168 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:31:55.170 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:55.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:31:55.183 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2024-05-14T15:31:55.381 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:31:55.385 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:31:55.386 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:31:55.387 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:31:55.387 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:55.624 INFO:teuthology.orchestra.run.smithi039.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2024-05-14T15:31:55.628 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/367 2024-05-14T15:31:55.628 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/367 2024-05-14T15:31:55.628 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:31:55.631 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:55.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:31:55.644 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2024-05-14T15:31:55.844 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:31:55.849 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:31:55.849 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:31:55.850 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:31:55.850 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:56.087 INFO:teuthology.orchestra.run.smithi039.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2024-05-14T15:31:56.091 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/368 2024-05-14T15:31:56.091 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/368 2024-05-14T15:31:56.091 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:31:56.094 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:56.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:31:56.107 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2024-05-14T15:31:56.308 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:31:56.312 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:31:56.312 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:31:56.313 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:31:56.313 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:56.558 INFO:teuthology.orchestra.run.smithi039.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2024-05-14T15:31:56.562 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/369 2024-05-14T15:31:56.562 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/369 2024-05-14T15:31:56.562 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:31:56.564 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:56.577 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:31:56.577 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2024-05-14T15:31:56.781 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:31:56.785 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:31:56.785 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:31:56.786 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:31:56.786 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:57.030 INFO:teuthology.orchestra.run.smithi039.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2024-05-14T15:31:57.034 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/370 2024-05-14T15:31:57.034 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/370 2024-05-14T15:31:57.034 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:31:57.036 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:57.049 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:31:57.049 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2024-05-14T15:31:57.249 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:31:57.253 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:31:57.254 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:31:57.255 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:31:57.255 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:57.504 INFO:teuthology.orchestra.run.smithi039.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-05-14T15:31:57.508 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/371 2024-05-14T15:31:57.508 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/371 2024-05-14T15:31:57.508 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:31:57.510 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:57.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:31:57.527 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2024-05-14T15:31:57.725 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:31:57.729 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:31:57.730 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:31:57.731 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:31:57.731 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:58.149 INFO:teuthology.orchestra.run.smithi039.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:31:58.156 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/372 2024-05-14T15:31:58.156 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/372 2024-05-14T15:31:58.156 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:31:58.158 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:58.577 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:31:58.577 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2024-05-14T15:31:58.788 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:31:58.792 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:31:58.792 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:31:58.794 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:31:58.794 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:59.214 INFO:teuthology.orchestra.run.smithi039.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:31:59.221 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/373 2024-05-14T15:31:59.221 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/373 2024-05-14T15:31:59.221 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:31:59.226 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:31:59.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:31:59.602 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2024-05-14T15:31:59.804 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:31:59.808 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:31:59.808 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:31:59.809 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:31:59.809 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:00.175 INFO:teuthology.orchestra.run.smithi039.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-05-14T15:32:00.229 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/374 2024-05-14T15:32:00.229 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/374 2024-05-14T15:32:00.229 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:00.233 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:00.650 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:00.650 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2024-05-14T15:32:00.850 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:00.854 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:00.854 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:00.855 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:00.856 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:01.176 INFO:teuthology.orchestra.run.smithi039.stdout:generic/375 1s 2024-05-14T15:32:01.181 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/375 2024-05-14T15:32:01.182 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:01.184 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:01.237 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:01.237 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2024-05-14T15:32:01.699 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:01.703 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:01.704 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:01.705 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:01.705 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:01.958 INFO:teuthology.orchestra.run.smithi039.stdout:generic/376 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T15:32:01.962 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/376 2024-05-14T15:32:01.962 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/376 2024-05-14T15:32:01.962 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:01.964 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:01.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:01.994 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2024-05-14T15:32:02.208 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:02.212 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:02.212 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:02.213 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:02.213 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:02.626 INFO:teuthology.orchestra.run.smithi039.stdout:generic/377 0s 2024-05-14T15:32:02.631 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/377 2024-05-14T15:32:02.632 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:02.634 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:02.643 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:02.643 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2024-05-14T15:32:02.854 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:02.858 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:02.859 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:02.860 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:02.860 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:03.334 INFO:teuthology.orchestra.run.smithi039.stdout:generic/378 1s 2024-05-14T15:32:03.339 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/378 2024-05-14T15:32:03.340 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:03.342 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:03.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:03.394 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2024-05-14T15:32:03.869 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:03.873 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:03.873 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:03.874 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:03.874 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:04.128 INFO:teuthology.orchestra.run.smithi039.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2024-05-14T15:32:04.132 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/379 2024-05-14T15:32:04.132 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/379 2024-05-14T15:32:04.133 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:04.135 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:04.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:04.161 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2024-05-14T15:32:04.359 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:04.363 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:04.363 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:04.364 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:04.364 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:04.601 INFO:teuthology.orchestra.run.smithi039.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2024-05-14T15:32:04.605 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/380 2024-05-14T15:32:04.605 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/380 2024-05-14T15:32:04.605 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:04.608 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:04.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:04.621 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2024-05-14T15:32:04.823 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:04.827 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:04.828 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:04.829 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:04.829 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:05.077 INFO:teuthology.orchestra.run.smithi039.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2024-05-14T15:32:05.081 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/381 2024-05-14T15:32:05.081 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/381 2024-05-14T15:32:05.082 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:05.084 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:05.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:05.117 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2024-05-14T15:32:05.312 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:05.316 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:05.316 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:05.317 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:05.317 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:05.561 INFO:teuthology.orchestra.run.smithi039.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2024-05-14T15:32:05.565 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/382 2024-05-14T15:32:05.565 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/382 2024-05-14T15:32:05.565 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:05.567 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:05.580 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:05.581 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2024-05-14T15:32:05.780 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:05.784 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:05.785 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:05.786 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:05.786 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:06.022 INFO:teuthology.orchestra.run.smithi039.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2024-05-14T15:32:06.026 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/383 2024-05-14T15:32:06.026 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/383 2024-05-14T15:32:06.026 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:06.028 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:06.041 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:06.041 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2024-05-14T15:32:06.243 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:06.247 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:06.247 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:06.249 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:06.249 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:06.500 INFO:teuthology.orchestra.run.smithi039.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2024-05-14T15:32:06.504 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/384 2024-05-14T15:32:06.504 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/384 2024-05-14T15:32:06.504 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:06.506 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:06.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:06.519 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2024-05-14T15:32:06.719 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:06.723 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:06.724 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:06.725 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:06.725 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:06.963 INFO:teuthology.orchestra.run.smithi039.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2024-05-14T15:32:06.967 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/385 2024-05-14T15:32:06.967 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/385 2024-05-14T15:32:06.968 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:06.970 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:06.983 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:06.983 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2024-05-14T15:32:07.190 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:07.194 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:07.195 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:07.196 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:07.196 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:07.428 INFO:teuthology.orchestra.run.smithi039.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2024-05-14T15:32:07.433 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/386 2024-05-14T15:32:07.433 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/386 2024-05-14T15:32:07.433 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:07.435 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:07.448 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:07.448 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2024-05-14T15:32:07.655 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:07.659 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:07.659 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:07.661 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:07.661 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:08.092 INFO:teuthology.orchestra.run.smithi039.stdout:generic/387 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:32:08.100 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/387 2024-05-14T15:32:08.100 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/387 2024-05-14T15:32:08.100 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:08.102 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:08.485 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:08.485 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2024-05-14T15:32:08.687 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:08.691 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:08.691 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:08.692 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:08.693 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:08.944 INFO:teuthology.orchestra.run.smithi039.stdout:generic/388 [not run] require 172.21.15.39:6789:/scratch to be local device 2024-05-14T15:32:08.948 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/388 2024-05-14T15:32:08.948 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/388 2024-05-14T15:32:08.948 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:08.950 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:08.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:08.964 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2024-05-14T15:32:09.169 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:09.173 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:09.174 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:09.175 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:09.175 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:09.424 INFO:teuthology.orchestra.run.smithi039.stdout:generic/389 [not run] O_TMPFILE is not supported 2024-05-14T15:32:09.428 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/389 2024-05-14T15:32:09.428 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/389 2024-05-14T15:32:09.428 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:09.431 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:09.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:09.443 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2024-05-14T15:32:09.662 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:09.666 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:09.666 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:09.668 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:09.668 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:09.930 INFO:teuthology.orchestra.run.smithi039.stdout:generic/390 [not run] ceph does not support freezing 2024-05-14T15:32:09.934 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/390 2024-05-14T15:32:09.935 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/390 2024-05-14T15:32:09.935 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:09.937 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:09.950 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:09.950 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2024-05-14T15:32:10.155 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:10.159 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:10.160 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:10.161 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:10.161 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:10.423 INFO:teuthology.orchestra.run.smithi039.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-05-14T15:32:10.427 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/391 2024-05-14T15:32:10.427 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/391 2024-05-14T15:32:10.427 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:10.429 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:10.445 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:10.445 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2024-05-14T15:32:10.644 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:10.648 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:10.649 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:10.650 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:10.650 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:11.002 INFO:teuthology.orchestra.run.smithi039.stdout:generic/392 [not run] ceph does not support shutdown 2024-05-14T15:32:11.010 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/392 2024-05-14T15:32:11.010 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/392 2024-05-14T15:32:11.010 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:11.013 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:11.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:11.025 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2024-05-14T15:32:11.232 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:11.236 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:11.237 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:11.238 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:11.238 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:11.991 INFO:teuthology.orchestra.run.smithi039.stdout:generic/393 0s 2024-05-14T15:32:11.996 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/393 2024-05-14T15:32:11.997 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:11.999 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:12.008 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:12.008 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2024-05-14T15:32:12.218 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:12.222 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:12.223 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:12.224 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:12.224 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:12.508 INFO:teuthology.orchestra.run.smithi039.stdout:generic/394 0s 2024-05-14T15:32:12.513 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/394 2024-05-14T15:32:12.514 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:12.516 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:12.587 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:12.587 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2024-05-14T15:32:13.033 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:13.037 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:13.038 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:13.039 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:13.039 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:13.504 INFO:teuthology.orchestra.run.smithi039.stdout:generic/395 [not run] kernel does not support ceph encryption 2024-05-14T15:32:13.516 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/395 2024-05-14T15:32:13.516 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/395 2024-05-14T15:32:13.516 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:13.519 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:13.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:13.538 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2024-05-14T15:32:13.816 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:13.820 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:13.821 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:13.822 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:13.822 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:14.344 INFO:teuthology.orchestra.run.smithi039.stdout:generic/396 [not run] kernel does not support ceph encryption 2024-05-14T15:32:14.368 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/396 2024-05-14T15:32:14.368 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/396 2024-05-14T15:32:14.368 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:14.371 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:14.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:14.389 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2024-05-14T15:32:14.654 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:14.658 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:14.658 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:14.659 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:14.659 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:15.081 INFO:teuthology.orchestra.run.smithi039.stdout:generic/397 [not run] kernel does not support ceph encryption 2024-05-14T15:32:15.089 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/397 2024-05-14T15:32:15.089 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/397 2024-05-14T15:32:15.089 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:15.091 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:15.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:15.104 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2024-05-14T15:32:15.311 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:15.315 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:15.315 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:15.316 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:15.317 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:15.715 INFO:teuthology.orchestra.run.smithi039.stdout:generic/398 [not run] kernel does not support ceph encryption 2024-05-14T15:32:15.723 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/398 2024-05-14T15:32:15.723 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/398 2024-05-14T15:32:15.724 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:15.726 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:15.738 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:15.739 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2024-05-14T15:32:15.938 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:15.942 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:15.943 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:15.944 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:15.944 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:16.353 INFO:teuthology.orchestra.run.smithi039.stdout:generic/399 [not run] kernel does not support ceph encryption 2024-05-14T15:32:16.362 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/399 2024-05-14T15:32:16.362 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/399 2024-05-14T15:32:16.362 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:16.364 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:16.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:16.388 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2024-05-14T15:32:16.597 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:16.601 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:16.601 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:16.602 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:16.602 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:16.837 INFO:teuthology.orchestra.run.smithi039.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2024-05-14T15:32:16.841 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/400 2024-05-14T15:32:16.841 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/400 2024-05-14T15:32:16.841 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:16.844 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:16.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:16.856 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2024-05-14T15:32:17.071 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:17.076 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:17.076 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:17.077 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:17.077 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:17.543 INFO:teuthology.orchestra.run.smithi039.stdout:generic/401 0s 2024-05-14T15:32:17.555 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/401 2024-05-14T15:32:17.555 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:17.559 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:17.572 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:17.572 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2024-05-14T15:32:17.973 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:17.977 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:17.977 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:17.978 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:17.978 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:18.353 INFO:teuthology.orchestra.run.smithi039.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2024-05-14T15:32:18.361 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/402 2024-05-14T15:32:18.361 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/402 2024-05-14T15:32:18.361 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:18.364 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:18.386 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:18.386 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2024-05-14T15:32:18.581 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:18.585 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:18.585 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:18.586 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:18.586 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:19.132 INFO:teuthology.orchestra.run.smithi039.stdout:generic/403 1s 2024-05-14T15:32:19.138 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/403 2024-05-14T15:32:19.138 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:19.140 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:19.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:19.150 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2024-05-14T15:32:19.358 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:19.362 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:19.362 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:19.363 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:19.364 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:19.627 INFO:teuthology.orchestra.run.smithi039.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-05-14T15:32:19.631 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/404 2024-05-14T15:32:19.631 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/404 2024-05-14T15:32:19.631 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:19.633 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:19.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:19.649 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2024-05-14T15:32:19.859 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:19.863 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:19.864 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:19.865 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:19.865 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:20.145 INFO:teuthology.orchestra.run.smithi039.stdout:generic/405 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T15:32:20.149 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/405 2024-05-14T15:32:20.149 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/405 2024-05-14T15:32:20.150 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:20.152 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:20.165 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:20.165 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2024-05-14T15:32:20.370 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:20.374 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:20.374 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:20.375 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:20.376 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:21.914 INFO:teuthology.orchestra.run.smithi039.stdout:generic/406 1s 2024-05-14T15:32:21.920 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/406 2024-05-14T15:32:21.920 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:21.922 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:21.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:21.931 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2024-05-14T15:32:22.134 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:22.138 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:22.138 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:22.139 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:22.139 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:22.460 INFO:teuthology.orchestra.run.smithi039.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2024-05-14T15:32:22.464 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/407 2024-05-14T15:32:22.464 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/407 2024-05-14T15:32:22.465 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:22.467 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:22.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:22.527 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2024-05-14T15:32:22.982 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:22.986 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:22.986 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:22.988 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:22.988 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:23.239 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:32:23.241 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:32:23.274 INFO:tasks.ceph.osd.0.smithi039.stderr:2024-05-14T15:32:23.271+0000 7f65b0fad640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 344974) UID: 0 2024-05-14T15:32:23.274 INFO:tasks.ceph.osd.1.smithi039.stderr:2024-05-14T15:32:23.271+0000 7fcb29227640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 344974) UID: 0 2024-05-14T15:32:23.274 INFO:tasks.ceph.osd.2.smithi039.stderr:2024-05-14T15:32:23.271+0000 7f2810f95640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 344974) UID: 0 2024-05-14T15:32:23.275 INFO:tasks.ceph.osd.3.smithi039.stderr:2024-05-14T15:32:23.271+0000 7ff86254c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 344974) UID: 0 2024-05-14T15:32:23.275 INFO:teuthology.orchestra.run.smithi039.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2024-05-14T15:32:23.275 INFO:tasks.ceph.mds.b.smithi062.stderr:2024-05-14T15:32:23.273+0000 7fcc26b22640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 49113) UID: 0 2024-05-14T15:32:23.276 INFO:tasks.ceph.mds.d.smithi062.stderr:2024-05-14T15:32:23.273+0000 7fbd5811b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 49113) UID: 0 2024-05-14T15:32:23.279 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/408 2024-05-14T15:32:23.279 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/408 2024-05-14T15:32:23.279 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:23.281 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:23.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:23.339 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2024-05-14T15:32:23.858 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:23.862 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:23.863 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:23.864 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:23.864 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:24.109 INFO:teuthology.orchestra.run.smithi039.stdout:generic/409 [not run] require 172.21.15.39:6789:/scratch to be local device 2024-05-14T15:32:24.113 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/409 2024-05-14T15:32:24.113 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/409 2024-05-14T15:32:24.113 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:24.115 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:24.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:24.128 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2024-05-14T15:32:24.327 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:24.331 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:24.331 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:24.333 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:24.333 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:24.595 INFO:teuthology.orchestra.run.smithi039.stdout:generic/410 [not run] require 172.21.15.39:6789:/scratch to be local device 2024-05-14T15:32:24.599 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/410 2024-05-14T15:32:24.599 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/410 2024-05-14T15:32:24.599 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:24.601 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:24.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:24.615 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2024-05-14T15:32:24.816 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:24.820 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:24.820 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:24.821 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:24.821 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:25.080 INFO:teuthology.orchestra.run.smithi039.stdout:generic/411 [not run] require 172.21.15.39:6789:/scratch to be local device 2024-05-14T15:32:25.084 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/411 2024-05-14T15:32:25.084 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/411 2024-05-14T15:32:25.084 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:25.087 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:25.112 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:25.112 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2024-05-14T15:32:25.315 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:25.319 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:25.320 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:25.321 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:25.321 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:25.844 INFO:teuthology.orchestra.run.smithi039.stdout:generic/412 0s 2024-05-14T15:32:25.850 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/412 2024-05-14T15:32:25.850 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:25.852 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:25.861 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:25.861 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2024-05-14T15:32:26.060 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:26.064 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:26.064 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:26.065 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:26.065 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:26.419 INFO:teuthology.orchestra.run.smithi039.stdout:generic/413 [not run] mount 172.21.15.39:6789:/scratch with dax failed 2024-05-14T15:32:26.423 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/413 2024-05-14T15:32:26.423 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/413 2024-05-14T15:32:26.423 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:26.425 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:26.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:26.438 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2024-05-14T15:32:26.647 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:26.651 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:26.652 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:26.653 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:26.653 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:27.086 INFO:teuthology.orchestra.run.smithi039.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:32:27.093 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/414 2024-05-14T15:32:27.093 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/414 2024-05-14T15:32:27.094 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:27.102 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:27.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:27.552 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2024-05-14T15:32:27.750 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:27.754 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:27.755 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:27.756 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:27.756 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:28.151 INFO:teuthology.orchestra.run.smithi039.stdout:generic/415 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:32:28.159 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/415 2024-05-14T15:32:28.159 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/415 2024-05-14T15:32:28.160 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:28.161 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:28.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:28.624 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2024-05-14T15:32:28.822 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:28.826 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:28.827 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:28.828 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:28.828 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:29.071 INFO:teuthology.orchestra.run.smithi039.stdout:generic/416 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-05-14T15:32:29.075 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/416 2024-05-14T15:32:29.076 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/416 2024-05-14T15:32:29.076 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:29.078 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:29.102 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:29.102 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2024-05-14T15:32:29.303 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:29.307 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:29.307 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:29.308 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:29.309 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:29.656 INFO:teuthology.orchestra.run.smithi039.stdout:generic/417 [not run] ceph does not support shutdown 2024-05-14T15:32:29.663 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/417 2024-05-14T15:32:29.664 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/417 2024-05-14T15:32:29.664 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:29.666 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:29.695 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:29.696 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2024-05-14T15:32:29.895 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:29.899 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:29.899 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:29.901 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:29.901 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:30.189 INFO:teuthology.orchestra.run.smithi039.stdout:generic/418 [not run] require 172.21.15.39:6789:/test to be valid block disk 2024-05-14T15:32:30.193 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/418 2024-05-14T15:32:30.194 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/418 2024-05-14T15:32:30.194 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:30.196 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:30.227 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:30.228 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2024-05-14T15:32:30.426 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:30.430 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:30.431 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:30.432 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:30.432 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:30.816 INFO:teuthology.orchestra.run.smithi039.stdout:generic/419 [not run] kernel does not support ceph encryption 2024-05-14T15:32:30.825 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/419 2024-05-14T15:32:30.825 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/419 2024-05-14T15:32:30.825 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:30.826 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:30.838 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:30.838 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2024-05-14T15:32:31.033 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:31.037 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:31.038 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:31.039 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:31.039 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:31.445 INFO:teuthology.orchestra.run.smithi039.stdout:generic/420 0s 2024-05-14T15:32:31.450 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/420 2024-05-14T15:32:31.450 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:31.453 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:31.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:31.514 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2024-05-14T15:32:32.047 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:32.051 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:32.052 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:32.053 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:32.053 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:32.452 INFO:teuthology.orchestra.run.smithi039.stdout:generic/421 [not run] kernel does not support ceph encryption 2024-05-14T15:32:32.473 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/421 2024-05-14T15:32:32.473 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/421 2024-05-14T15:32:32.473 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:32.475 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:32.487 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:32.488 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2024-05-14T15:32:32.684 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:32.688 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:32.689 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:32.690 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:32.690 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:32.959 INFO:teuthology.orchestra.run.smithi039.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-05-14T15:32:32.963 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/422 2024-05-14T15:32:32.963 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/422 2024-05-14T15:32:32.963 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:32.966 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:32.983 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:32.983 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2024-05-14T15:32:33.192 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:33.196 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:33.197 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:33.198 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:33.198 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:33.534 INFO:teuthology.orchestra.run.smithi039.stdout:generic/423 0s 2024-05-14T15:32:33.540 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/423 2024-05-14T15:32:33.540 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:33.543 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:33.604 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:33.604 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2024-05-14T15:32:34.130 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:34.134 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:34.135 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:34.136 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:34.136 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:34.407 INFO:teuthology.orchestra.run.smithi039.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2024-05-14T15:32:34.411 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/424 2024-05-14T15:32:34.411 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/424 2024-05-14T15:32:34.411 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:34.414 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:34.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:34.442 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2024-05-14T15:32:34.648 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:34.652 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:34.652 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:34.653 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:34.653 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:34.933 INFO:teuthology.orchestra.run.smithi039.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2024-05-14T15:32:34.937 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/425 2024-05-14T15:32:34.937 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/425 2024-05-14T15:32:34.937 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:32:34.940 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:32:34.982 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:32:34.982 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2024-05-14T15:32:35.514 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:32:35.518 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:32:35.519 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:32:35.520 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:32:35.520 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:33:03.157 INFO:teuthology.orchestra.run.smithi039.stdout:generic/426 27s 2024-05-14T15:33:03.433 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/426 2024-05-14T15:33:03.434 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:33:03.436 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:33:03.689 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:33:03.689 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2024-05-14T15:33:06.459 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:33:06.463 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:33:06.464 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:33:06.465 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:33:06.465 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:33:06.983 INFO:teuthology.orchestra.run.smithi039.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-05-14T15:33:06.988 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/427 2024-05-14T15:33:06.988 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/427 2024-05-14T15:33:06.988 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:33:06.990 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:33:07.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:33:07.008 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2024-05-14T15:33:07.211 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:33:07.215 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:33:07.216 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:33:07.217 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:33:07.217 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:33:07.541 INFO:teuthology.orchestra.run.smithi039.stdout:generic/428 0s 2024-05-14T15:33:07.547 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/428 2024-05-14T15:33:07.547 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:33:07.549 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:33:07.570 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:33:07.570 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2024-05-14T15:33:07.772 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:33:07.776 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:33:07.776 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:33:07.778 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:33:07.778 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:33:08.205 INFO:teuthology.orchestra.run.smithi039.stdout:generic/429 [not run] kernel does not support ceph encryption 2024-05-14T15:33:08.213 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/429 2024-05-14T15:33:08.213 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/429 2024-05-14T15:33:08.213 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:33:08.215 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:33:08.229 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:33:08.229 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2024-05-14T15:33:08.429 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:33:08.433 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:33:08.433 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:33:08.434 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:33:08.435 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:33:08.807 INFO:teuthology.orchestra.run.smithi039.stdout:generic/430 0s 2024-05-14T15:33:08.813 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/430 2024-05-14T15:33:08.813 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:33:08.815 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:33:08.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:33:08.900 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2024-05-14T15:33:09.399 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:33:09.403 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:33:09.403 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:33:09.404 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:33:09.404 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:33:09.741 INFO:teuthology.orchestra.run.smithi039.stdout:generic/431 0s 2024-05-14T15:33:09.746 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/431 2024-05-14T15:33:09.747 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:33:09.749 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:33:09.811 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:33:09.811 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2024-05-14T15:33:10.302 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:33:10.305 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:33:10.305 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:33:10.306 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:33:10.306 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:33:10.635 INFO:teuthology.orchestra.run.smithi039.stdout:generic/432 0s 2024-05-14T15:33:10.641 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/432 2024-05-14T15:33:10.641 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:33:10.643 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:33:10.699 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:33:10.699 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2024-05-14T15:33:11.192 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:33:11.196 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:33:11.197 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:33:11.197 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:33:11.198 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:33:11.515 INFO:teuthology.orchestra.run.smithi039.stdout:generic/433 0s 2024-05-14T15:33:11.520 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/433 2024-05-14T15:33:11.521 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:33:11.526 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:33:11.587 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:33:11.587 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2024-05-14T15:33:12.079 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:33:12.084 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:33:12.084 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:33:12.085 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:33:12.085 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:33:12.448 INFO:teuthology.orchestra.run.smithi039.stdout:generic/434 0s 2024-05-14T15:33:12.453 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/434 2024-05-14T15:33:12.453 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:33:12.456 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:33:12.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:33:12.528 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2024-05-14T15:33:13.020 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:33:13.024 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:33:13.024 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:33:13.025 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:33:13.026 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:33:13.428 INFO:teuthology.orchestra.run.smithi039.stdout:generic/435 [not run] kernel does not support ceph encryption 2024-05-14T15:33:13.436 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/435 2024-05-14T15:33:13.436 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/435 2024-05-14T15:33:13.436 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:33:13.438 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:33:13.460 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:33:13.460 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2024-05-14T15:33:13.678 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:33:13.682 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:33:13.683 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:33:13.684 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:33:13.684 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:33:14.224 INFO:teuthology.orchestra.run.smithi039.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-05-14T15:33:14.228 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/436 2024-05-14T15:33:14.228 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/436 2024-05-14T15:33:14.228 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:33:14.230 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:33:14.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:33:14.262 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2024-05-14T15:33:14.799 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:33:14.803 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:33:14.803 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:33:14.805 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:33:14.805 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:33:15.715 INFO:teuthology.orchestra.run.smithi039.stdout:generic/437 1s 2024-05-14T15:33:15.721 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/437 2024-05-14T15:33:15.721 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:33:15.723 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:33:15.743 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:33:15.743 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2024-05-14T15:33:15.945 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:33:15.949 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:33:15.949 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:33:15.951 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:33:15.951 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:34:38.545 INFO:teuthology.orchestra.run.smithi039.stdout:generic/438 82s 2024-05-14T15:34:38.555 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/438 2024-05-14T15:34:38.555 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:34:38.558 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:34:38.577 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:34:38.577 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2024-05-14T15:34:38.778 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:34:38.782 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:34:38.783 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:34:38.784 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:34:38.784 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:34:40.345 INFO:teuthology.orchestra.run.smithi039.stdout:generic/439 2s 2024-05-14T15:34:40.391 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/439 2024-05-14T15:34:40.391 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:34:40.394 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:34:40.412 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:34:40.412 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2024-05-14T15:34:40.626 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:34:40.629 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:34:40.630 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:34:40.631 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:34:40.631 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:34:41.098 INFO:teuthology.orchestra.run.smithi039.stdout:generic/440 [not run] kernel does not support ceph encryption 2024-05-14T15:34:41.107 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/440 2024-05-14T15:34:41.108 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/440 2024-05-14T15:34:41.108 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:34:41.110 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:34:41.126 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:34:41.126 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2024-05-14T15:34:41.326 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:34:41.330 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:34:41.331 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:34:41.332 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:34:41.332 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:34:41.790 INFO:teuthology.orchestra.run.smithi039.stdout:generic/441 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T15:34:41.794 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/441 2024-05-14T15:34:41.794 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/441 2024-05-14T15:34:41.794 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:34:41.796 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:34:41.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:34:41.813 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2024-05-14T15:34:42.012 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:34:42.016 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:34:42.016 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:34:42.017 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:34:42.017 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:34:42.295 INFO:teuthology.orchestra.run.smithi039.stdout:generic/442 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T15:34:42.299 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/442 2024-05-14T15:34:42.299 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/442 2024-05-14T15:34:42.299 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:34:42.301 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:34:42.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:34:42.317 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2024-05-14T15:34:42.520 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:34:42.523 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:34:42.524 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:34:42.525 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:34:42.525 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:34:42.841 INFO:teuthology.orchestra.run.smithi039.stdout:generic/443 0s 2024-05-14T15:34:42.847 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/443 2024-05-14T15:34:42.847 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:34:42.850 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:34:42.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:34:42.873 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2024-05-14T15:34:43.079 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:34:43.083 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:34:43.083 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:34:43.084 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:34:43.085 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:34:43.539 INFO:teuthology.orchestra.run.smithi039.stdout:generic/444 0s 2024-05-14T15:34:43.545 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/444 2024-05-14T15:34:43.545 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:34:43.547 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:34:43.574 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:34:43.574 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2024-05-14T15:34:43.782 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:34:43.786 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:34:43.786 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:34:43.787 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:34:43.787 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:34:44.412 INFO:teuthology.orchestra.run.smithi039.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-05-14T15:34:44.417 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/445 2024-05-14T15:34:44.417 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/445 2024-05-14T15:34:44.417 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:34:44.419 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:34:44.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:34:44.459 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2024-05-14T15:34:44.958 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:34:44.962 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:34:44.963 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:34:44.964 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:34:44.964 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:35:09.000 INFO:teuthology.orchestra.run.smithi039.stdout:generic/446 23s 2024-05-14T15:35:09.009 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/446 2024-05-14T15:35:09.009 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:35:09.014 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:35:09.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:35:09.026 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2024-05-14T15:35:09.471 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:35:09.475 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:35:09.475 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:35:09.476 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:35:09.476 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:35:09.897 INFO:teuthology.orchestra.run.smithi039.stdout:generic/447 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:35:09.908 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/447 2024-05-14T15:35:09.908 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/447 2024-05-14T15:35:09.908 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:35:09.912 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:35:10.271 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:35:10.272 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2024-05-14T15:35:10.503 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:35:10.507 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:35:10.507 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:35:10.509 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:35:10.509 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:35:11.589 INFO:teuthology.orchestra.run.smithi039.stdout:generic/448 1s 2024-05-14T15:35:11.595 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/448 2024-05-14T15:35:11.595 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:35:11.597 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:35:11.647 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:35:11.647 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2024-05-14T15:35:12.116 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:35:12.120 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:35:12.120 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:35:12.121 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:35:12.121 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:35:12.533 INFO:teuthology.orchestra.run.smithi039.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-05-14T15:35:12.537 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/449 2024-05-14T15:35:12.537 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/449 2024-05-14T15:35:12.537 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:35:12.539 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:35:12.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:35:12.608 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2024-05-14T15:35:13.048 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:35:13.052 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:35:13.052 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:35:13.053 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:35:13.053 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:35:13.812 INFO:teuthology.orchestra.run.smithi039.stdout:generic/450 0s 2024-05-14T15:35:13.926 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/450 2024-05-14T15:35:13.926 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:35:13.929 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:35:13.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:35:13.993 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2024-05-14T15:35:14.451 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:35:14.457 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:35:14.458 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:35:14.459 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:35:14.459 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:35:44.860 INFO:teuthology.orchestra.run.smithi039.stdout:generic/451 30s 2024-05-14T15:35:44.866 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/451 2024-05-14T15:35:44.866 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:35:44.868 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:35:44.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:35:44.933 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2024-05-14T15:35:45.364 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:35:45.368 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:35:45.368 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:35:45.369 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:35:45.369 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:35:45.851 INFO:teuthology.orchestra.run.smithi039.stdout:generic/452 0s 2024-05-14T15:35:45.856 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/452 2024-05-14T15:35:45.856 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:35:45.859 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:35:45.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:35:45.868 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2024-05-14T15:35:46.071 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:35:46.075 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:35:46.076 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:35:46.077 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:35:46.077 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:35:46.329 INFO:teuthology.orchestra.run.smithi039.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2024-05-14T15:35:46.333 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/453 2024-05-14T15:35:46.333 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/453 2024-05-14T15:35:46.333 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:35:46.335 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:35:46.352 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:35:46.352 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2024-05-14T15:35:46.562 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:35:46.566 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:35:46.566 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:35:46.567 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:35:46.567 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:35:46.841 INFO:teuthology.orchestra.run.smithi039.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2024-05-14T15:35:46.845 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/454 2024-05-14T15:35:46.845 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/454 2024-05-14T15:35:46.846 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:35:46.848 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:35:46.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:35:46.873 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2024-05-14T15:35:47.076 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:35:47.080 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:35:47.080 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:35:47.081 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:35:47.081 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:35:47.412 INFO:teuthology.orchestra.run.smithi039.stdout:generic/455 [not run] This test requires a valid $LOGWRITES_DEV 2024-05-14T15:35:47.416 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/455 2024-05-14T15:35:47.417 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/455 2024-05-14T15:35:47.417 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:35:47.419 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:35:47.436 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:35:47.436 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2024-05-14T15:35:47.635 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:35:47.639 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:35:47.639 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:35:47.641 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:35:47.641 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:35:47.917 INFO:teuthology.orchestra.run.smithi039.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-05-14T15:35:47.921 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/456 2024-05-14T15:35:47.921 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/456 2024-05-14T15:35:47.921 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:35:47.925 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:35:47.946 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:35:47.947 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2024-05-14T15:35:48.150 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:35:48.154 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:35:48.154 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:35:48.155 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:35:48.155 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:35:48.687 INFO:teuthology.orchestra.run.smithi039.stdout:generic/457 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:35:48.695 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/457 2024-05-14T15:35:48.695 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/457 2024-05-14T15:35:48.695 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:35:48.697 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:35:48.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:35:48.954 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2024-05-14T15:35:49.167 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:35:49.171 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:35:49.171 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:35:49.172 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:35:49.172 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:35:49.593 INFO:teuthology.orchestra.run.smithi039.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2024-05-14T15:35:49.604 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/458 2024-05-14T15:35:49.604 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/458 2024-05-14T15:35:49.604 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:35:49.607 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:35:49.908 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:35:49.908 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2024-05-14T15:35:50.041 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:35:50.044 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:35:50.134 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:35:50.138 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:35:50.139 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:35:50.140 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:35:50.140 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:35:50.587 INFO:teuthology.orchestra.run.smithi039.stdout:generic/459 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T15:35:50.591 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/459 2024-05-14T15:35:50.591 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/459 2024-05-14T15:35:50.591 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:35:50.594 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:35:50.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:35:50.613 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2024-05-14T15:35:50.820 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:35:50.824 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:35:50.824 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:35:50.826 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:35:50.826 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:35:52.676 INFO:teuthology.orchestra.run.smithi039.stdout:generic/460 2s 2024-05-14T15:35:52.682 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/460 2024-05-14T15:35:52.682 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:35:52.684 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:35:52.693 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:35:52.693 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2024-05-14T15:35:52.909 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:35:52.913 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:35:52.913 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:35:52.914 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:35:52.914 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:35:53.284 INFO:teuthology.orchestra.run.smithi039.stdout:generic/461 [not run] ceph does not support shutdown 2024-05-14T15:35:53.288 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/461 2024-05-14T15:35:53.288 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/461 2024-05-14T15:35:53.288 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:35:53.291 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:35:53.305 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:35:53.305 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2024-05-14T15:35:53.561 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:35:53.565 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:35:53.565 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:35:53.566 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:35:53.566 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:35:53.998 INFO:teuthology.orchestra.run.smithi039.stdout:generic/462 [not run] mount 172.21.15.39:6789:/scratch with dax failed 2024-05-14T15:35:54.002 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/462 2024-05-14T15:35:54.003 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/462 2024-05-14T15:35:54.003 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:35:54.005 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:35:54.019 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:35:54.020 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2024-05-14T15:35:54.233 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:35:54.237 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:35:54.237 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:35:54.239 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:35:54.239 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:35:54.545 INFO:teuthology.orchestra.run.smithi039.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2024-05-14T15:35:54.549 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/463 2024-05-14T15:35:54.549 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/463 2024-05-14T15:35:54.549 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:35:54.551 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:35:54.616 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:35:54.617 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2024-05-14T15:35:55.021 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:35:55.025 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:35:55.026 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:35:55.027 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:35:55.027 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:36:20.151 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:36:20.155 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:36:50.621 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:36:50.624 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:36:51.218 INFO:teuthology.orchestra.run.smithi039.stdout:generic/464 56s 2024-05-14T15:36:51.223 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/464 2024-05-14T15:36:51.223 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:36:51.226 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:36:51.235 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:36:51.235 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2024-05-14T15:36:51.438 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:36:51.442 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:36:51.442 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:36:51.443 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:36:51.443 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:36:55.961 INFO:teuthology.orchestra.run.smithi039.stdout:generic/465 4s 2024-05-14T15:36:55.971 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/465 2024-05-14T15:36:55.971 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:36:55.974 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:36:55.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:36:55.993 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2024-05-14T15:36:56.364 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:36:56.368 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:36:56.368 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:36:56.369 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:36:56.369 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:36:56.632 INFO:teuthology.orchestra.run.smithi039.stdout:generic/466 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T15:36:56.637 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/466 2024-05-14T15:36:56.638 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/466 2024-05-14T15:36:56.638 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:36:56.639 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:36:56.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:36:56.657 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2024-05-14T15:36:56.859 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:36:56.863 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:36:56.863 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:36:56.864 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:36:56.865 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:37:01.576 INFO:teuthology.orchestra.run.smithi039.stdout:generic/467 5s 2024-05-14T15:37:01.639 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/467 2024-05-14T15:37:01.639 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:37:01.642 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:37:01.828 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:37:01.829 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2024-05-14T15:37:02.838 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:37:02.842 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:37:02.842 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:37:02.843 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:37:02.843 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:37:03.294 INFO:teuthology.orchestra.run.smithi039.stdout:generic/468 [not run] ceph does not support shutdown 2024-05-14T15:37:03.304 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/468 2024-05-14T15:37:03.304 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/468 2024-05-14T15:37:03.304 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:37:03.306 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:37:03.321 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:37:03.322 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2024-05-14T15:37:03.524 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:37:03.529 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:37:03.529 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:37:03.530 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:37:03.530 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:37:03.810 INFO:teuthology.orchestra.run.smithi039.stdout:generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-05-14T15:37:03.814 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/469 2024-05-14T15:37:03.814 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/469 2024-05-14T15:37:03.815 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:37:03.817 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:37:03.838 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:37:03.839 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2024-05-14T15:37:04.039 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:37:04.044 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:37:04.044 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:37:04.045 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:37:04.045 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:37:04.366 INFO:teuthology.orchestra.run.smithi039.stdout:generic/470 [not run] This test requires a valid $LOGWRITES_DEV 2024-05-14T15:37:04.370 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/470 2024-05-14T15:37:04.370 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/470 2024-05-14T15:37:04.370 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:37:04.373 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:37:04.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:37:04.389 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2024-05-14T15:37:04.588 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:37:04.592 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:37:04.592 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:37:04.594 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:37:04.594 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:37:20.979 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:37:20.982 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:37:51.085 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:37:51.088 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:37:55.419 INFO:teuthology.orchestra.run.smithi039.stdout:generic/471 51s 2024-05-14T15:37:55.427 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/471 2024-05-14T15:37:55.427 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:37:55.431 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:37:55.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:37:55.544 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2024-05-14T15:37:56.043 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:37:56.050 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:37:56.051 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:37:56.053 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:37:56.053 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:37:56.823 INFO:teuthology.orchestra.run.smithi039.stdout:generic/472 [not run] swapfiles are not supported 2024-05-14T15:37:56.828 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/472 2024-05-14T15:37:56.828 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/472 2024-05-14T15:37:56.828 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:37:56.830 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:37:56.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:37:56.846 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2024-05-14T15:37:57.053 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:37:57.057 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:37:57.057 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:37:57.058 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:37:57.058 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:37:57.353 INFO:teuthology.orchestra.run.smithi039.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-05-14T15:37:57.357 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/473 2024-05-14T15:37:57.358 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/473 2024-05-14T15:37:57.358 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:37:57.360 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:37:57.378 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:37:57.379 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2024-05-14T15:37:57.588 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:37:57.592 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:37:57.592 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:37:57.593 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:37:57.593 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:37:57.929 INFO:teuthology.orchestra.run.smithi039.stdout:generic/474 [not run] ceph does not support shutdown 2024-05-14T15:37:57.937 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/474 2024-05-14T15:37:57.938 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/474 2024-05-14T15:37:57.938 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:37:57.940 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:37:57.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:37:57.954 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2024-05-14T15:37:58.155 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:37:58.159 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:37:58.159 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:37:58.161 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:37:58.161 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:37:58.451 INFO:teuthology.orchestra.run.smithi039.stdout:generic/475 [not run] require 172.21.15.39:6789:/scratch to be valid block disk 2024-05-14T15:37:58.456 INFO:teuthology.orchestra.run.smithi039.stdout:Ran: generic/475 2024-05-14T15:37:58.456 INFO:teuthology.orchestra.run.smithi039.stdout:Not run: generic/475 2024-05-14T15:37:58.456 INFO:teuthology.orchestra.run.smithi039.stdout:Passed all 1 tests 2024-05-14T15:37:58.458 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:37:58.472 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-05-14T15:37:58.472 DEBUG:teuthology.orchestra.run.smithi039:> (cd /tmp/tmp.BmtVWB36S6xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2024-05-14T15:37:58.673 INFO:teuthology.orchestra.run.smithi039.stdout:FSTYP -- ceph 2024-05-14T15:37:58.677 INFO:teuthology.orchestra.run.smithi039.stdout:PLATFORM -- Linux/x86_64 smithi039 5.14.0-446.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri May 3 16:10:18 UTC 2024 2024-05-14T15:37:58.677 INFO:teuthology.orchestra.run.smithi039.stdout:MKFS_OPTIONS -- 172.21.15.39:6789:/scratch 2024-05-14T15:37:58.678 INFO:teuthology.orchestra.run.smithi039.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCSd0NmvLcMFBAAPT5llnU7oxxw2wJj4nHX3A== -o context=system_u:object_r:root_t:s0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch 2024-05-14T15:37:58.678 INFO:teuthology.orchestra.run.smithi039.stdout: 2024-05-14T15:38:21.153 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:38:21.157 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:38:51.242 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:38:51.246 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:39:21.931 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:39:21.934 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:39:52.041 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:39:52.044 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:40:22.368 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:40:22.371 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:40:52.658 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:40:52.662 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:41:22.751 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:41:22.757 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:41:22.838 INFO:tasks.ceph.osd.1.smithi039.stderr:2024-05-14T15:41:22.835+0000 7fcb29227640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580158) UID: 0 2024-05-14T15:41:22.845 INFO:tasks.ceph.osd.3.smithi039.stderr:2024-05-14T15:41:22.841+0000 7ff86254c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580158) UID: 0 2024-05-14T15:41:22.846 INFO:tasks.ceph.osd.0.smithi039.stderr:2024-05-14T15:41:22.833+0000 7f65b0fad640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580158) UID: 0 2024-05-14T15:41:22.848 INFO:tasks.ceph.osd.2.smithi039.stderr:2024-05-14T15:41:22.847+0000 7f2810f95640 -1 Fail to open '/proc/580158/cmdline' error = (2) No such file or directory 2024-05-14T15:41:22.848 INFO:tasks.ceph.osd.2.smithi039.stderr:2024-05-14T15:41:22.847+0000 7f2810f95640 -1 received signal: Hangup from (PID: 580158) UID: 0 2024-05-14T15:46:18.596 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:46:18.599 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:46:18.652 INFO:tasks.ceph.osd.4.smithi062.stderr:2024-05-14T15:46:18.652+0000 7fe149cba640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49720) UID: 0 2024-05-14T15:46:18.653 INFO:tasks.ceph.osd.6.smithi062.stderr:2024-05-14T15:46:18.652+0000 7fb2cd976640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49720) UID: 0 2024-05-14T15:46:18.653 INFO:tasks.ceph.osd.7.smithi062.stderr:2024-05-14T15:46:18.652+0000 7fb173614640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49720) UID: 0 2024-05-14T15:46:18.654 INFO:tasks.ceph.osd.5.smithi062.stderr:2024-05-14T15:46:18.652+0000 7fa629395640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49720) UID: 0 2024-05-14T15:46:18.753 INFO:tasks.ceph.osd.2.smithi039.stderr:2024-05-14T15:46:18.752+0000 7f2810f95640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580235) UID: 0 2024-05-14T15:46:18.753 INFO:tasks.ceph.osd.3.smithi039.stderr:2024-05-14T15:46:18.752+0000 7ff86254c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580235) UID: 0 2024-05-14T15:46:18.754 INFO:tasks.ceph.osd.0.smithi039.stderr:2024-05-14T15:46:18.752+0000 7f65b0fad640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580235) UID: 0 2024-05-14T15:46:18.754 INFO:tasks.ceph.osd.1.smithi039.stderr:2024-05-14T15:46:18.752+0000 7fcb29227640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580235) UID: 0 2024-05-14T15:51:04.539 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:51:04.542 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T15:51:04.580 INFO:tasks.ceph.mds.b.smithi062.stderr:2024-05-14T15:51:04.579+0000 7fcc26b22640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 49755) UID: 0 2024-05-14T15:51:04.580 INFO:tasks.ceph.mds.d.smithi062.stderr:2024-05-14T15:51:04.579+0000 7fbd5811b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 49755) UID: 0 2024-05-14T15:51:04.602 INFO:tasks.ceph.osd.2.smithi039.stderr:2024-05-14T15:51:04.601+0000 7f2810f95640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580276) UID: 0 2024-05-14T15:51:04.603 INFO:tasks.ceph.osd.0.smithi039.stderr:2024-05-14T15:51:04.601+0000 7f65b0fad640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580276) UID: 0 2024-05-14T15:51:04.603 INFO:tasks.ceph.osd.3.smithi039.stderr:2024-05-14T15:51:04.601+0000 7ff86254c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580276) UID: 0 2024-05-14T15:51:04.603 INFO:tasks.ceph.osd.1.smithi039.stderr:2024-05-14T15:51:04.601+0000 7fcb29227640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580276) UID: 0 2024-05-14T15:55:56.485 INFO:tasks.ceph.osd.4.smithi062.stderr:2024-05-14T15:55:56.481+0000 7fe149cba640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49788) UID: 0 2024-05-14T15:55:56.485 INFO:tasks.ceph.osd.6.smithi062.stderr:2024-05-14T15:55:56.485+0000 7fb2cd976640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49788) UID: 0 2024-05-14T15:55:56.498 INFO:tasks.ceph.osd.5.smithi062.stderr:2024-05-14T15:55:56.497+0000 7fa629395640 -1 Fail to open '/proc/49788/cmdline' error = (2) No such file or directory 2024-05-14T15:55:56.498 INFO:tasks.ceph.osd.5.smithi062.stderr:2024-05-14T15:55:56.497+0000 7fa629395640 -1 received signal: Hangup from (PID: 49788) UID: 0 2024-05-14T15:55:56.534 INFO:tasks.ceph.osd.7.smithi062.stderr:2024-05-14T15:55:56.485+0000 7fb173614640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49788) UID: 0 2024-05-14T16:00:53.259 INFO:teuthology.orchestra.run.smithi062.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-osd.6.log.1: 2024-05-14T16:00:53.259 INFO:teuthology.orchestra.run.smithi062.stderr:gzip: stdin: file size changed while zipping 2024-05-14T16:05:39.695 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:05:39.698 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:05:39.734 INFO:tasks.ceph.mds.b.smithi062.stderr:2024-05-14T16:05:39.733+0000 7fcc26b22640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 49903) UID: 0 2024-05-14T16:05:39.734 INFO:tasks.ceph.mds.d.smithi062.stderr:2024-05-14T16:05:39.733+0000 7fbd5811b640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 49903) UID: 0 2024-05-14T16:05:40.232 INFO:tasks.ceph.osd.2.smithi039.stderr:2024-05-14T16:05:40.232+0000 7f2810f95640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580422) UID: 0 2024-05-14T16:05:40.233 INFO:tasks.ceph.osd.0.smithi039.stderr:2024-05-14T16:05:40.232+0000 7f65b0fad640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580422) UID: 0 2024-05-14T16:05:40.233 INFO:tasks.ceph.osd.1.smithi039.stderr:2024-05-14T16:05:40.232+0000 7fcb29227640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580422) UID: 0 2024-05-14T16:05:40.242 INFO:tasks.ceph.osd.3.smithi039.stderr:2024-05-14T16:05:40.232+0000 7ff86254c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580422) UID: 0 2024-05-14T16:08:07.222 INFO:tasks.ceph.osd.5.smithi062.stderr:2024-05-14T16:08:07.220+0000 7fa61f98b640 -1 bdev(0x5610e7458900 /var/lib/ceph/osd/ceph-5/block) _aio_thread got r=-28 ((28) No space left on device) 2024-05-14T16:08:07.223 INFO:tasks.ceph.osd.5.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3588-ge2b755a6/rpm/el9/BUILD/ceph-19.0.0-3588-ge2b755a6/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7fa61f98b640 time 2024-05-14T16:08:07.221382+0000 2024-05-14T16:08:07.223 INFO:tasks.ceph.osd.5.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3588-ge2b755a6/rpm/el9/BUILD/ceph-19.0.0-3588-ge2b755a6/src/blk/kernel/KernelDevice.cc: 666: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2024-05-14T16:08:07.223 INFO:tasks.ceph.osd.5.smithi062.stderr: ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev) 2024-05-14T16:08:07.223 INFO:tasks.ceph.osd.5.smithi062.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc0) [0x5610df554f4e] 2024-05-14T16:08:07.223 INFO:tasks.ceph.osd.5.smithi062.stderr: 2: (KernelDevice::_aio_thread()+0xc2a) [0x5610df9601ca] 2024-05-14T16:08:07.223 INFO:tasks.ceph.osd.5.smithi062.stderr: 3: ceph-osd(+0xfd0d55) [0x5610df960d55] 2024-05-14T16:08:07.223 INFO:tasks.ceph.osd.5.smithi062.stderr: 4: (Thread::entry_wrapper()+0x43) [0x5610df5261fd] 2024-05-14T16:08:07.223 INFO:tasks.ceph.osd.5.smithi062.stderr: 5: (Thread::_entry_func(void*)+0xd) [0x5610df526219] 2024-05-14T16:08:07.223 INFO:tasks.ceph.osd.5.smithi062.stderr: 6: /lib64/libc.so.6(+0x89c02) [0x7fa62c889c02] 2024-05-14T16:08:07.224 INFO:tasks.ceph.osd.5.smithi062.stderr: 7: /lib64/libc.so.6(+0x10ec40) [0x7fa62c90ec40] 2024-05-14T16:08:07.224 INFO:tasks.ceph.osd.5.smithi062.stderr:*** Caught signal (Aborted) ** 2024-05-14T16:08:07.224 INFO:tasks.ceph.osd.5.smithi062.stderr: in thread 7fa61f98b640 thread_name:bstore_aio 2024-05-14T16:08:07.224 INFO:tasks.ceph.osd.5.smithi062.stderr:2024-05-14T16:08:07.221+0000 7fa61f98b640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3588-ge2b755a6/rpm/el9/BUILD/ceph-19.0.0-3588-ge2b755a6/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7fa61f98b640 time 2024-05-14T16:08:07.221382+0000 2024-05-14T16:08:07.224 INFO:tasks.ceph.osd.5.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3588-ge2b755a6/rpm/el9/BUILD/ceph-19.0.0-3588-ge2b755a6/src/blk/kernel/KernelDevice.cc: 666: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2024-05-14T16:08:07.224 INFO:tasks.ceph.osd.5.smithi062.stderr: 2024-05-14T16:08:07.224 INFO:tasks.ceph.osd.5.smithi062.stderr: ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev) 2024-05-14T16:08:07.224 INFO:tasks.ceph.osd.5.smithi062.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc0) [0x5610df554f4e] 2024-05-14T16:08:07.224 INFO:tasks.ceph.osd.5.smithi062.stderr: 2: (KernelDevice::_aio_thread()+0xc2a) [0x5610df9601ca] 2024-05-14T16:08:07.224 INFO:tasks.ceph.osd.5.smithi062.stderr: 3: ceph-osd(+0xfd0d55) [0x5610df960d55] 2024-05-14T16:08:07.224 INFO:tasks.ceph.osd.5.smithi062.stderr: 4: (Thread::entry_wrapper()+0x43) [0x5610df5261fd] 2024-05-14T16:08:07.224 INFO:tasks.ceph.osd.5.smithi062.stderr: 5: (Thread::_entry_func(void*)+0xd) [0x5610df526219] 2024-05-14T16:08:07.224 INFO:tasks.ceph.osd.5.smithi062.stderr: 6: /lib64/libc.so.6(+0x89c02) [0x7fa62c889c02] 2024-05-14T16:08:07.224 INFO:tasks.ceph.osd.5.smithi062.stderr: 7: /lib64/libc.so.6(+0x10ec40) [0x7fa62c90ec40] 2024-05-14T16:08:07.224 INFO:tasks.ceph.osd.5.smithi062.stderr: 2024-05-14T16:08:07.227 INFO:tasks.ceph.osd.5.smithi062.stderr: ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev) 2024-05-14T16:08:07.227 INFO:tasks.ceph.osd.5.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa62c83e6f0] 2024-05-14T16:08:07.227 INFO:tasks.ceph.osd.5.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b94c) [0x7fa62c88b94c] 2024-05-14T16:08:07.227 INFO:tasks.ceph.osd.5.smithi062.stderr: 3: raise() 2024-05-14T16:08:07.227 INFO:tasks.ceph.osd.5.smithi062.stderr: 4: abort() 2024-05-14T16:08:07.227 INFO:tasks.ceph.osd.5.smithi062.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x232) [0x5610df5550c0] 2024-05-14T16:08:07.227 INFO:tasks.ceph.osd.5.smithi062.stderr: 6: (KernelDevice::_aio_thread()+0xc2a) [0x5610df9601ca] 2024-05-14T16:08:07.227 INFO:tasks.ceph.osd.5.smithi062.stderr: 7: ceph-osd(+0xfd0d55) [0x5610df960d55] 2024-05-14T16:08:07.227 INFO:tasks.ceph.osd.5.smithi062.stderr: 8: (Thread::entry_wrapper()+0x43) [0x5610df5261fd] 2024-05-14T16:08:07.227 INFO:tasks.ceph.osd.5.smithi062.stderr: 9: (Thread::_entry_func(void*)+0xd) [0x5610df526219] 2024-05-14T16:08:07.227 INFO:tasks.ceph.osd.5.smithi062.stderr: 10: /lib64/libc.so.6(+0x89c02) [0x7fa62c889c02] 2024-05-14T16:08:07.227 INFO:tasks.ceph.osd.5.smithi062.stderr: 11: /lib64/libc.so.6(+0x10ec40) [0x7fa62c90ec40] 2024-05-14T16:08:07.228 INFO:tasks.ceph.osd.5.smithi062.stderr:2024-05-14T16:08:07.227+0000 7fa61f98b640 -1 *** Caught signal (Aborted) ** 2024-05-14T16:08:07.228 INFO:tasks.ceph.osd.5.smithi062.stderr: in thread 7fa61f98b640 thread_name:bstore_aio 2024-05-14T16:08:07.228 INFO:tasks.ceph.osd.5.smithi062.stderr: 2024-05-14T16:08:07.228 INFO:tasks.ceph.osd.5.smithi062.stderr: ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev) 2024-05-14T16:08:07.228 INFO:tasks.ceph.osd.5.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa62c83e6f0] 2024-05-14T16:08:07.228 INFO:tasks.ceph.osd.5.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b94c) [0x7fa62c88b94c] 2024-05-14T16:08:07.228 INFO:tasks.ceph.osd.5.smithi062.stderr: 3: raise() 2024-05-14T16:08:07.228 INFO:tasks.ceph.osd.5.smithi062.stderr: 4: abort() 2024-05-14T16:08:07.228 INFO:tasks.ceph.osd.5.smithi062.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x232) [0x5610df5550c0] 2024-05-14T16:08:07.228 INFO:tasks.ceph.osd.5.smithi062.stderr: 6: (KernelDevice::_aio_thread()+0xc2a) [0x5610df9601ca] 2024-05-14T16:08:07.228 INFO:tasks.ceph.osd.5.smithi062.stderr: 7: ceph-osd(+0xfd0d55) [0x5610df960d55] 2024-05-14T16:08:07.229 INFO:tasks.ceph.osd.5.smithi062.stderr: 8: (Thread::entry_wrapper()+0x43) [0x5610df5261fd] 2024-05-14T16:08:07.229 INFO:tasks.ceph.osd.5.smithi062.stderr: 9: (Thread::_entry_func(void*)+0xd) [0x5610df526219] 2024-05-14T16:08:07.229 INFO:tasks.ceph.osd.5.smithi062.stderr: 10: /lib64/libc.so.6(+0x89c02) [0x7fa62c889c02] 2024-05-14T16:08:07.229 INFO:tasks.ceph.osd.5.smithi062.stderr: 11: /lib64/libc.so.6(+0x10ec40) [0x7fa62c90ec40] 2024-05-14T16:08:07.229 INFO:tasks.ceph.osd.5.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-05-14T16:08:07.229 INFO:tasks.ceph.osd.5.smithi062.stderr: 2024-05-14T16:08:07.289 INFO:tasks.ceph.osd.5.smithi062.stderr: -156> 2024-05-14T16:08:07.220+0000 7fa61f98b640 -1 bdev(0x5610e7458900 /var/lib/ceph/osd/ceph-5/block) _aio_thread got r=-28 ((28) No space left on device) 2024-05-14T16:08:07.289 INFO:tasks.ceph.osd.5.smithi062.stderr: -155> 2024-05-14T16:08:07.221+0000 7fa61f98b640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3588-ge2b755a6/rpm/el9/BUILD/ceph-19.0.0-3588-ge2b755a6/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7fa61f98b640 time 2024-05-14T16:08:07.221382+0000 2024-05-14T16:08:07.289 INFO:tasks.ceph.osd.5.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3588-ge2b755a6/rpm/el9/BUILD/ceph-19.0.0-3588-ge2b755a6/src/blk/kernel/KernelDevice.cc: 666: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2024-05-14T16:08:07.289 INFO:tasks.ceph.osd.5.smithi062.stderr: 2024-05-14T16:08:07.289 INFO:tasks.ceph.osd.5.smithi062.stderr: ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev) 2024-05-14T16:08:07.289 INFO:tasks.ceph.osd.5.smithi062.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc0) [0x5610df554f4e] 2024-05-14T16:08:07.290 INFO:tasks.ceph.osd.5.smithi062.stderr: 2: (KernelDevice::_aio_thread()+0xc2a) [0x5610df9601ca] 2024-05-14T16:08:07.290 INFO:tasks.ceph.osd.5.smithi062.stderr: 3: ceph-osd(+0xfd0d55) [0x5610df960d55] 2024-05-14T16:08:07.290 INFO:tasks.ceph.osd.5.smithi062.stderr: 4: (Thread::entry_wrapper()+0x43) [0x5610df5261fd] 2024-05-14T16:08:07.290 INFO:tasks.ceph.osd.5.smithi062.stderr: 5: (Thread::_entry_func(void*)+0xd) [0x5610df526219] 2024-05-14T16:08:07.290 INFO:tasks.ceph.osd.5.smithi062.stderr: 6: /lib64/libc.so.6(+0x89c02) [0x7fa62c889c02] 2024-05-14T16:08:07.290 INFO:tasks.ceph.osd.5.smithi062.stderr: 7: /lib64/libc.so.6(+0x10ec40) [0x7fa62c90ec40] 2024-05-14T16:08:07.290 INFO:tasks.ceph.osd.5.smithi062.stderr: 2024-05-14T16:08:07.290 INFO:tasks.ceph.osd.5.smithi062.stderr: 0> 2024-05-14T16:08:07.227+0000 7fa61f98b640 -1 *** Caught signal (Aborted) ** 2024-05-14T16:08:07.290 INFO:tasks.ceph.osd.5.smithi062.stderr: in thread 7fa61f98b640 thread_name:bstore_aio 2024-05-14T16:08:07.290 INFO:tasks.ceph.osd.5.smithi062.stderr: 2024-05-14T16:08:07.290 INFO:tasks.ceph.osd.5.smithi062.stderr: ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev) 2024-05-14T16:08:07.290 INFO:tasks.ceph.osd.5.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa62c83e6f0] 2024-05-14T16:08:07.290 INFO:tasks.ceph.osd.5.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b94c) [0x7fa62c88b94c] 2024-05-14T16:08:07.290 INFO:tasks.ceph.osd.5.smithi062.stderr: 3: raise() 2024-05-14T16:08:07.291 INFO:tasks.ceph.osd.5.smithi062.stderr: 4: abort() 2024-05-14T16:08:07.291 INFO:tasks.ceph.osd.5.smithi062.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x232) [0x5610df5550c0] 2024-05-14T16:08:07.291 INFO:tasks.ceph.osd.5.smithi062.stderr: 6: (KernelDevice::_aio_thread()+0xc2a) [0x5610df9601ca] 2024-05-14T16:08:07.291 INFO:tasks.ceph.osd.5.smithi062.stderr: 7: ceph-osd(+0xfd0d55) [0x5610df960d55] 2024-05-14T16:08:07.291 INFO:tasks.ceph.osd.5.smithi062.stderr: 8: (Thread::entry_wrapper()+0x43) [0x5610df5261fd] 2024-05-14T16:08:07.291 INFO:tasks.ceph.osd.5.smithi062.stderr: 9: (Thread::_entry_func(void*)+0xd) [0x5610df526219] 2024-05-14T16:08:07.291 INFO:tasks.ceph.osd.5.smithi062.stderr: 10: /lib64/libc.so.6(+0x89c02) [0x7fa62c889c02] 2024-05-14T16:08:07.291 INFO:tasks.ceph.osd.5.smithi062.stderr: 11: /lib64/libc.so.6(+0x10ec40) [0x7fa62c90ec40] 2024-05-14T16:08:07.291 INFO:tasks.ceph.osd.5.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-05-14T16:08:07.291 INFO:tasks.ceph.osd.5.smithi062.stderr: 2024-05-14T16:08:07.438 INFO:tasks.ceph.osd.5.smithi062.stderr: -3453> 2024-05-14T16:08:07.220+0000 7fa61f98b640 -1 bdev(0x5610e7458900 /var/lib/ceph/osd/ceph-5/block) _aio_thread got r=-28 ((28) No space left on device) 2024-05-14T16:08:07.439 INFO:tasks.ceph.osd.5.smithi062.stderr: -3452> 2024-05-14T16:08:07.221+0000 7fa61f98b640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3588-ge2b755a6/rpm/el9/BUILD/ceph-19.0.0-3588-ge2b755a6/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7fa61f98b640 time 2024-05-14T16:08:07.221382+0000 2024-05-14T16:08:07.439 INFO:tasks.ceph.osd.5.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3588-ge2b755a6/rpm/el9/BUILD/ceph-19.0.0-3588-ge2b755a6/src/blk/kernel/KernelDevice.cc: 666: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2024-05-14T16:08:07.439 INFO:tasks.ceph.osd.5.smithi062.stderr: 2024-05-14T16:08:07.439 INFO:tasks.ceph.osd.5.smithi062.stderr: ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev) 2024-05-14T16:08:07.439 INFO:tasks.ceph.osd.5.smithi062.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc0) [0x5610df554f4e] 2024-05-14T16:08:07.439 INFO:tasks.ceph.osd.5.smithi062.stderr: 2: (KernelDevice::_aio_thread()+0xc2a) [0x5610df9601ca] 2024-05-14T16:08:07.439 INFO:tasks.ceph.osd.5.smithi062.stderr: 3: ceph-osd(+0xfd0d55) [0x5610df960d55] 2024-05-14T16:08:07.439 INFO:tasks.ceph.osd.5.smithi062.stderr: 4: (Thread::entry_wrapper()+0x43) [0x5610df5261fd] 2024-05-14T16:08:07.439 INFO:tasks.ceph.osd.5.smithi062.stderr: 5: (Thread::_entry_func(void*)+0xd) [0x5610df526219] 2024-05-14T16:08:07.439 INFO:tasks.ceph.osd.5.smithi062.stderr: 6: /lib64/libc.so.6(+0x89c02) [0x7fa62c889c02] 2024-05-14T16:08:07.439 INFO:tasks.ceph.osd.5.smithi062.stderr: 7: /lib64/libc.so.6(+0x10ec40) [0x7fa62c90ec40] 2024-05-14T16:08:07.439 INFO:tasks.ceph.osd.5.smithi062.stderr: 2024-05-14T16:08:07.439 INFO:tasks.ceph.osd.5.smithi062.stderr: -3297> 2024-05-14T16:08:07.227+0000 7fa61f98b640 -1 *** Caught signal (Aborted) ** 2024-05-14T16:08:07.439 INFO:tasks.ceph.osd.5.smithi062.stderr: in thread 7fa61f98b640 thread_name:bstore_aio 2024-05-14T16:08:07.440 INFO:tasks.ceph.osd.5.smithi062.stderr: 2024-05-14T16:08:07.440 INFO:tasks.ceph.osd.5.smithi062.stderr: ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev) 2024-05-14T16:08:07.440 INFO:tasks.ceph.osd.5.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa62c83e6f0] 2024-05-14T16:08:07.440 INFO:tasks.ceph.osd.5.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b94c) [0x7fa62c88b94c] 2024-05-14T16:08:07.440 INFO:tasks.ceph.osd.5.smithi062.stderr: 3: raise() 2024-05-14T16:08:07.440 INFO:tasks.ceph.osd.5.smithi062.stderr: 4: abort() 2024-05-14T16:08:07.440 INFO:tasks.ceph.osd.5.smithi062.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x232) [0x5610df5550c0] 2024-05-14T16:08:07.440 INFO:tasks.ceph.osd.5.smithi062.stderr: 6: (KernelDevice::_aio_thread()+0xc2a) [0x5610df9601ca] 2024-05-14T16:08:07.440 INFO:tasks.ceph.osd.5.smithi062.stderr: 7: ceph-osd(+0xfd0d55) [0x5610df960d55] 2024-05-14T16:08:07.440 INFO:tasks.ceph.osd.5.smithi062.stderr: 8: (Thread::entry_wrapper()+0x43) [0x5610df5261fd] 2024-05-14T16:08:07.440 INFO:tasks.ceph.osd.5.smithi062.stderr: 9: (Thread::_entry_func(void*)+0xd) [0x5610df526219] 2024-05-14T16:08:07.440 INFO:tasks.ceph.osd.5.smithi062.stderr: 10: /lib64/libc.so.6(+0x89c02) [0x7fa62c889c02] 2024-05-14T16:08:07.440 INFO:tasks.ceph.osd.5.smithi062.stderr: 11: /lib64/libc.so.6(+0x10ec40) [0x7fa62c90ec40] 2024-05-14T16:08:07.440 INFO:tasks.ceph.osd.5.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-05-14T16:08:07.440 INFO:tasks.ceph.osd.5.smithi062.stderr: 2024-05-14T16:08:07.708 INFO:tasks.ceph.osd.5.smithi062.stderr:daemon-helper: command failed with exit status 5 2024-05-14T16:08:14.810 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-05-14T16:08:21.423 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~7s 2024-05-14T16:08:28.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~13s 2024-05-14T16:08:34.647 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~20s 2024-05-14T16:08:41.261 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~26s 2024-05-14T16:08:47.872 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~33s 2024-05-14T16:08:54.485 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~40s 2024-05-14T16:09:01.097 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~46s 2024-05-14T16:09:07.709 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~53s 2024-05-14T16:09:14.322 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~60s 2024-05-14T16:09:20.937 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~66s 2024-05-14T16:09:27.549 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~73s 2024-05-14T16:09:34.162 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~79s 2024-05-14T16:09:40.773 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~86s 2024-05-14T16:09:47.386 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~93s 2024-05-14T16:09:53.997 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~99s 2024-05-14T16:10:00.609 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~106s 2024-05-14T16:10:07.220 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~112s 2024-05-14T16:10:13.832 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~119s 2024-05-14T16:10:20.445 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~126s 2024-05-14T16:10:21.628 INFO:tasks.ceph.osd.4.smithi062.stderr:2024-05-14T16:10:21.625+0000 7fe149cba640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49967) UID: 0 2024-05-14T16:10:21.641 INFO:tasks.ceph.osd.7.smithi062.stderr:2024-05-14T16:10:21.638+0000 7fb173614640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49967) UID: 0 2024-05-14T16:10:21.642 INFO:tasks.ceph.osd.6.smithi062.stderr:2024-05-14T16:10:21.632+0000 7fb2cd976640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49967) UID: 0 2024-05-14T16:10:27.058 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~132s 2024-05-14T16:10:33.670 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~139s 2024-05-14T16:10:40.283 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~145s 2024-05-14T16:10:46.895 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~152s 2024-05-14T16:10:53.508 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~159s 2024-05-14T16:11:00.120 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~165s 2024-05-14T16:11:06.732 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~172s 2024-05-14T16:11:13.344 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~179s 2024-05-14T16:11:19.956 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~185s 2024-05-14T16:11:26.569 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~192s 2024-05-14T16:11:33.181 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~198s 2024-05-14T16:11:39.794 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~205s 2024-05-14T16:11:46.404 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~212s 2024-05-14T16:11:53.017 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~218s 2024-05-14T16:11:59.629 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~225s 2024-05-14T16:12:06.242 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~231s 2024-05-14T16:12:12.854 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~238s 2024-05-14T16:12:19.468 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~245s 2024-05-14T16:12:26.080 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~251s 2024-05-14T16:12:32.690 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~258s 2024-05-14T16:12:39.301 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~264s 2024-05-14T16:12:45.912 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~271s 2024-05-14T16:12:52.521 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~278s 2024-05-14T16:12:59.130 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~284s 2024-05-14T16:13:05.741 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~291s 2024-05-14T16:13:12.351 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~298s 2024-05-14T16:13:18.963 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~304s 2024-05-14T16:13:18.963 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2024-05-14T16:13:18.964 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T16:13:18.964 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T16:13:19.259 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T16:13:19.259 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T16:13:19.286 DEBUG:teuthology.orchestra.run.smithi039:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-14T16:13:20.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.231+0000 7fb7b22e2640 1 Processor -- start 2024-05-14T16:13:20.231 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.231+0000 7fb7b22e2640 1 -- start start 2024-05-14T16:13:20.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.233+0000 7fb7b22e2640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7ac0b0b60 0x7fb7ac164980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T16:13:20.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.234+0000 7fb7b22e2640 1 -- --> v1:172.21.15.39:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7ac0b10d0 con 0x7fb7ac06f2a0 2024-05-14T16:13:20.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.234+0000 7fb7b22e2640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7ac06c840 con 0x7fb7ac0ae930 2024-05-14T16:13:20.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.234+0000 7fb7b22e2640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fb7ac0b13b0 con 0x7fb7ac0b0b60 2024-05-14T16:13:20.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.234+0000 7fb7b087f640 1 --1- >> v1:172.21.15.39:6789/0 conn(0x7fb7ac06f2a0 0x7fb7ac06f6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.39:6789/0 says I am v1:172.21.15.39:47550/0 (socket says 172.21.15.39:47550) 2024-05-14T16:13:20.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.234+0000 7fb7b087f640 1 -- 172.21.15.39:0/420954422 learned_addr learned my addr 172.21.15.39:0/420954422 (peer_addr_for_me v1:172.21.15.39:0/0) 2024-05-14T16:13:20.234 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.234+0000 7fb7abfff640 1 --2- 172.21.15.39:0/420954422 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7ac0b0b60 0x7fb7ac164980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T16:13:20.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.234+0000 7fb7ab7fe640 1 -- 172.21.15.39:0/420954422 <== mon.0 v1:172.21.15.39:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 859153103 0 0) 0x7fb7ac0b10d0 con 0x7fb7ac06f2a0 2024-05-14T16:13:20.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.234+0000 7fb7ab7fe640 1 -- 172.21.15.39:0/420954422 --> v1:172.21.15.39:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb798003520 con 0x7fb7ac06f2a0 2024-05-14T16:13:20.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.234+0000 7fb7abfff640 1 -- 172.21.15.39:0/420954422 >> v1:172.21.15.62:6789/0 conn(0x7fb7ac0ae930 legacy=0x7fb7ac0d06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T16:13:20.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.234+0000 7fb7abfff640 1 -- 172.21.15.39:0/420954422 >> v1:172.21.15.39:6789/0 conn(0x7fb7ac06f2a0 legacy=0x7fb7ac06f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T16:13:20.235 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.234+0000 7fb7abfff640 1 -- 172.21.15.39:0/420954422 --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7ac06cb20 con 0x7fb7ac0b0b60 2024-05-14T16:13:20.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.236+0000 7fb7abfff640 1 --2- 172.21.15.39:0/420954422 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7ac0b0b60 0x7fb7ac164980 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb79c0097d0 tx=0x7fb79c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77e7b5c83b01e8b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T16:13:20.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.236+0000 7fb7ab7fe640 1 -- 172.21.15.39:0/420954422 <== mon.2 v2:172.21.15.62:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79c037070 con 0x7fb7ac0b0b60 2024-05-14T16:13:20.236 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.236+0000 7fb7ab7fe640 1 -- 172.21.15.39:0/420954422 <== mon.2 v2:172.21.15.62:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb79c032440 con 0x7fb7ac0b0b60 2024-05-14T16:13:20.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.237+0000 7fb7b22e2640 1 -- 172.21.15.39:0/420954422 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7ac0b0b60 msgr2=0x7fb7ac164980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T16:13:20.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.237+0000 7fb7ab7fe640 1 -- 172.21.15.39:0/420954422 <== mon.2 v2:172.21.15.62:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79c037070 con 0x7fb7ac0b0b60 2024-05-14T16:13:20.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.237+0000 7fb7b22e2640 1 --2- 172.21.15.39:0/420954422 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7ac0b0b60 0x7fb7ac164980 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb79c0097d0 tx=0x7fb79c02a210 comp rx=0 tx=0).stop 2024-05-14T16:13:20.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.237+0000 7fb7b22e2640 1 -- 172.21.15.39:0/420954422 shutdown_connections 2024-05-14T16:13:20.237 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.237+0000 7fb7b22e2640 1 --2- 172.21.15.39:0/420954422 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7ac0b0b60 0x7fb7ac164980 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T16:13:20.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.237+0000 7fb7b22e2640 1 -- 172.21.15.39:0/420954422 >> 172.21.15.39:0/420954422 conn(0x7fb7ac0ce330 msgr2=0x7fb7ac0ce740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T16:13:20.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.237+0000 7fb7b22e2640 1 -- 172.21.15.39:0/420954422 shutdown_connections 2024-05-14T16:13:20.238 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.237+0000 7fb7b22e2640 1 -- 172.21.15.39:0/420954422 wait complete. 2024-05-14T16:13:20.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.240+0000 7fb7b22e2640 1 Processor -- start 2024-05-14T16:13:20.240 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.240+0000 7fb7b22e2640 1 -- start start 2024-05-14T16:13:20.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.242+0000 7fb7b22e2640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7ac06f2a0 0x7fb7ac1fed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T16:13:20.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.242+0000 7fb7b22e2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7ac0ae930 0x7fb7ac153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T16:13:20.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.242+0000 7fb7b22e2640 1 --2- >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7ac0b0b60 0x7fb7ac1fe190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T16:13:20.243 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.242+0000 7fb7b22e2640 1 -- --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ac0aed40 con 0x7fb7ac06f2a0 2024-05-14T16:13:20.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.242+0000 7fb7b22e2640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 -- 0x7fb7ac0d0db0 con 0x7fb7ac0ae930 2024-05-14T16:13:20.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.242+0000 7fb7b22e2640 1 -- --> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] -- mon_getmap magic: 0 -- 0x7fb7ac06d320 con 0x7fb7ac0b0b60 2024-05-14T16:13:20.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.243+0000 7fb7abfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7ac06f2a0 0x7fb7ac1fed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T16:13:20.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.243+0000 7fb7abfff640 1 --2- >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7ac06f2a0 0x7fb7ac1fed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.39:3300/0 says I am v2:172.21.15.39:44050/0 (socket says 172.21.15.39:44050) 2024-05-14T16:13:20.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.243+0000 7fb7abfff640 1 -- 172.21.15.39:0/4099822588 learned_addr learned my addr 172.21.15.39:0/4099822588 (peer_addr_for_me v2:172.21.15.39:0/0) 2024-05-14T16:13:20.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.243+0000 7fb7b087f640 1 --2- 172.21.15.39:0/4099822588 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7ac0b0b60 0x7fb7ac1fe190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T16:13:20.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.243+0000 7fb7a37fe640 1 --2- 172.21.15.39:0/4099822588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7ac0ae930 0x7fb7ac153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T16:13:20.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.243+0000 7fb7abfff640 1 -- 172.21.15.39:0/4099822588 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7ac0b0b60 msgr2=0x7fb7ac1fe190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T16:13:20.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.243+0000 7fb7abfff640 1 --2- 172.21.15.39:0/4099822588 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7ac0b0b60 0x7fb7ac1fe190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T16:13:20.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.243+0000 7fb7abfff640 1 -- 172.21.15.39:0/4099822588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7ac0ae930 msgr2=0x7fb7ac153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T16:13:20.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.243+0000 7fb7abfff640 1 --2- 172.21.15.39:0/4099822588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7ac0ae930 0x7fb7ac153680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T16:13:20.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.243+0000 7fb7abfff640 1 -- 172.21.15.39:0/4099822588 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7ac1efc60 con 0x7fb7ac06f2a0 2024-05-14T16:13:20.244 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.243+0000 7fb7abfff640 1 --2- 172.21.15.39:0/4099822588 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7ac06f2a0 0x7fb7ac1fed30 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 crypto rx=0x7fb79c035040 tx=0x7fb79c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T16:13:20.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.248+0000 7fb7a97fa640 1 -- 172.21.15.39:0/4099822588 <== mon.0 v2:172.21.15.39:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79c037050 con 0x7fb7ac06f2a0 2024-05-14T16:13:20.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.248+0000 7fb7b22e2640 1 -- 172.21.15.39:0/4099822588 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7ac164e20 con 0x7fb7ac06f2a0 2024-05-14T16:13:20.248 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.248+0000 7fb7b22e2640 1 -- 172.21.15.39:0/4099822588 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7ac166980 con 0x7fb7ac06f2a0 2024-05-14T16:13:20.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.252+0000 7fb7a97fa640 1 -- 172.21.15.39:0/4099822588 <== mon.0 v2:172.21.15.39:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb79c043070 con 0x7fb7ac06f2a0 2024-05-14T16:13:20.252 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.253+0000 7fb7a97fa640 1 -- 172.21.15.39:0/4099822588 <== mon.0 v2:172.21.15.39:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79c037050 con 0x7fb7ac06f2a0 2024-05-14T16:13:20.253 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.253+0000 7fb7b22e2640 1 -- 172.21.15.39:0/4099822588 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7ac166be0 con 0x7fb7ac06f2a0 2024-05-14T16:13:20.264 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.264+0000 7fb7a97fa640 1 -- 172.21.15.39:0/4099822588 <== mon.0 v2:172.21.15.39:3300/0 4 ==== mgrmap(e 5) ==== 98201+0+0 (secure 0 0 0) 0x7fb79c03e450 con 0x7fb7ac06f2a0 2024-05-14T16:13:20.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.265+0000 7fb7a97fa640 1 --2- 172.21.15.39:0/4099822588 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fb78c0764d0 0x7fb78c0789e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T16:13:20.265 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.265+0000 7fb7a37fe640 1 --2- 172.21.15.39:0/4099822588 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fb78c0764d0 0x7fb78c0789e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T16:13:20.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.266+0000 7fb7a37fe640 1 --2- 172.21.15.39:0/4099822588 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fb78c0764d0 0x7fb78c0789e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb794000f60 tx=0x7fb794009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T16:13:20.266 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.266+0000 7fb7a97fa640 1 -- 172.21.15.39:0/4099822588 <== mon.0 v2:172.21.15.39:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6130+0+0 (secure 0 0 0) 0x7fb79c07dc00 con 0x7fb7ac06f2a0 2024-05-14T16:13:20.275 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.275+0000 7fb7a97fa640 1 -- 172.21.15.39:0/4099822588 <== mon.0 v2:172.21.15.39:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+190839 (secure 0 0 0) 0x7fb79c082070 con 0x7fb7ac06f2a0 2024-05-14T16:13:20.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.525+0000 7fb7b22e2640 1 -- 172.21.15.39:0/4099822588 --> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb7ac076aa0 con 0x7fb7ac06f2a0 2024-05-14T16:13:20.526 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.526+0000 7fb7a97fa640 1 -- 172.21.15.39:0/4099822588 <== mon.0 v2:172.21.15.39:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v40) ==== 80+0+0 (secure 0 0 0) 0x7fb79c081970 con 0x7fb7ac06f2a0 2024-05-14T16:13:20.526 INFO:teuthology.orchestra.run.smithi039.stderr:listed 0 entries 2024-05-14T16:13:20.528 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.528+0000 7fb7b22e2640 1 -- 172.21.15.39:0/4099822588 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fb78c0764d0 msgr2=0x7fb78c0789e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T16:13:20.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.528+0000 7fb7b22e2640 1 --2- 172.21.15.39:0/4099822588 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fb78c0764d0 0x7fb78c0789e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb794000f60 tx=0x7fb794009040 comp rx=0 tx=0).stop 2024-05-14T16:13:20.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.528+0000 7fb7b22e2640 1 -- 172.21.15.39:0/4099822588 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7ac06f2a0 msgr2=0x7fb7ac1fed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T16:13:20.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.528+0000 7fb7b22e2640 1 --2- 172.21.15.39:0/4099822588 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7ac06f2a0 0x7fb7ac1fed30 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 crypto rx=0x7fb79c035040 tx=0x7fb79c0046c0 comp rx=0 tx=0).stop 2024-05-14T16:13:20.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.528+0000 7fb7b22e2640 1 -- 172.21.15.39:0/4099822588 shutdown_connections 2024-05-14T16:13:20.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.528+0000 7fb7b22e2640 1 --2- 172.21.15.39:0/4099822588 >> [v2:172.21.15.39:6832/498853008,v1:172.21.15.39:6833/498853008] conn(0x7fb78c0764d0 0x7fb78c0789e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T16:13:20.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.528+0000 7fb7b22e2640 1 --2- 172.21.15.39:0/4099822588 >> [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] conn(0x7fb7ac0b0b60 0x7fb7ac1fe190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T16:13:20.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.528+0000 7fb7b22e2640 1 --2- 172.21.15.39:0/4099822588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb7ac0ae930 0x7fb7ac153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T16:13:20.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.528+0000 7fb7b22e2640 1 --2- 172.21.15.39:0/4099822588 >> [v2:172.21.15.39:3300/0,v1:172.21.15.39:6789/0] conn(0x7fb7ac06f2a0 0x7fb7ac1fed30 unknown :-1 s=CLOSED pgs=2137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T16:13:20.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.528+0000 7fb7b22e2640 1 -- 172.21.15.39:0/4099822588 >> 172.21.15.39:0/4099822588 conn(0x7fb7ac0ce330 msgr2=0x7fb7ac06dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T16:13:20.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.528+0000 7fb7b22e2640 1 -- 172.21.15.39:0/4099822588 shutdown_connections 2024-05-14T16:13:20.529 INFO:teuthology.orchestra.run.smithi039.stderr:2024-05-14T16:13:20.528+0000 7fb7b22e2640 1 -- 172.21.15.39:0/4099822588 wait complete. 2024-05-14T16:13:20.560 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-14T16:13:20.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T16:13:20.560 DEBUG:teuthology.orchestra.run.smithi039:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-05-14T16:13:20.596 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi039.front.sepia.ceph.com 2024-05-14T16:13:20.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T16:13:20.596 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-14T16:13:20.677 DEBUG:teuthology.orchestra.run.smithi039:> set -ex 2024-05-14T16:13:20.677 DEBUG:teuthology.orchestra.run.smithi039:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T16:13:20.735 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056332,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16893 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 172.21.15.39:6789:/test /tmp/tmp.kK5043bZVYtest ceph rw,context=system_u:object_r:root_t:s0,relatime,name=admin,secret=,fsid=d7983fec-79c7-4991-b19c-1aecead64611,acl 0 0 172.21.15.39:6789:/scratch /tmp/tmp.gzlHp5CthUscratch ceph rw,context=system_u:object_r:root_t:s0,relatime,name=admin,secret=,fsid=d7983fec-79c7-4991-b19c-1aecead64611,acl 0 0 2024-05-14T16:13:20.735 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi039.front.sepia.ceph.com 2024-05-14T16:13:20.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T16:13:20.735 DEBUG:teuthology.orchestra.run.smithi039:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-05-14T16:13:20.796 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T16:13:20.797 INFO:teuthology.orchestra.run.smithi039.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-05-14T16:13:20.797 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-14T16:13:20.797 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T16:13:20.840 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056334,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14564 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248840k,nr_inodes=812210,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-14T16:13:20.840 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi062.front.sepia.ceph.com 2024-05-14T16:13:20.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T16:13:20.840 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-14T16:13:20.918 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T16:13:20.919 INFO:teuthology.orchestra.run.smithi062.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-05-14T16:13:20.919 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-05-14T16:13:20.919 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T16:13:20.983 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056334,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14564 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248840k,nr_inodes=812210,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497680k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-05-14T16:13:20.984 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi062.front.sepia.ceph.com 2024-05-14T16:13:20.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T16:13:20.984 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-05-14T16:13:21.051 INFO:teuthology.orchestra.run.smithi062.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-05-14T16:13:21.052 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T16:13:22.662 INFO:tasks.ceph.osd.0:Sent signal 15 2024-05-14T16:13:22.663 INFO:tasks.ceph.osd.1:Sent signal 15 2024-05-14T16:13:22.663 INFO:tasks.ceph.osd.2:Sent signal 15 2024-05-14T16:13:22.663 INFO:tasks.ceph.osd.3:Sent signal 15 2024-05-14T16:13:22.663 INFO:tasks.ceph.osd.4:Sent signal 15 2024-05-14T16:13:22.663 INFO:tasks.ceph.osd.6:Sent signal 15 2024-05-14T16:13:22.663 INFO:tasks.ceph.osd.7:Sent signal 15 2024-05-14T16:13:22.664 INFO:tasks.ceph.mds.a:Sent signal 15 2024-05-14T16:13:22.664 INFO:tasks.ceph.mds.c:Sent signal 15 2024-05-14T16:13:22.664 INFO:tasks.ceph.mds.b:Sent signal 15 2024-05-14T16:13:22.664 INFO:tasks.ceph.mds.d:Sent signal 15 2024-05-14T16:13:22.664 INFO:tasks.ceph.mon.a:Sent signal 15 2024-05-14T16:13:22.665 INFO:tasks.ceph.mon.b:Sent signal 15 2024-05-14T16:13:22.665 INFO:tasks.ceph.mon.c:Sent signal 15 2024-05-14T16:13:22.665 INFO:tasks.ceph.mgr.y:Sent signal 15 2024-05-14T16:13:22.665 INFO:tasks.ceph.mgr.x:Sent signal 15 2024-05-14T16:13:22.666 INFO:tasks.ceph.osd.4.smithi062.stderr:2024-05-14T16:13:22.664+0000 7fe149cba640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 37238) UID: 0 2024-05-14T16:13:22.666 INFO:tasks.ceph.osd.4.smithi062.stderr:2024-05-14T16:13:22.664+0000 7fe149cba640 -1 osd.4 40 *** Got signal Terminated *** 2024-05-14T16:13:22.666 INFO:tasks.ceph.osd.4.smithi062.stderr:2024-05-14T16:13:22.664+0000 7fe149cba640 -1 osd.4 40 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T16:13:22.666 INFO:tasks.ceph.osd.7.smithi062.stderr:2024-05-14T16:13:22.664+0000 7fb173614640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 37247) UID: 0 2024-05-14T16:13:22.666 INFO:tasks.ceph.osd.7.smithi062.stderr:2024-05-14T16:13:22.664+0000 7fb173614640 -1 osd.7 40 *** Got signal Terminated *** 2024-05-14T16:13:22.667 INFO:tasks.ceph.osd.7.smithi062.stderr:2024-05-14T16:13:22.664+0000 7fb173614640 -1 osd.7 40 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T16:13:22.667 INFO:tasks.ceph.mds.b.smithi062.stderr:2024-05-14T16:13:22.665+0000 7fcc26b22640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 44271) UID: 0 2024-05-14T16:13:22.667 INFO:tasks.ceph.mds.b.smithi062.stderr:2024-05-14T16:13:22.665+0000 7fcc26b22640 -1 mds.b *** got signal Terminated *** 2024-05-14T16:13:22.667 INFO:tasks.ceph.mds.d.smithi062.stderr:2024-05-14T16:13:22.665+0000 7fbd5811b640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i d (PID: 44270) UID: 0 2024-05-14T16:13:22.667 INFO:tasks.ceph.mds.d.smithi062.stderr:2024-05-14T16:13:22.665+0000 7fbd5811b640 -1 mds.d *** got signal Terminated *** 2024-05-14T16:13:22.668 INFO:tasks.ceph.mon.b.smithi062.stderr:2024-05-14T16:13:22.666+0000 7fc34312a640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 36659) UID: 0 2024-05-14T16:13:22.668 INFO:tasks.ceph.mon.b.smithi062.stderr:2024-05-14T16:13:22.666+0000 7fc34312a640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2024-05-14T16:13:22.668 INFO:tasks.ceph.mon.c.smithi062.stderr:2024-05-14T16:13:22.666+0000 7f616e6b1640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 36662) UID: 0 2024-05-14T16:13:22.668 INFO:tasks.ceph.mon.c.smithi062.stderr:2024-05-14T16:13:22.666+0000 7f616e6b1640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2024-05-14T16:13:22.668 INFO:tasks.ceph.osd.6.smithi062.stderr:2024-05-14T16:13:22.664+0000 7fb2cd976640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 37244) UID: 0 2024-05-14T16:13:22.669 INFO:tasks.ceph.osd.6.smithi062.stderr:2024-05-14T16:13:22.664+0000 7fb2cd976640 -1 osd.6 40 *** Got signal Terminated *** 2024-05-14T16:13:22.669 INFO:tasks.ceph.osd.6.smithi062.stderr:2024-05-14T16:13:22.664+0000 7fb2cd976640 -1 osd.6 40 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T16:13:22.669 INFO:tasks.ceph.osd.0.smithi039.stderr:2024-05-14T16:13:22.663+0000 7f65b0fad640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 37028) UID: 0 2024-05-14T16:13:22.669 INFO:tasks.ceph.osd.0.smithi039.stderr:2024-05-14T16:13:22.663+0000 7f65b0fad640 -1 osd.0 40 *** Got signal Terminated *** 2024-05-14T16:13:22.669 INFO:tasks.ceph.osd.0.smithi039.stderr:2024-05-14T16:13:22.663+0000 7f65b0fad640 -1 osd.0 40 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T16:13:22.670 INFO:tasks.ceph.osd.1.smithi039.stderr:2024-05-14T16:13:22.667+0000 7fcb29227640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 37032) UID: 0 2024-05-14T16:13:22.670 INFO:tasks.ceph.osd.1.smithi039.stderr:2024-05-14T16:13:22.667+0000 7fcb29227640 -1 osd.1 40 *** Got signal Terminated *** 2024-05-14T16:13:22.670 INFO:tasks.ceph.osd.1.smithi039.stderr:2024-05-14T16:13:22.667+0000 7fcb29227640 -1 osd.1 40 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T16:13:22.670 INFO:tasks.ceph.mon.a.smithi039.stderr:2024-05-14T16:13:22.669+0000 7fbdf8518640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 36747) UID: 0 2024-05-14T16:13:22.677 INFO:tasks.ceph.osd.2.smithi039.stderr:2024-05-14T16:13:22.669+0000 7f2810f95640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 37043) UID: 0 2024-05-14T16:13:22.677 INFO:tasks.ceph.osd.2.smithi039.stderr:2024-05-14T16:13:22.674+0000 7f2810f95640 -1 osd.2 40 *** Got signal Terminated *** 2024-05-14T16:13:22.678 INFO:tasks.ceph.osd.2.smithi039.stderr:2024-05-14T16:13:22.674+0000 7f2810f95640 -1 osd.2 40 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T16:13:22.678 INFO:tasks.ceph.osd.3.smithi039.stderr:2024-05-14T16:13:22.669+0000 7ff86254c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 37042) UID: 0 2024-05-14T16:13:22.678 INFO:tasks.ceph.osd.3.smithi039.stderr:2024-05-14T16:13:22.669+0000 7ff86254c640 -1 osd.3 40 *** Got signal Terminated *** 2024-05-14T16:13:22.678 INFO:tasks.ceph.osd.3.smithi039.stderr:2024-05-14T16:13:22.669+0000 7ff86254c640 -1 osd.3 40 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T16:13:22.716 INFO:tasks.ceph.mon.a.smithi039.stderr:2024-05-14T16:13:22.716+0000 7fbdf2d0d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-14T16:13:22.747 INFO:tasks.ceph.mon.a.smithi039.stderr:2024-05-14T16:13:22.746+0000 7fbdf8518640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-05-14T16:13:22.756 INFO:tasks.ceph.mds.a.smithi039.stderr:2024-05-14T16:13:22.737+0000 7efc627aa640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 48969) UID: 0 2024-05-14T16:13:22.757 INFO:tasks.ceph.mds.c.smithi039.stderr:2024-05-14T16:13:22.737+0000 7fabc8517640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i c (PID: 48968) UID: 0 2024-05-14T16:13:22.757 INFO:tasks.ceph.mds.a.smithi039.stderr:2024-05-14T16:13:22.757+0000 7efc627aa640 -1 mds.a *** got signal Terminated *** 2024-05-14T16:13:22.757 INFO:tasks.ceph.mds.c.smithi039.stderr:2024-05-14T16:13:22.757+0000 7fabc8517640 -1 mds.c *** got signal Terminated *** 2024-05-14T16:13:22.871 INFO:tasks.ceph.mgr.x.smithi062.stderr:daemon-helper: command crashed with signal 15 2024-05-14T16:15:31.013 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:15:31.017 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:15:31.082 INFO:teuthology.orchestra.run.smithi039.stderr:ceph-osd: no process found 2024-05-14T16:18:24.291 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:18:24.295 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:18:54.362 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:18:54.366 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:19:24.449 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:19:24.453 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:19:54.513 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:19:54.517 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:20:24.585 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:20:24.589 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:20:54.658 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:20:54.661 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:21:24.721 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:21:24.725 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:21:54.784 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:21:54.788 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:22:24.873 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:22:24.876 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:22:54.937 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:22:54.940 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:23:25.025 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:23:25.029 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:23:55.090 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:23:55.094 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:24:25.161 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:24:25.164 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:24:55.225 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:24:55.228 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:25:25.296 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:25:25.299 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:25:55.510 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:25:55.514 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:26:25.582 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:26:25.586 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:26:55.654 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:26:55.658 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:27:25.718 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:27:25.721 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:27:55.780 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:27:55.784 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:28:25.869 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:28:25.873 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:28:55.933 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:28:55.937 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:29:25.997 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:29:26.000 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:29:56.070 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:29:56.073 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:30:26.141 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:30:26.145 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:30:56.228 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:30:56.232 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:31:26.322 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:31:26.326 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:31:56.397 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:31:56.401 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:32:26.469 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:32:26.473 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:32:56.542 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:32:56.545 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:33:26.621 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:33:26.625 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:33:56.693 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:33:56.696 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:34:26.765 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:34:26.769 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:34:56.846 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:34:56.849 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:35:26.917 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:35:26.920 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:35:56.996 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:35:57.001 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:36:27.069 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:36:27.072 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:36:57.249 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:36:57.253 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:37:27.330 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:37:27.335 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:37:57.411 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:37:57.414 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:38:27.498 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:38:27.502 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:38:57.562 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:38:57.565 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:39:27.625 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:39:27.629 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:39:57.688 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:39:57.692 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:40:27.760 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:40:27.764 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:40:57.966 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:40:57.969 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:41:28.037 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:41:28.041 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:41:58.113 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:41:58.116 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:42:28.181 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:42:28.184 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:42:58.252 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:42:58.255 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:43:28.317 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:43:28.320 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:43:58.387 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:43:58.391 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:44:28.459 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:44:28.462 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:44:58.533 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:44:58.536 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:45:28.603 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:45:28.607 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:45:58.666 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:45:58.670 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:46:28.739 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:46:28.742 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:46:58.804 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:46:58.807 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:47:28.876 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:47:28.879 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:47:58.948 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:47:58.952 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:48:29.012 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:48:29.016 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:48:59.075 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:48:59.078 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:49:29.147 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:49:29.150 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:49:59.210 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:49:59.214 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:50:29.291 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:50:29.295 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:50:59.362 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:50:59.366 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:51:29.432 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:51:29.435 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:51:59.506 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:51:59.510 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:52:29.570 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:52:29.574 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:52:59.634 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:52:59.637 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:53:29.713 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:53:29.717 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:53:59.782 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:53:59.785 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:54:29.850 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:54:29.853 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:54:59.924 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:54:59.928 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:55:29.997 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:55:30.000 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:56:00.090 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:56:00.093 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:56:30.162 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:56:30.165 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:57:00.229 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:57:00.233 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:57:30.297 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:57:30.300 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:58:00.364 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:58:00.368 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:58:30.437 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:58:30.441 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:59:00.500 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:59:00.503 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:59:30.568 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T16:59:30.572 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:00:00.635 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:00:00.639 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:00:30.703 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:00:30.708 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:01:00.775 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:01:00.779 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:01:30.839 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:01:30.843 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:02:00.911 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:02:00.914 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:02:30.987 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:02:30.990 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:03:01.064 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:03:01.068 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:03:31.119 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:03:31.123 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:04:01.194 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:04:01.197 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:04:31.270 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:04:31.274 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:05:01.337 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:05:01.340 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:05:31.401 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:05:31.406 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:06:01.470 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:06:01.474 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:06:31.545 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:06:31.548 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:07:01.616 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:07:01.620 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:07:31.702 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:07:31.705 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:08:01.768 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:08:01.772 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:08:31.837 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:08:31.841 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:09:01.917 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:09:01.921 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:09:31.992 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:09:31.995 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:10:02.063 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:10:02.067 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:10:32.136 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:10:32.139 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:11:02.205 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:11:02.209 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:11:32.277 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:11:32.281 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:12:02.481 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:12:02.485 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:12:32.548 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:12:32.552 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:13:02.645 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:13:02.648 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:13:32.713 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:13:32.717 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:14:02.787 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:14:02.791 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:14:32.857 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:14:32.860 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:15:02.954 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:15:02.958 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:15:33.045 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:15:33.049 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:16:03.116 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:16:03.120 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:16:33.180 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:16:33.184 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:17:03.253 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:17:03.256 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:17:33.323 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:17:33.326 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:18:03.396 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:18:03.400 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:18:33.469 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:18:33.472 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:19:03.539 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:19:03.543 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:19:33.602 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:19:33.606 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:20:03.675 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:20:03.678 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:20:33.774 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:20:33.778 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:21:03.844 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:21:03.848 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:21:33.936 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:21:33.940 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:22:04.001 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:22:04.005 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:22:34.075 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:22:34.078 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:23:04.156 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:23:04.160 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:23:34.218 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:23:34.221 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:24:04.391 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:24:04.394 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:24:34.461 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:24:34.464 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:25:04.526 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:25:04.530 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:25:34.723 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:25:34.726 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:26:04.795 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:26:04.798 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:26:34.865 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:26:34.868 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:27:04.938 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:27:04.941 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:27:35.017 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:27:35.021 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:28:05.090 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:28:05.094 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:28:35.163 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:28:35.166 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:29:05.234 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:29:05.237 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:29:35.305 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:29:35.308 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:30:05.377 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:30:05.381 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:30:35.457 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:30:35.461 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:31:05.646 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:31:05.649 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:31:35.719 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:31:35.723 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:32:05.798 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:32:05.804 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:32:35.870 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:32:35.874 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:33:05.933 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:33:05.937 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:33:36.023 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:33:36.026 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:34:06.092 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:34:06.096 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:34:36.165 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:34:36.169 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:35:06.237 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:35:06.241 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:35:36.307 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:35:36.311 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:36:06.381 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:36:06.384 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:36:36.501 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:36:36.504 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:37:06.574 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:37:06.579 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:37:36.646 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:37:36.651 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:38:06.718 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:38:06.722 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:38:36.790 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:38:36.795 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:39:06.871 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:39:06.874 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:39:36.942 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:39:36.946 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:40:07.014 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:40:07.019 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:40:37.085 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:40:37.089 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:41:07.158 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:41:07.162 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:41:37.220 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:41:37.224 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:42:07.293 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:42:07.297 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:42:37.366 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:42:37.370 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:43:07.438 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:43:07.442 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:43:37.509 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:43:37.512 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:44:07.581 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:44:07.585 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:44:37.679 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:44:37.682 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:45:07.750 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:45:07.753 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:45:37.820 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:45:37.823 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:46:07.918 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:46:07.922 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:46:37.990 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:46:37.994 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:47:08.096 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:47:08.100 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:47:38.168 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:47:38.171 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:48:08.240 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:48:08.248 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:48:38.303 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:48:38.307 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:49:08.391 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:49:08.395 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:49:38.479 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:49:38.483 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:50:08.552 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:50:08.556 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:50:38.624 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:50:38.628 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:51:08.695 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:51:08.699 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:51:38.767 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:51:38.770 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:52:08.860 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:52:08.863 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:52:38.927 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:52:38.930 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:53:09.000 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:53:09.002 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:53:39.069 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:53:39.072 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:54:09.141 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:54:09.144 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:54:39.204 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:54:39.208 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:55:09.276 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:55:09.280 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:55:39.348 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:55:39.351 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:56:09.420 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:56:09.423 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:56:39.494 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:56:39.497 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:57:09.572 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:57:09.575 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:57:39.643 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:57:39.647 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:58:09.717 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:58:09.721 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:58:39.789 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:58:39.793 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:59:09.858 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:59:09.862 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:59:39.933 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T17:59:39.937 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:00:10.005 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:00:10.008 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:00:40.074 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:00:40.077 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:01:10.150 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:01:10.153 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:01:40.221 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:01:40.225 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:02:10.289 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:02:10.293 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:02:40.394 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:02:40.398 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:03:10.471 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:03:10.475 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:03:40.543 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:03:40.546 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:04:10.615 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:04:10.620 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:04:40.686 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:04:40.690 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:05:10.778 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:05:10.782 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:05:40.850 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:05:40.853 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:06:10.922 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:06:10.926 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:06:40.993 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:06:40.997 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:07:11.080 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:07:11.084 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:07:41.162 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:07:41.165 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:08:11.234 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:08:11.238 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:08:41.305 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:08:41.309 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:09:11.376 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:09:11.380 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:09:41.548 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:09:41.552 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:10:11.637 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:10:11.640 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:10:41.708 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:10:41.712 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:11:11.780 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:11:11.783 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:11:41.871 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:11:41.887 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:12:11.972 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:12:11.976 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:12:42.054 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:12:42.057 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:13:12.267 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:13:12.272 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:13:42.332 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:13:42.336 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:14:12.412 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:14:12.416 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:14:42.482 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:14:42.485 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:15:12.581 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:15:12.584 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:15:42.651 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:15:42.655 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:16:12.725 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:16:12.728 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:16:42.788 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:16:42.791 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:17:12.868 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:17:12.872 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:17:42.940 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:17:42.943 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:18:13.011 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:18:13.015 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:18:43.083 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:18:43.087 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:19:13.155 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:19:13.159 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:19:43.220 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:19:43.223 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:20:13.315 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:20:13.319 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:20:43.388 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:20:43.392 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:21:13.460 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:21:13.463 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:21:43.557 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:21:43.561 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:22:13.635 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:22:13.639 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:22:43.700 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:22:43.704 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:23:13.787 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:23:13.790 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:23:43.860 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:23:43.864 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:24:13.939 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:24:13.942 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:24:44.012 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:24:44.015 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:25:14.082 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:25:14.086 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:25:44.164 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:25:44.168 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:26:14.236 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:26:14.240 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:26:44.300 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:26:44.303 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:27:14.372 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:27:14.375 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:27:44.444 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:27:44.449 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:28:14.521 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:28:14.525 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:28:44.604 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:28:44.607 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:29:14.676 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:29:14.680 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:29:44.746 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:29:44.750 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:30:14.817 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:30:14.821 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:30:44.903 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:30:44.906 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:31:14.977 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:31:14.980 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:31:45.054 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:31:45.058 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:32:15.127 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:32:15.131 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:32:45.198 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:32:45.201 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:33:15.273 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:33:15.277 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:33:45.353 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:33:45.356 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:34:15.421 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:34:15.425 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:34:45.488 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:34:45.492 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:35:15.551 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:35:15.555 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:35:45.621 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:35:45.625 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:36:15.686 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:36:15.692 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:36:45.758 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:36:45.762 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:37:15.830 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:37:15.834 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:37:45.899 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:37:45.903 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:38:15.974 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:38:15.978 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:38:46.046 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:38:46.050 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:39:16.117 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:39:16.121 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:39:46.213 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:39:46.217 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:40:16.285 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:40:16.289 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:40:46.357 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:40:46.361 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:41:16.445 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:41:16.449 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:41:46.517 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:41:46.521 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:42:16.597 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:42:16.601 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:42:46.669 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:42:46.673 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:43:16.740 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:43:16.744 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:43:46.813 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:43:46.816 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:44:16.909 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:44:16.913 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:44:46.973 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:44:46.976 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:45:17.045 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:45:17.049 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:45:47.116 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:45:47.120 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:46:17.189 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:46:17.193 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:46:47.261 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:46:47.264 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:47:17.357 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:47:17.361 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:47:47.429 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:47:47.432 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:48:17.501 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:48:17.504 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:48:47.572 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:48:47.575 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:49:17.645 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:49:17.649 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:49:47.716 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:49:47.719 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:50:17.787 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:50:17.791 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:50:47.860 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:50:47.864 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:51:17.933 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:51:17.937 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:51:48.013 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:51:48.017 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:52:18.099 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:52:18.103 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:52:48.165 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:52:48.168 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:53:18.234 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:53:18.238 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:53:48.306 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:53:48.310 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:54:18.389 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:54:18.393 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:54:48.483 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:54:48.487 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:55:18.565 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:55:18.568 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:55:48.636 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:55:48.640 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:56:18.708 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:56:18.712 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:56:48.771 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:56:48.775 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:57:18.852 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:57:18.856 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:57:48.915 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:57:48.919 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:58:18.986 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:58:18.989 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:58:49.185 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:58:49.191 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:59:19.264 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:59:19.268 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:59:49.358 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T18:59:49.362 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:00:19.431 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:00:19.435 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:00:49.505 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:00:49.508 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:01:19.582 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:01:19.586 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:01:49.655 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:01:49.660 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:02:19.846 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:02:19.851 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:02:49.929 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:02:49.934 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:03:20.111 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:03:20.114 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:03:50.170 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:03:50.174 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:04:20.246 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:04:20.250 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:04:50.368 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:04:50.374 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:05:20.448 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:05:20.453 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:05:50.520 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:05:50.524 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:06:20.591 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:06:20.595 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:06:50.663 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:06:50.667 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:07:20.760 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:07:20.764 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:07:50.831 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:07:50.835 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:08:20.909 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:08:20.913 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:08:51.008 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:08:51.012 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:09:21.080 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:09:21.087 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:09:51.160 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:09:51.164 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:10:21.237 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:10:21.242 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:10:51.301 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:10:51.305 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:11:21.375 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:11:21.379 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:11:51.446 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:11:51.450 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:12:21.518 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:12:21.522 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:12:51.587 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:12:51.590 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:13:21.668 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:13:21.672 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:13:51.739 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:13:51.743 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:14:21.813 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:14:21.817 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:14:51.883 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:14:51.886 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:15:22.071 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:15:22.075 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:15:52.144 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:15:52.148 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:16:22.215 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:16:22.218 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:16:52.279 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:16:52.283 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:17:22.344 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:17:22.347 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:17:52.415 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:17:52.418 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:18:22.511 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:18:22.515 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:18:52.692 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:18:52.695 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:19:22.764 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:19:22.767 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:19:52.835 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:19:52.839 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:20:22.906 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:20:22.909 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:20:52.970 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:20:52.974 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:21:23.067 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:21:23.071 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:21:53.131 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:21:53.135 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:22:23.202 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:22:23.206 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:22:53.274 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:22:53.279 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:23:23.346 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:23:23.350 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:23:53.417 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:23:53.421 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:24:23.549 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:24:23.553 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:24:53.738 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:24:53.742 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:25:23.819 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:25:23.823 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:25:53.891 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:25:53.895 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:26:23.955 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:26:23.959 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:26:54.018 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:26:54.022 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:27:24.090 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:27:24.095 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:27:54.162 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:27:54.166 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:28:24.239 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:28:24.243 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:28:54.302 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:28:54.305 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:29:24.378 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:29:24.382 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:29:54.445 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:29:54.449 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:30:24.517 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:30:24.521 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:30:54.586 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:30:54.592 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:31:24.658 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:31:24.662 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:31:54.730 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:31:54.735 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:32:24.803 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:32:24.807 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:32:54.868 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:32:54.871 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:33:24.940 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:33:24.944 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:33:55.003 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:33:55.007 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:34:25.075 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:34:25.078 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:34:55.146 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:34:55.151 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:35:25.225 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:35:25.229 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:35:55.333 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:35:55.336 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:36:25.403 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:36:25.407 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:36:55.492 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:36:55.496 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:37:25.573 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:37:25.576 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:37:55.636 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:37:55.640 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:38:25.712 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:38:25.716 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:38:55.777 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:38:55.781 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:39:25.853 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:39:25.857 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:39:55.950 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:39:55.953 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:40:26.034 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:40:26.038 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:40:56.097 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:40:56.101 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:41:26.166 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:41:26.170 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:41:56.251 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:41:56.254 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:42:26.322 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:42:26.326 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:42:56.406 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:42:56.410 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:43:26.478 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:43:26.481 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:43:56.538 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:43:56.542 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:44:26.626 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:44:26.629 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:44:56.694 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:44:56.697 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:45:26.766 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:45:26.770 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:45:56.863 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:45:56.867 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:46:26.952 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:46:26.955 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:46:57.029 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:46:57.032 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:47:27.104 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:47:27.107 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:47:57.173 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:47:57.176 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:48:27.246 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:48:27.250 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:48:57.319 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:48:57.322 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:49:27.414 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:49:27.417 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:49:57.479 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:49:57.483 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:50:27.556 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:50:27.560 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:50:57.629 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:50:57.632 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:51:27.695 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:51:27.698 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:51:57.781 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:51:57.785 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:52:27.855 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:52:27.858 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:52:57.926 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:52:57.930 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:53:28.005 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:53:28.009 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:53:58.079 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:53:58.082 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:54:28.173 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:54:28.177 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:54:58.237 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:54:58.240 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:55:28.328 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:55:28.332 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:55:58.398 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:55:58.401 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:56:28.471 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:56:28.475 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:56:58.557 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:56:58.561 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:57:28.746 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:57:28.750 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:57:58.820 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:57:58.825 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:58:28.909 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:58:28.913 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:58:58.980 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:58:58.984 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:59:29.075 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:59:29.079 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:59:59.147 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T19:59:59.150 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:00:29.221 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:00:29.225 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:00:59.291 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:00:59.298 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:01:29.381 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:01:29.385 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:01:59.446 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:01:59.450 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:02:29.524 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:02:29.527 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:02:59.598 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:02:59.601 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:03:29.668 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:03:29.671 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:03:59.739 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:03:59.743 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:04:29.813 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:04:29.817 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:04:59.885 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:04:59.889 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:05:29.957 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:05:29.961 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:06:00.029 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:06:00.032 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:06:30.101 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:06:30.105 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:07:00.163 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:07:00.166 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:07:30.234 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:07:30.238 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:08:00.301 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:08:00.305 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:08:30.495 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:08:30.498 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:09:00.566 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:09:00.570 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:09:30.640 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:09:30.643 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:10:00.711 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:10:00.714 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:10:30.783 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:10:30.787 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:11:00.854 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:11:00.858 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:11:30.919 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:11:30.922 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:12:00.991 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:12:00.998 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:12:31.065 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:12:31.069 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:13:01.136 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:13:01.139 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:13:31.207 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:13:31.211 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:14:01.296 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:14:01.299 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:14:31.375 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:14:31.383 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:15:01.450 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:15:01.454 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:15:31.528 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:15:31.532 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:16:01.601 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:16:01.604 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:16:31.672 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:16:31.676 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:17:01.761 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:17:01.764 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:17:31.832 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:17:31.836 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:18:01.896 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:18:01.899 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:18:31.968 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:18:31.972 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:19:02.047 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:19:02.050 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:19:32.119 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:19:32.123 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:20:02.184 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:20:02.187 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:20:32.255 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:20:32.258 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:21:02.327 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:21:02.331 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:21:32.398 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:21:32.401 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:22:02.470 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:22:02.474 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:22:32.542 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:22:32.546 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:23:02.606 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:23:02.609 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:23:32.719 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:23:32.722 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:24:02.783 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:24:02.786 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:24:32.855 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:24:32.859 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:25:02.927 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:25:02.931 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:25:32.999 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:25:33.003 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:26:03.069 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:26:03.073 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:26:33.150 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:26:33.154 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:27:03.215 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:27:03.218 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:27:33.287 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:27:33.292 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:28:03.356 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:28:03.360 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:28:33.504 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:28:33.508 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:29:03.583 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:29:03.587 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:29:33.680 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:29:33.683 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:30:03.753 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:30:03.757 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:30:33.832 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:30:33.836 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:31:03.905 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:31:03.909 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:31:34.002 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:31:34.006 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:32:04.073 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:32:04.076 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:32:34.169 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:32:34.172 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:33:04.243 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:33:04.247 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:33:34.340 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:33:34.345 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:34:04.420 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:34:04.424 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:34:34.499 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:34:34.503 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:35:04.572 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:35:04.578 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:35:34.660 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:35:34.665 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:36:04.757 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:36:04.761 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:36:34.820 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:36:34.824 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:37:04.884 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:37:04.888 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:37:34.956 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:37:34.959 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:38:05.028 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:38:05.032 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:38:35.124 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:38:35.128 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:39:05.197 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:39:05.200 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:39:35.267 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:39:35.271 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:40:05.347 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:40:05.351 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:40:35.420 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:40:35.425 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:41:05.493 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:41:05.497 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:41:35.680 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:41:35.683 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:42:05.753 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:42:05.757 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:42:35.817 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:42:35.820 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:43:05.886 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:43:05.890 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:43:35.953 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:43:35.957 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:44:06.042 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:44:06.046 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:44:36.105 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:44:36.109 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:45:06.182 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:45:06.186 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:45:36.257 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:45:36.261 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:46:06.329 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:46:06.333 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:46:36.402 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:46:36.405 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:47:06.470 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:47:06.474 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:47:36.554 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:47:36.557 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:48:06.630 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:48:06.634 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:48:36.706 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:48:36.710 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:49:06.779 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:49:06.782 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:49:36.853 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:49:36.857 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:50:06.953 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:50:06.956 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:50:37.029 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:50:37.034 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:51:07.094 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:51:07.098 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:51:37.165 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:51:37.169 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:52:07.237 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:52:07.240 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:52:37.307 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:52:37.311 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:53:07.381 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:53:07.385 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:53:37.452 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:53:37.455 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:54:07.525 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:54:07.528 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:54:37.595 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:54:37.599 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:55:07.709 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:55:07.713 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:55:37.781 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:55:37.784 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:56:07.854 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:56:07.858 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:56:37.934 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:56:37.938 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:57:08.005 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:57:08.008 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:57:38.078 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:57:38.083 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:58:08.150 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:58:08.154 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:58:38.220 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:58:38.224 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:59:08.292 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:59:08.296 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:59:38.383 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T20:59:38.386 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:00:08.451 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:00:08.455 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:00:38.528 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:00:38.532 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:01:08.604 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:01:08.607 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:01:38.680 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:01:38.683 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:02:08.757 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:02:08.760 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:02:38.849 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:02:38.852 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:03:08.921 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:03:08.925 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:03:38.988 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:03:38.992 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:04:09.061 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:04:09.064 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:04:39.138 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:04:39.141 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:05:09.212 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:05:09.216 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:05:39.284 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:05:39.289 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:06:09.358 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:06:09.362 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:06:39.428 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:06:39.432 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:07:09.500 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:07:09.504 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:07:39.578 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:07:39.581 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:08:09.649 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:08:09.653 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:08:39.721 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:08:39.724 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:09:09.795 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:09:09.799 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:09:39.868 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:09:39.872 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:10:09.948 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:10:09.951 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:10:40.019 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:10:40.023 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:11:10.090 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:11:10.094 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:11:40.163 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:11:40.167 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:12:10.243 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:12:10.247 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:12:40.316 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:12:40.320 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:13:10.403 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:13:10.408 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:13:40.483 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:13:40.487 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:14:10.555 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:14:10.559 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:14:40.629 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:14:40.633 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:15:10.834 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:15:10.838 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:15:40.920 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:15:40.924 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:16:10.992 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:16:10.996 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:16:41.183 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:16:41.186 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:17:11.255 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:17:11.259 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:17:41.340 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:17:41.343 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:18:11.432 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:18:11.435 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:18:41.505 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:18:41.509 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:19:11.581 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:19:11.584 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:19:41.657 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:19:41.661 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:20:11.838 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:20:11.842 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:20:41.921 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:20:41.925 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:21:12.015 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:21:12.018 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:21:42.081 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:21:42.085 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:22:12.154 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:22:12.158 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:22:42.225 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:22:42.229 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:23:12.313 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:23:12.319 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:23:42.394 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:23:42.397 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:24:12.466 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:24:12.470 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:24:42.535 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:24:42.538 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:25:12.609 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:25:12.613 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:25:42.699 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:25:42.702 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:26:12.770 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:26:12.773 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:26:42.839 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:26:42.842 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:27:12.915 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:27:12.918 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:27:42.984 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:27:42.987 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:28:13.057 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:28:13.061 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:28:43.129 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:28:43.133 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:29:13.202 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:29:13.205 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:29:43.305 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:29:43.308 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:30:13.379 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:30:13.382 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:30:43.482 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:30:43.486 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:31:13.547 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:31:13.550 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:31:43.618 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:31:43.622 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:32:13.690 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:32:13.693 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:32:43.770 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:32:43.774 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:33:13.977 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:33:13.981 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:33:44.181 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:33:44.185 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:34:14.253 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:34:14.258 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:34:44.326 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:34:44.330 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:35:14.397 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:35:14.401 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:35:44.485 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:35:44.488 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:36:14.558 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:36:14.562 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:36:44.654 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:36:44.658 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:37:14.727 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:37:14.731 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:37:44.798 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:37:44.801 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:38:14.865 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:38:14.869 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:38:44.941 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:38:44.944 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:39:15.014 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:39:15.018 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:39:45.086 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:39:45.090 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:40:15.159 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:40:15.162 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:40:45.230 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:40:45.233 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:41:15.303 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:41:15.307 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:41:45.365 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:41:45.369 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:42:15.437 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:42:15.441 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:42:45.517 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:42:45.521 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:43:15.589 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:43:15.593 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:43:45.661 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:43:45.665 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:44:15.732 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:44:15.736 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:44:45.805 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:44:45.808 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:45:15.869 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:45:15.872 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:45:45.940 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:45:45.944 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:46:16.011 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:46:16.015 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:46:46.084 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:46:46.087 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:47:16.156 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:47:16.159 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:47:46.227 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:47:46.231 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:48:16.300 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:48:16.303 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:48:46.379 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:48:46.382 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:49:16.569 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:49:16.573 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:49:46.639 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:49:46.643 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:50:16.712 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:50:16.715 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:50:46.785 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:50:46.788 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:51:16.856 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:51:16.859 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:51:46.928 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:51:46.931 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:52:17.016 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:52:17.019 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:52:47.089 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:52:47.093 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:53:17.160 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:53:17.163 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:53:47.232 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:53:47.236 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:54:17.304 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:54:17.308 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:54:47.376 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:54:47.380 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:55:17.455 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:55:17.458 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:55:47.528 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:55:47.532 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:56:17.601 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:56:17.604 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:56:47.672 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:56:47.675 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:57:17.736 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:57:17.739 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:57:47.915 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:57:47.919 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:58:17.995 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:58:17.999 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:58:48.067 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:58:48.070 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:59:18.139 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:59:18.142 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:59:48.211 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T21:59:48.215 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:00:18.283 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:00:18.286 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:00:48.355 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:00:48.358 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:01:18.433 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:01:18.438 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:01:48.508 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:01:48.512 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:02:18.585 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:02:18.591 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:02:48.669 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:02:48.673 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:03:18.745 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:03:18.748 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:03:48.821 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:03:48.824 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:04:18.896 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:04:18.900 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:04:48.964 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:04:48.967 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:05:19.064 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:05:19.068 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:05:49.128 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:05:49.131 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:06:19.199 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:06:19.203 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:06:49.276 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:06:49.279 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:07:19.351 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:07:19.354 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:07:49.431 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:07:49.434 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:08:19.502 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:08:19.506 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:08:49.572 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:08:49.575 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:09:19.645 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:09:19.649 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:09:49.709 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:09:49.713 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:10:19.805 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:10:19.808 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:10:49.901 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:10:49.904 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:11:19.982 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:11:19.985 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:11:50.046 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:11:50.050 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:12:20.125 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:12:20.128 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:12:50.205 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:12:50.209 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:13:20.276 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:13:20.280 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:13:50.382 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:13:50.387 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:14:20.453 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:14:20.456 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:14:50.518 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:14:50.522 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:15:20.604 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:15:20.608 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:15:50.679 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:15:50.683 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:16:20.756 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:16:20.759 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:16:50.930 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:16:50.934 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:17:20.998 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:17:21.002 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:17:51.124 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:17:51.128 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:18:21.192 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:18:21.195 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:18:51.269 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:18:51.272 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:19:21.344 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:19:21.348 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:19:51.426 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:19:51.429 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:20:21.520 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:20:21.523 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:20:51.589 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:20:51.593 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:21:21.663 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:21:21.666 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:21:51.733 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:21:51.736 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:22:21.806 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:22:21.809 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:22:51.875 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:22:51.878 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:23:21.949 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:23:21.954 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:23:52.027 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:23:52.030 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:24:22.092 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:24:22.096 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:24:52.158 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:24:52.161 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:25:22.236 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:25:22.239 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:25:52.306 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:25:52.310 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:26:22.394 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:26:22.398 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:26:52.467 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:26:52.471 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:27:22.539 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:27:22.542 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:27:52.610 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:27:52.614 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:28:22.682 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:28:22.685 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:28:52.746 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:28:52.749 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:29:22.825 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:29:22.828 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:29:52.889 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:29:52.893 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:30:22.960 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:30:22.963 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:30:53.032 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:30:53.036 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:31:23.103 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:31:23.106 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:31:53.178 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:31:53.181 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:32:23.266 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:32:23.270 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:32:53.330 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:32:53.334 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:33:23.406 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:33:23.409 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:33:53.482 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:33:53.491 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:34:23.558 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:34:23.562 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:34:53.634 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:34:53.638 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:35:23.709 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:35:23.713 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:35:53.786 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:35:53.789 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:36:23.861 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:36:23.864 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:36:53.938 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:36:53.941 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:37:24.012 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:37:24.016 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:37:54.082 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:37:54.086 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:38:24.155 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:38:24.159 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:38:54.225 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:38:54.229 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:39:24.301 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:39:24.305 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:39:54.369 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:39:54.373 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:40:24.436 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:40:24.439 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:40:54.504 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:40:54.508 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:41:24.580 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:41:24.585 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:41:54.649 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:41:54.653 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:42:24.722 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:42:24.726 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:42:54.801 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:42:54.805 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:43:24.874 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:43:24.877 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:43:54.946 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:43:54.950 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:44:25.018 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:44:25.021 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:44:55.096 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:44:55.100 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:45:25.169 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:45:25.173 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:45:55.232 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:45:55.236 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:46:25.304 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:46:25.307 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:46:55.366 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:46:55.370 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:47:25.438 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:47:25.442 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:47:55.536 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:47:55.543 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:48:25.614 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:48:25.617 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:48:55.679 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:48:55.683 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:49:25.749 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:49:25.753 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:49:55.814 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:49:55.819 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:50:25.893 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:50:25.897 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:50:55.991 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:50:55.995 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:51:26.062 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:51:26.066 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:51:56.127 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:51:56.130 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:52:26.331 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:52:26.335 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:52:56.404 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:52:56.408 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:53:26.481 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:53:26.484 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:53:56.554 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:53:56.558 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:54:26.633 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:54:26.637 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:54:56.713 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:54:56.717 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:55:26.784 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:55:26.788 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:55:56.852 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:55:56.856 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:56:26.928 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:56:26.932 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:56:56.986 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:56:56.990 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:57:27.080 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:57:27.115 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:57:57.179 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:57:57.183 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:58:27.249 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:58:27.253 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:58:57.314 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:58:57.318 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:59:27.384 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:59:27.388 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:59:57.457 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T22:59:57.462 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:00:27.537 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:00:27.541 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:00:57.610 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:00:57.614 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:01:27.679 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:01:27.683 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:01:57.743 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:01:57.747 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:02:27.831 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:02:27.834 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:02:57.897 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:02:57.901 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:03:27.977 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:03:27.980 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:03:58.050 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:03:58.053 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:04:28.125 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:04:28.129 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:04:58.206 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:04:58.209 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:05:28.277 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:05:28.281 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:05:58.344 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:05:58.347 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:06:28.425 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:06:28.429 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:06:58.497 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:06:58.500 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:07:28.589 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:07:28.592 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:07:58.665 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:07:58.669 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:08:28.731 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:08:28.734 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:08:58.809 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:08:58.813 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:09:28.891 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:09:28.895 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:09:58.971 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:09:58.974 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:10:29.042 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:10:29.050 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:10:59.121 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:10:59.125 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:11:29.195 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:11:29.198 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:11:59.265 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:11:59.268 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:12:29.337 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:12:29.341 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:12:59.401 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:12:59.405 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:13:29.480 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:13:29.484 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:13:59.555 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:13:59.559 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:14:29.632 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:14:29.635 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:14:59.697 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:14:59.700 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:15:29.767 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:15:29.772 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:15:59.832 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:15:59.836 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:16:29.909 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:16:29.913 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:16:59.985 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:16:59.988 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:17:30.053 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:17:30.056 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:18:00.128 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:18:00.132 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:18:30.204 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:18:30.208 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:19:00.298 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:19:00.301 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:19:30.372 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:19:30.376 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:20:00.442 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:20:00.445 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:20:30.515 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:20:30.519 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:21:00.585 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:21:00.589 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:21:30.659 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:21:30.662 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:22:00.737 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:22:00.741 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:22:30.811 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:22:30.814 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:23:00.881 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:23:00.886 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:23:30.953 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:23:30.957 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:24:01.025 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:24:01.029 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:24:31.104 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:24:31.108 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:25:01.194 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:25:01.198 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:25:31.272 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:25:31.276 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:26:01.345 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:26:01.349 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:26:31.424 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:26:31.429 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:27:01.496 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:27:01.500 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:27:31.575 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:27:31.578 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:28:01.641 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:28:01.644 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:28:31.718 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:28:31.721 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:29:01.793 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:29:01.796 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:29:31.861 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:29:31.864 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:30:01.936 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:30:01.940 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:30:32.013 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:30:32.016 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:31:02.089 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:31:02.093 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:31:32.164 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:31:32.167 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:32:02.233 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:32:02.237 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:32:32.299 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:32:32.302 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:33:02.359 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:33:02.363 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:33:32.434 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:33:32.437 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:34:02.512 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:34:02.516 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:34:32.585 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:34:32.589 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:35:02.648 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:35:02.651 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:35:32.836 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:35:32.840 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:36:02.908 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:36:02.912 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:36:32.979 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:36:32.982 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:37:03.052 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:37:03.055 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:37:33.132 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:37:33.136 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:38:03.196 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:38:03.199 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:38:33.266 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:38:33.270 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:39:03.340 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:39:03.343 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:39:33.417 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:39:33.421 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:40:03.475 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:40:03.478 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:40:33.547 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:40:33.551 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:41:03.627 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:41:03.631 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:41:33.695 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:41:33.699 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:42:03.884 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:42:03.887 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:42:33.955 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:42:33.958 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:43:04.023 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:43:04.027 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:43:34.098 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:43:34.102 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:44:04.175 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:44:04.179 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:44:34.274 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:44:34.277 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:45:04.351 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:45:04.355 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:45:34.426 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:45:34.429 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:46:04.490 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:46:04.493 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:46:34.561 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:46:34.565 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:47:04.649 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:47:04.653 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:47:34.721 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:47:34.725 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:48:04.792 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:48:04.796 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:48:34.855 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:48:34.858 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:49:04.928 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:49:04.932 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:49:35.017 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:49:35.021 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:50:05.187 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:50:05.190 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:50:35.267 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:50:35.271 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:51:05.341 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:51:05.344 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:51:35.418 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:51:35.421 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:52:05.497 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:52:05.501 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:52:35.569 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:52:35.572 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:53:05.637 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:53:05.640 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:53:35.704 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:53:35.707 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:54:05.773 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:54:05.776 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:54:35.871 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:54:35.874 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:55:05.941 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:55:05.948 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:55:36.024 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:55:36.027 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:56:06.118 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:56:06.121 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:56:36.190 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:56:36.194 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:57:06.280 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:57:06.284 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:57:36.350 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:57:36.353 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:58:06.456 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:58:06.459 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:58:36.527 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:58:36.530 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:59:06.624 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:59:06.627 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:59:36.712 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-14T23:59:36.716 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:00:06.784 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:00:06.788 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:00:36.865 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:00:36.869 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:01:06.964 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:01:06.968 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:01:37.028 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:01:37.032 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:02:07.107 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:02:07.111 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:02:37.168 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:02:37.172 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:03:07.244 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:03:07.247 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:03:37.320 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:03:37.324 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:04:07.501 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:04:07.505 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:04:37.563 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:04:37.567 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:05:07.639 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:05:07.643 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:05:37.706 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:05:37.709 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:06:07.786 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:06:07.790 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:06:37.849 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:06:37.853 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:07:07.918 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:07:07.922 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:07:37.990 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:07:37.993 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:08:08.070 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:08:08.074 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:08:38.134 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:08:38.137 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:09:08.205 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:09:08.209 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:09:38.269 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:09:38.273 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:10:08.343 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:10:08.346 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:10:38.406 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:10:38.410 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:11:08.485 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:11:08.488 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:11:38.549 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:11:38.553 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:12:08.629 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:12:08.633 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:12:38.692 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:12:38.696 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:13:08.766 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:13:08.770 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:13:38.830 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:13:38.835 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:14:08.902 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:14:08.906 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:14:38.965 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:14:38.968 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:15:09.037 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:15:09.040 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:15:39.101 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:15:39.104 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:16:09.172 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:16:09.176 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:16:39.236 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:16:39.240 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:17:09.311 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:17:09.315 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:17:39.375 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:17:39.379 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:18:09.450 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:18:09.454 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:18:39.510 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:18:39.514 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:19:09.585 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:19:09.590 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:19:39.666 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:19:39.671 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:20:09.745 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:20:09.749 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:20:39.817 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:20:39.821 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:21:09.894 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:21:09.898 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:21:39.956 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:21:39.960 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:22:10.028 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:22:10.032 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:22:40.104 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:22:40.107 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:23:10.180 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:23:10.183 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:23:40.242 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:23:40.246 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:24:10.320 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:24:10.323 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:24:40.386 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:24:40.390 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:25:10.457 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:25:10.460 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:25:40.535 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:25:40.538 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:26:10.615 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:26:10.619 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:26:40.689 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:26:40.693 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:27:10.767 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:27:10.771 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:27:40.838 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:27:40.842 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:28:10.915 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:28:10.919 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:28:40.976 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:28:40.979 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:29:11.047 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:29:11.051 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:29:41.109 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:29:41.112 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:30:11.182 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:30:11.186 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:30:41.245 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:30:41.249 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:31:11.318 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:31:11.321 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:31:41.397 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:31:41.400 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:32:11.470 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:32:11.473 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:32:41.540 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:32:41.544 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:33:11.613 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:33:11.617 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:33:41.675 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:33:41.679 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:34:11.748 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:34:11.752 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:34:41.819 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:34:41.822 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:35:11.924 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:35:11.928 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:35:41.988 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:35:41.992 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:36:12.060 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:36:12.064 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:36:42.122 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:36:42.126 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:37:12.195 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:37:12.199 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:37:42.273 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:37:42.277 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:38:12.355 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:38:12.359 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:38:42.510 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:38:42.514 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:39:12.588 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:39:12.592 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:39:42.651 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:39:42.655 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:40:12.748 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:40:12.751 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:40:42.811 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:40:42.815 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:41:12.899 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:41:12.903 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:41:42.966 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:41:42.969 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:42:13.046 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:42:13.050 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:42:43.139 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:42:43.143 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:43:13.223 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:43:13.226 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:43:43.290 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:43:43.294 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:44:13.383 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:44:13.386 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:44:43.447 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:44:43.451 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:45:13.538 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:45:13.543 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:45:43.611 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:45:43.615 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:46:13.686 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:46:13.690 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:46:43.750 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:46:43.754 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:47:13.825 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:47:13.829 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:47:43.913 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:47:43.918 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:48:13.994 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:48:13.997 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:48:44.060 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:48:44.064 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:49:14.135 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:49:14.139 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:49:44.200 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:49:44.206 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:50:14.305 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:50:14.309 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:50:44.367 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:50:44.371 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:51:14.440 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:51:14.444 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:51:44.510 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:51:44.514 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:52:14.699 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:52:14.703 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:52:44.763 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:52:44.767 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:53:14.834 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:53:14.837 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:53:44.898 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:53:44.901 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:54:14.978 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:54:14.981 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:54:45.041 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:54:45.044 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:55:15.129 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:55:15.133 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:55:45.200 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:55:45.204 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:56:15.273 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:56:15.277 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:56:45.344 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:56:45.348 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:57:15.416 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:57:15.420 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:57:45.480 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:57:45.483 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:58:15.559 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:58:15.563 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:58:45.630 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:58:45.634 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:59:15.702 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:59:15.705 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:59:45.790 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T00:59:45.794 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:00:15.863 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:00:15.866 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:00:45.926 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:00:45.930 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:01:16.006 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:01:16.009 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:01:46.071 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:01:46.075 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:02:16.149 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:02:16.154 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:02:46.246 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:02:46.250 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:03:16.325 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:03:16.330 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:03:46.398 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:03:46.402 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:04:16.587 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:04:16.591 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:04:46.658 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:04:46.661 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:05:16.730 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:05:16.734 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:05:46.799 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:05:46.803 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:06:16.873 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:06:16.877 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:06:46.936 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:06:46.939 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:07:17.008 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:07:17.012 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:07:47.186 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:07:47.190 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:08:17.260 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:08:17.264 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:08:47.324 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:08:47.327 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:09:17.402 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:09:17.407 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:09:47.474 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:09:47.477 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:10:17.547 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:10:17.551 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:10:47.610 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:10:47.615 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:11:17.688 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:11:17.691 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:11:47.752 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:11:47.756 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:12:17.824 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:12:17.828 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:12:47.887 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:12:47.891 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:13:17.960 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:13:17.963 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:13:48.029 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:13:48.033 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:14:18.103 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:14:18.106 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:14:48.164 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:14:48.168 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:15:18.380 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:15:18.384 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:15:48.449 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:15:48.453 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:16:18.530 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:16:18.533 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:16:48.593 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:16:48.597 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:17:18.673 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:17:18.676 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:17:48.736 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:17:48.740 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:18:18.828 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:18:18.832 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:18:48.883 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:18:48.887 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:19:18.963 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:19:18.967 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:19:49.026 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:19:49.029 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:20:19.098 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:20:19.103 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:20:49.161 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:20:49.164 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:21:19.257 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:21:19.261 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:21:49.320 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:21:49.324 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:22:19.415 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:22:19.418 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:22:49.478 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:22:49.482 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:23:19.558 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:23:19.561 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:23:49.629 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:23:49.633 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:24:19.712 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:24:19.716 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:24:49.789 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:24:49.793 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:25:19.861 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:25:19.865 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:25:49.933 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:25:49.936 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:26:19.996 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:26:20.000 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:26:50.059 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:26:50.063 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:27:20.281 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:27:20.285 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:27:50.344 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:27:50.348 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:28:20.416 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:28:20.419 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:28:50.479 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:28:50.482 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:29:20.556 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:29:20.560 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:29:50.640 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:29:50.643 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:30:20.716 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:30:20.720 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:30:50.796 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:30:50.800 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:31:20.871 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:31:20.875 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:31:50.939 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:31:50.942 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:32:21.031 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:32:21.036 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:32:51.098 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:32:51.102 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:33:21.175 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:33:21.178 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:33:51.259 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:33:51.263 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:34:21.334 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:34:21.337 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:34:51.414 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:34:51.418 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:35:21.485 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:35:21.488 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:35:51.557 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:35:51.561 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:36:21.642 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:36:21.645 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:36:51.722 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:36:51.725 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:37:21.807 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:37:21.811 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:37:51.866 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:37:51.869 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:38:21.954 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:38:21.958 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:38:52.018 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:38:52.021 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:39:22.093 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:39:22.097 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:39:52.174 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:39:52.178 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:40:22.250 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:40:22.253 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:40:52.318 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:40:52.322 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:41:22.393 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:41:22.397 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:41:52.457 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:41:52.460 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:42:22.532 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:42:22.536 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:42:52.604 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:42:52.607 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:43:22.676 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:43:22.693 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:43:52.756 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:43:52.759 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:44:22.832 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:44:22.835 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:44:52.891 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:44:52.895 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:45:22.968 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:45:22.982 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:45:53.052 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:45:53.055 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:46:23.123 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:46:23.126 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:46:53.186 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:46:53.189 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:47:23.258 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:47:23.262 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:47:53.326 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:47:53.329 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:48:23.401 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:48:23.405 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:48:53.462 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:48:53.465 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:49:23.550 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:49:23.553 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:49:53.613 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:49:53.616 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:50:23.688 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:50:23.692 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:50:53.752 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:50:53.756 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:51:23.824 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:51:23.828 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:51:53.884 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:51:53.887 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:52:24.089 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:52:24.092 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:52:54.152 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:52:54.155 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:53:24.227 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:53:24.232 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:53:54.298 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:53:54.302 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:54:24.370 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:54:24.374 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:54:54.434 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:54:54.437 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:55:24.544 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:55:24.548 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:55:54.607 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:55:54.610 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:56:24.686 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:56:24.690 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:56:54.745 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:56:54.748 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:57:24.818 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:57:24.821 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:57:54.872 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:57:54.875 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:58:24.935 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:58:24.939 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:58:54.998 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:58:55.002 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:59:25.073 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:59:25.076 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:59:55.133 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T01:59:55.137 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:00:25.205 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:00:25.208 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:00:55.385 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:00:55.388 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:01:25.458 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:01:25.461 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:01:55.521 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:01:55.524 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:02:25.596 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:02:25.599 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:02:55.659 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:02:55.662 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:03:25.727 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:03:25.731 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:03:55.798 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:03:55.801 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:04:25.869 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:04:25.872 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:04:55.933 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:04:55.937 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:05:26.005 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:05:26.008 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:05:56.069 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:05:56.073 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:06:26.146 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:06:26.150 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:06:56.319 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:06:56.323 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:07:26.403 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:07:26.406 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:07:56.479 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:07:56.483 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:08:26.551 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:08:26.555 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:08:56.614 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:08:56.618 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:09:26.686 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:09:26.690 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:09:56.748 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:09:56.751 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:10:26.820 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:10:26.823 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:10:56.901 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:10:56.904 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:11:26.971 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:11:26.974 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:11:57.053 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:11:57.056 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:12:27.124 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:12:27.127 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:12:57.187 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:12:57.191 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:13:27.260 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:13:27.264 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:13:57.345 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:13:57.348 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:14:27.436 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:14:27.440 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:14:57.499 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:14:57.502 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:15:27.571 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:15:27.575 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:15:57.634 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:15:57.637 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:16:27.705 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:16:27.709 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:16:57.777 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:16:57.781 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:17:27.847 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:17:27.852 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:17:57.921 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:17:57.924 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:18:27.992 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:18:27.996 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:18:58.063 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:18:58.067 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:19:28.160 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:19:28.164 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:19:58.224 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:19:58.228 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:20:28.295 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:20:28.299 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:20:58.366 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:20:58.370 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:21:28.439 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:21:28.442 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:21:58.519 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:21:58.523 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:22:28.592 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:22:28.596 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:22:58.678 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:22:58.681 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:23:28.749 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:23:28.753 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:23:58.814 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:23:58.817 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:24:28.902 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:24:28.905 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:24:58.966 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:24:58.971 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:25:29.037 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:25:29.041 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:25:59.100 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:25:59.103 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:26:29.205 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:26:29.208 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:26:59.393 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:26:59.397 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:27:29.465 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:27:29.469 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:27:59.528 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:27:59.532 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:28:29.600 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:28:29.603 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:28:59.663 DEBUG:teuthology.orchestra.run.smithi039:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:28:59.667 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-15T02:29:10.849 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2024-05-15T02:29:10.850 DEBUG:teuthology.task.console_log:Killing console logger for smithi039 2024-05-15T02:29:10.851 DEBUG:teuthology.task.console_log:Killing console logger for smithi062 2024-05-15T02:29:10.851 DEBUG:teuthology.exit:Finished running handlers